-- Logs begin at Sat 2022-06-25 20:01:14 UTC, end at Sat 2022-06-25 22:30:22 UTC. -- Jun 25 20:34:36.117545 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jun 25 20:34:36.126587 ncdv-master-1 devstack@keystone.service[97705]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 20:34:36 2022] *** Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: nodename: ncdv-master-1 Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: machine: x86_64 Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: clock source: unix Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: pcre jit disabled Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: detected number of CPU cores: 4 Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: current working directory: / Jun 25 20:34:36.128591 ncdv-master-1 devstack@keystone.service[97705]: detected binary path: /usr/bin/uwsgi-core Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: your processes number limit is 47680 Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: your memory page size is 4096 bytes Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: detected max file descriptor number: 2048 Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: lock engine: pthread robust mutexes Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: thunder lock: enabled Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 25 20:34:36.129177 ncdv-master-1 devstack@keystone.service[97705]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 20:34:36.177461 ncdv-master-1 devstack@keystone.service[97705]: Python main interpreter initialized at 0x5631046b29c0 Jun 25 20:34:36.177461 ncdv-master-1 devstack@keystone.service[97705]: python threads support enabled Jun 25 20:34:36.177461 ncdv-master-1 devstack@keystone.service[97705]: your server socket listen backlog is limited to 100 connections Jun 25 20:34:36.177461 ncdv-master-1 devstack@keystone.service[97705]: your mercy for graceful operations on workers is 90 seconds Jun 25 20:34:36.177831 ncdv-master-1 devstack@keystone.service[97705]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 20:34:36.177907 ncdv-master-1 devstack@keystone.service[97705]: *** Operational MODE: preforking *** Jun 25 20:34:36.178144 ncdv-master-1 devstack@keystone.service[97705]: *** uWSGI is running in multiple interpreter mode *** Jun 25 20:34:36.178144 ncdv-master-1 devstack@keystone.service[97705]: spawned uWSGI master process (pid: 97705) Jun 25 20:34:36.178359 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jun 25 20:34:36.179490 ncdv-master-1 devstack@keystone.service[97705]: spawned uWSGI worker 1 (pid: 97719, cores: 1) Jun 25 20:34:36.179490 ncdv-master-1 devstack@keystone.service[97705]: spawned uWSGI worker 2 (pid: 97720, cores: 1) Jun 25 20:34:36.179490 ncdv-master-1 devstack@keystone.service[97705]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 20:34:41.840508 ncdv-master-1 devstack@keystone.service[97720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:41.840508 ncdv-master-1 devstack@keystone.service[97720]: from cryptography.utils import int_from_bytes Jun 25 20:34:41.841215 ncdv-master-1 devstack@keystone.service[97720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:41.841215 ncdv-master-1 devstack@keystone.service[97720]: from cryptography.utils import int_from_bytes Jun 25 20:34:41.843421 ncdv-master-1 devstack@keystone.service[97719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:41.843421 ncdv-master-1 devstack@keystone.service[97719]: from cryptography.utils import int_from_bytes Jun 25 20:34:41.843915 ncdv-master-1 devstack@keystone.service[97719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:41.843915 ncdv-master-1 devstack@keystone.service[97719]: from cryptography.utils import int_from_bytes Jun 25 20:34:41.890552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:34:41.890732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:34:41.890807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:34:41.890883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] command line args: [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:34:41.891020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:34:41.891165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:34:41.891248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] command line args: [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:34:41.891314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ================================================================================ {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:34:41.891440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:34:41.891526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] admin_token = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.891600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ================================================================================ {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:34:41.891798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] config_dir = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.891931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] admin_token = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] config_dir = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] config_source = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] debug = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] config_source = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] debug = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.892995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_config_append = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.893983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_config_append = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_dir = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_file = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_dir = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_file = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.894934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.895972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.896957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.897929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] publish_errors = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] publish_errors = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.898957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] standard_threads = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.899903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] standard_threads = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] use_journal = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] use_json = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] use_journal = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.900978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] use_stderr = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] use_json = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] use_syslog = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] use_stderr = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] use_syslog = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:41.901691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.901866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.901989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.902949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.903973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.904948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.905917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.906962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.907962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.908895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.909955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.910887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.911989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.912945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.913998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.914941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.915891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.916997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.917952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.918977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.919914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.920982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.921995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.922924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.923930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.924874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.925998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.external = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.external = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.926972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.password = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.password = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] auth.token = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] auth.token = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.927974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.928952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.929948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.930902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.931873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.932926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.933880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.934975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.935928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.936999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.937917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.938893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.939831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.940848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.941943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.942960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.943964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.944891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.945890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.946980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.947946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.948955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.949915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.950902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.951884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.952987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.953965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.954936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.955906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.956920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.957904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.958915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.959893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] role.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] role.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.960894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] role.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] role.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.961994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.962981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.963937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.964994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.965877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.966872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.967953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.968946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.969989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.970933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.connection = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.971953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.connection = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.972931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.973864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.974972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.975997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:34:41.976613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:41.976949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:34:42.005254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.005489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.005582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.005707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.005797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.006011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.014067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.014283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.043475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.043633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.043736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.043805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.094697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.095251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.142671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.142878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.143332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.143577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.208953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.209096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.209209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.209289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.209350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.209508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.233692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.233886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.233991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.234912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.235031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.235117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.246279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.247050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.259962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.260570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:42.277686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.277896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:42.278017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.278178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:42.278259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.278424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:42.278545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.278679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.278758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:42.278943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.279688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.290446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.290686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.290812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.291012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.291196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.291289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.291412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.291534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.299406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.299604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.302694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.302878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.303007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.303904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.304964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.305759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.331894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.332107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.333530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.333673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.333831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.333951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.339122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.339246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.339381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.339482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.339611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.339782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.346955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.347187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.347325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.347581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.352140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.352447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.352570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.352779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.352904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.353884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.354002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.354130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.354383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.374265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.374542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.374663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.374822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.379123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.379377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.382799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.383074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.383219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.383410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.388075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.388353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.391672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.391975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.395414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.395698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.395816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.395969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.396900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.397047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.397219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.415831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.416150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.416276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.416496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.416622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.416772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.416893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.417083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.424619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.424956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.426330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.426607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.426728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.426872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.429716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.430007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.430278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.430888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.431049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.444135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.444452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.444645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.444740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.444982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.445937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.446016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.446326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.465188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.468449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.471745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.473261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.473389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.474984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.475581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.475870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.476912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.480225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.481849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.483270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.483417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.483733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.484026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.484914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.488108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.488397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.488710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.488957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.491514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.493204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.496452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.496735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.497016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.497292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.498423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.498737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.499018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.506583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.506843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.506972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.507107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.507205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.507506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.507890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.508164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.508701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.508701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.509004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.509312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.509591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.509871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.510133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.510376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.510629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.514974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:42.515271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.515560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.515832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.516104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.516377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.516657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.516931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.517207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.517478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.517745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.518021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.518285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.518551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:42.548502 ncdv-master-1 devstack@keystone.service[97719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631046b29c0 pid: 97719 (default app) Jun 25 20:34:42.551831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc32f4-21e4-4e62-a523-3bed07fc0477 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:42.552126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc32f4-21e4-4e62-a523-3bed07fc0477 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:42.552409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc32f4-21e4-4e62-a523-3bed07fc0477 None None] PATH_INFO: `/v3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:42.556150 ncdv-master-1 devstack@keystone.service[97720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631046b29c0 pid: 97720 (default app) Jun 25 20:34:42.556791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sat Jun 25 20:34:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.673045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.673632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.673632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.677956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:34:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:34:50.684326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.685136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.685292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.771278 ncdv-master-1 devstack@keystone.service[97719]: INFO dbcounter [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] Registered counter for database keystone Jun 25 20:34:50.795767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG oslo_db.sqlalchemy.engines [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:34:50.806155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writer thread running {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:34:51.089964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG passlib.handlers.bcrypt [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97719) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 25 20:34:51.090378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG passlib.handlers.bcrypt [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97719) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 25 20:34:51.145619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:51.147220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:51.276337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 25 20:34:51.316637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:51.394529 ncdv-master-1 devstack@keystone.service[97720]: INFO dbcounter [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] Registered counter for database keystone Jun 25 20:34:51.416047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG oslo_db.sqlalchemy.engines [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:34:51.427693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writer thread running {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:34:51.649806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbda2-af62-4b84-8c17-f1ba4ef2bae6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.655179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.655828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.656111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.656386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.665603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.714439 ncdv-master-1 devstack@keystone.service[97720]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 25 20:34:51.715008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362acaf-da8f-4cab-ac1b-8e836a4dee2f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.724888 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Jun 25 20:34:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 20:34:51.734525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:51.757702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30211fd-f00b-4ebb-b3ab-436fba9805ee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.764171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.765340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.765626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.765904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] PATH_INFO: `/v3/projects/7d98522b7634403f83ff66fd72edfd9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.767651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] RBAC: Authorizing `identity:get_project(project_id=7d98522b7634403f83ff66fd72edfd9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.818678 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 25 20:34:51.819031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b33e-77e4-4e90-90b2-f38608cf1e7d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.823881 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Jun 25 20:34:51 2022] GET /identity/v3/projects/7d98522b7634403f83ff66fd72edfd9e => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:54.069462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379dc-b4c9-4a7b-8735-88a8e68d8505 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.070061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379dc-b4c9-4a7b-8735-88a8e68d8505 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.070061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379dc-b4c9-4a7b-8735-88a8e68d8505 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.074140 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:34:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:54.081037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.081707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.081891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.108059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:54.109614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:54.119408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 25 20:34:54.143614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6379dc-b4c9-4a7b-8735-88a8e68d8505 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.158508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6379dc-b4c9-4a7b-8735-88a8e68d8505 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.164186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.164858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.165140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.165425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.173600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.175412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44724e-d1db-46c1-8a72-5084320aa5cf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.184446 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:34:54.190441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.201307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77650b0-f584-43d1-a5f9-e309cd87a828 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.207342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.208215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.208522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.208803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.210451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.212304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c7b6e-3827-419d-b3eb-6929d78f46eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.213951 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:56.535102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660edb-37df-438b-86c3-d0f875cd3b46 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.535683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660edb-37df-438b-86c3-d0f875cd3b46 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.535683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68660edb-37df-438b-86c3-d0f875cd3b46 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.537046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:56.542899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.543347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.543451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.561328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:56.562529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:56.586475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f640-c4ec-4afe-926b-f9599f7ce46c None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.586764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f640-c4ec-4afe-926b-f9599f7ce46c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.587040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f640-c4ec-4afe-926b-f9599f7ce46c None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.588371 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:34:56.593478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.593771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.594050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.635437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG passlib.handlers.bcrypt [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97720) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 25 20:34:56.635847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG passlib.handlers.bcrypt [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97720) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 25 20:34:56.646678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:56.671205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.681080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:56.682659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:56.695733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.776961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758a14-9de8-4e46-9605-3af452d3083f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.781791 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:56.804811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.809769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.810582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.810866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.811145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.822967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:56.834499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:56.835431 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:34:56.836237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:34:56.841548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.908135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c7b6-753e-4b8b-a5dd-c1db082efedd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.910423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.921014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.939783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6327be6-5835-417b-88e7-5e38018b5c54 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.944449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.945378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.945668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.945949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.974430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.975606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.975920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.976205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.977218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:56.977570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.979046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.995332 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:57.002040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.026504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.028044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.109510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada37ab-ebfc-4326-8aef-d445b3befa19 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.125535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:34:57.131498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.134302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.143462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.144352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.144671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.144952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.146183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.147697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.149349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:57.154669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.170052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.232895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a63f5f-d11d-499e-ad14-9ac97ad78ce8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.254506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994754-6859-4b59-8b14-1899903603c4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.266816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.267619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.267900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.268181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.286282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.287078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.287764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.287860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.288198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.288465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.290235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.291712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.293343 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:57.299183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:34:57.311946 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:57.312839 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:57.314212 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:34:57.314212 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:34:57.314212 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:57.314212 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:34:57.314212 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:34:57.319049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.382886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.387816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.406826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244919-aa6a-470b-9c08-0840bb1ab68d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.429257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714b6b-b7e6-4675-b1c9-0b4a2dd54c07 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.443546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.444339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.444688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.444970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.445810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.domain.id=default, user.id=152e93db3c4b47f4a0815a7df2a050f8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:57.446122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.447609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde476-4cc5-4a7d-80b0-37fda6cd360b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.454610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/role_assignments?user.id=152e93db3c4b47f4a0815a7df2a050f8&scope.domain.id=default&role.id=54803232909643ca80ca0cfb291c7f49 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:57.467401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.468097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.468378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.468683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.469438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:57.469747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.471193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915cdfe-6606-4119-a806-de7adaaee07c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.491783 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:00.009890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc6a5-3d21-4783-a0bf-990edc103a70 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.010941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc6a5-3d21-4783-a0bf-990edc103a70 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.011426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc6a5-3d21-4783-a0bf-990edc103a70 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.013127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:00.018912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d549cc-845c-4970-be88-a6b97edc5ae2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.019810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d549cc-845c-4970-be88-a6b97edc5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.020281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d549cc-845c-4970-be88-a6b97edc5ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.049844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-81d549cc-845c-4970-be88-a6b97edc5ae2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:00.051433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81d549cc-845c-4970-be88-a6b97edc5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:00.138259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:00.175852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc6a5-3d21-4783-a0bf-990edc103a70 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.287536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d88d-0b3b-454c-bfd1-d1c6d4c2e381 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.288250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d88d-0b3b-454c-bfd1-d1c6d4c2e381 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.288747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8d88d-0b3b-454c-bfd1-d1c6d4c2e381 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.290302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:00.295315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.295884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.296352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.329300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:00.338104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:00.362899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc6a5-3d21-4783-a0bf-990edc103a70 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.444112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.444278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.449246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.449588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.449864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.476867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:00.485799 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:00.486858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:00.487800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:00.496144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 13/25] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:00.502061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.512567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:00.526556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.551065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.725654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbde0-a690-4786-9f33-ed548c7f4135 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.765249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34265c-3f5c-4474-a3c5-acfd73541635 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.785832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.786803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.787228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.787647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.788726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:00.789172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:00.790724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:00.808654 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 14/27] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:00.814335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.841709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.842520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.842868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.843212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.844037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:00.846576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7b54-32dd-4b88-a566-9b34b528e630 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:00.909856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.977300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf973-1016-4af5-88d9-3821bc10356c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.991938 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 14/28] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 25 20:35:00 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:35:00.998317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d478abd-b8a9-4f13-9825-4446db889961 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.998965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d478abd-b8a9-4f13-9825-4446db889961 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.999458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d478abd-b8a9-4f13-9825-4446db889961 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.001480 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 15/29] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:01.011671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.012307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.012871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.031821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.033396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.033837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.034266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.035910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.037681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.039641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 15/30] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:01.044528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:01.044528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:01.046048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.111434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.209331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:01.237888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9768-71c4-4f67-a318-852b4eae2c39 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.253552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.288305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.289176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.289463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.289740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.294676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.296215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714b94-09f3-446d-9bfb-8799e1d76721 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.298335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:01.299693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59291b-1e4a-47aa-bc11-b439f7477c0a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.299984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59291b-1e4a-47aa-bc11-b439f7477c0a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.300270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59291b-1e4a-47aa-bc11-b439f7477c0a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.301567 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:01.309399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59291b-1e4a-47aa-bc11-b439f7477c0a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.312727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.418612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb88f-1fb7-4838-9590-9dfd48905c75 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.435927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59291b-1e4a-47aa-bc11-b439f7477c0a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.468414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.471974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.472551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.473193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.489364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.492090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.497649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.500947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.501194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.501523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] PATH_INFO: `/v3/domains/default/users/152e93db3c4b47f4a0815a7df2a050f8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.506212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=152e93db3c4b47f4a0815a7df2a050f8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.507985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6959e1-1fe3-4c6d-8b7d-ae97e3c8cf1d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-65e4e825-9283-456b-8e0e-01d1289d1057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:01.518154 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:01.518992 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:01.519836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:01.519836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:01.519836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:01.519836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:01.522326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:01.528462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.529165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.529652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.547965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:01.549551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:01.564504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.621375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 18/35] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:01.626523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.640865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 18/36] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 25 20:35:01 2022] PUT /identity/v3/domains/default/users/152e93db3c4b47f4a0815a7df2a050f8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:01.642911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47ceb-73d9-435b-8147-6a435d6c5816 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.643221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47ceb-73d9-435b-8147-6a435d6c5816 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.643546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47ceb-73d9-435b-8147-6a435d6c5816 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.652446 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:01.654213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.654480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.654765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.673602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:01.675214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:01.744691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.750635 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 20/38] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:01.757931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.771736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bbc28-cd7a-4bb9-ac64-ea17cc295549 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.829885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.830932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.831536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.832026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.833106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:01.833622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.835346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.850091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 19/39] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:01.851381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.864318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.888479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b39f-8ba5-4af7-888e-1ac06eb7d3e3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.925340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.926127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.926319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.926603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.927362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.928999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.952457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:01.952457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.971065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b634df-d0f9-4a2c-ba66-80da7eff5ece None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.013851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.027406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.028966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.029255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.029534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.030314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.032087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33005d66-8295-4fdc-8d53-32c897887c1c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.053515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:02.055779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6359e-540d-4274-8b74-2f0f50f5e35f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.056193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6359e-540d-4274-8b74-2f0f50f5e35f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.056529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6359e-540d-4274-8b74-2f0f50f5e35f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.060619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 21/42] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:02.066052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.067080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.067369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.081506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891bfeb-d350-46cf-bc10-5773ac42f005 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.091611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:02.093389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:02.124521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.125366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.125723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.126110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.126913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.128625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.179142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.181415 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 22/43] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/projects => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:02.187004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:02.211999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.351164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f7b5-a2e6-4b35-9174-f2633f3842cb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.355615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.392633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.393455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.393737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.394014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.395225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.396763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99357568-8544-4697-a1c8-26c0456b948d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.398672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 23/45] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:02.404355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.512599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61dab1-5671-43cd-8f7a-143ae14924fd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.545965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.546630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.546944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.547224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.548205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.549709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e977dc-ea34-40ed-bb95-ba9ceb0cc625 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.577963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:35:02 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:04.044175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069190-f753-4f33-a2ea-901b516039e7 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.044735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069190-f753-4f33-a2ea-901b516039e7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.044735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069190-f753-4f33-a2ea-901b516039e7 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.046144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:04.051852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.052271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.052445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.070351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:04.071497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:04.120954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.143161 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:04.168196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069190-f753-4f33-a2ea-901b516039e7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.276076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069190-f753-4f33-a2ea-901b516039e7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.311734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.313105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.313614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.314140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.328162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:04.335882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:04.336845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:04.337602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 25/49] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:04.344318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.450175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb63a4b-36b4-4518-b4f2-c2a0114f01f1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.484573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.485249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.485531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.485809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.486559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:04.486865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.488274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.500109 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 25/50] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.505934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.538773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.606684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd9bd3-5bf6-479d-a466-f94343d9e9c3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.644303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.645275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.645564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.645847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.647228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.648855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.650720 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.656461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.703290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.763037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655335f-eedc-4ca3-b4b1-03401d1377d4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.798703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.799512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.799797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.800073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.801406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.802934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034bf04-07e7-4977-bd8e-3bbc7dd348fa None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.805738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.811513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.866272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230254-6912-406a-90e3-24ce640420b3 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.866458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230254-6912-406a-90e3-24ce640420b3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.866746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230254-6912-406a-90e3-24ce640420b3 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.868397 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 27/53] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:04.874022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.874318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.874604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.893858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:04.895081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:04.915501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.919559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ece3-1fb4-4b23-a3e9-77b441804b22 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.954186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.954840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.955127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.955407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.956255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.domain.id=default, user.id=152e93db3c4b47f4a0815a7df2a050f8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:04.956605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.958090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.962147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 28/54] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:04.964474 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/role_assignments?user.id=152e93db3c4b47f4a0815a7df2a050f8&scope.domain.id=default&role.id=54803232909643ca80ca0cfb291c7f49 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.987380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.034307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:05.098730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada4e5f-bea0-4aa4-951b-5e5c940b562a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.138798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.139524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.139804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.140080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.141332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.142814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf8688-8b2d-4884-b89b-dac764c42a20 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.144498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.150295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.257241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71735-89dd-4d92-a939-e20703c9236b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.291262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.291917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.292202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.292485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.293232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.294708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df701da3-7fde-407b-a4d6-cfd92caca434 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.323008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Jun 25 20:35:05 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:07.604709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1cb8-079e-40eb-9a67-4c9b4f22976d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:07.605273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1cb8-079e-40eb-9a67-4c9b4f22976d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:07.605273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1cb8-079e-40eb-9a67-4c9b4f22976d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:07.607411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:07.616463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:07.616835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:07.617102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:07.639620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:07.640912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:07.651765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:07.714973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:07.744986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1cb8-079e-40eb-9a67-4c9b4f22976d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:07.864735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1cb8-079e-40eb-9a67-4c9b4f22976d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:07.876887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:07.919639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:07.920460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:07.920741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:07.921015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:07.923029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:07.925427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772406f-72da-4ca8-811f-1f756c9e79ee None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:07.927946 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:07.934688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.051616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a098-34db-48ac-94d1-fa7c2082e376 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.094451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.095136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.095416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.095686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.096392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.097937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdb9fb-28c8-4f7e-a291-c1a2b03386fa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.126793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:07 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:11.595946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731f8c-4ee6-4458-97e8-b2482a36f8aa None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.596990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731f8c-4ee6-4458-97e8-b2482a36f8aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.597500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731f8c-4ee6-4458-97e8-b2482a36f8aa None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.599129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:11.607618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7c74-0ae3-4d1d-a622-12d3fa92041b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.608535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7c74-0ae3-4d1d-a622-12d3fa92041b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.609006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d7c74-0ae3-4d1d-a622-12d3fa92041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.618218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:11.633163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4e3d7c74-0ae3-4d1d-a622-12d3fa92041b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:11.634442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e3d7c74-0ae3-4d1d-a622-12d3fa92041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:11.738171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:11.781385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7731f8c-4ee6-4458-97e8-b2482a36f8aa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:11.792064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5401d-5832-4dd5-b360-243088909b55 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.792355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5401d-5832-4dd5-b360-243088909b55 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.792669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5401d-5832-4dd5-b360-243088909b55 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.794202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 32/64] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:11.801427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a11b9-16c7-4d5f-93c0-ba131a3f4b52 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.801720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a11b9-16c7-4d5f-93c0-ba131a3f4b52 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.802005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a11b9-16c7-4d5f-93c0-ba131a3f4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.825866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e39a11b9-16c7-4d5f-93c0-ba131a3f4b52 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:11.828116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e39a11b9-16c7-4d5f-93c0-ba131a3f4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:11.900570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7731f8c-4ee6-4458-97e8-b2482a36f8aa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:11.901624 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:11.903196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349abe8f-d7eb-47dc-bfc8-19a69fa2904f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.903650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349abe8f-d7eb-47dc-bfc8-19a69fa2904f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.904140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349abe8f-d7eb-47dc-bfc8-19a69fa2904f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.905883 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 34/66] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:11.911405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.911956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.912554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.929525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:11.931101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:11.938751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:11.939571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.939855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.940135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.952187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:11.961069 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:11.961963 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:11.962692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:11.964894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:11.965896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.001175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.002553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:12.003304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.008794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.076053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100944c0-c979-42c3-904d-406af08100f5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.113158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.113959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.114246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.114520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.123478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46957e5f-78f4-4c36-b3d2-d4982792b710 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.125194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d9c644dc-be14-4963-8129-8bdb99695da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:12.132853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:12.133732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:12.134481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:12.135590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece32a6-e338-42b0-a4b7-41629ae0a1bc None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.135590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece32a6-e338-42b0-a4b7-41629ae0a1bc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.135832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece32a6-e338-42b0-a4b7-41629ae0a1bc None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.137296 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 35/70] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:12.137784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece32a6-e338-42b0-a4b7-41629ae0a1bc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.173679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.174282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.174572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.174847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.175618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:12.175934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.177379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.190239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.190239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.243227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.251826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.260366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece32a6-e338-42b0-a4b7-41629ae0a1bc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.291434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4cc0-afea-49eb-9634-bd5496cab0ce None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.295797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.296650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.296939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.297216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.307865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3fa8c26e-1965-4c22-b87c-f78c615f0b26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:12.315995 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:12.316855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:12.317605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 36/72] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:12.318855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b615-1289-4438-9e3d-bfb93f7c750c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.318855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b615-1289-4438-9e3d-bfb93f7c750c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.319002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93b615-1289-4438-9e3d-bfb93f7c750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.327019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.327692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.327978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.328255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.329036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:12.329344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.330735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.335407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1a93b615-1289-4438-9e3d-bfb93f7c750c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:12.336653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1a93b615-1289-4438-9e3d-bfb93f7c750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:12.338794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.339573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.404326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:12.405711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54299ad-964a-4316-a63e-3f90974f5b5b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.406003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54299ad-964a-4316-a63e-3f90974f5b5b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.406292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54299ad-964a-4316-a63e-3f90974f5b5b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.407546 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 38/75] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:12.408248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54299ad-964a-4316-a63e-3f90974f5b5b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.445849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38ebc2-bc48-4008-a103-0f9a5ac40697 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.461870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.480296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.481216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.481503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.481784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.494888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.495346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.496398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.498131 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 38/76] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.501340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.511457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54299ad-964a-4316-a63e-3f90974f5b5b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.544200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.544899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.545188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.545468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.546257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:12.546563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.547943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a194-a84e-4ab1-9a87-0a1ddc117fbf None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.555761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 39/77] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.557121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.557392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.557671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.574073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:12.575277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:12.601340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015f04-9453-447f-bb41-52b55f02dc49 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.637894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.638757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.639045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.639327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.640595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.642076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.643735 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 39/78] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.648619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.651821 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:12.652722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.695365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.728673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.750703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aace4-841b-44cb-96e4-4b0b0d347b11 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.754698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388727-9d86-4cae-800f-38b81d294e70 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.786406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.787101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.787418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.787706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.791835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.792700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.792993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.793267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.794493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.795968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.797806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 40/80] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.798355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.859701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.861203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.898686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cc5c-38cc-40c1-8ca8-7d21da2995bc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.909262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.936009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.936909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.937921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.938285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.938599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.939842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.941336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.944479 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.944479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.964730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 41/82] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:12.965832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.051849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40cbf3-c415-467d-bfd0-c974fc43fc3b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.069748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5d06-d6b1-4ae9-8a55-2943f5e66c0e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.086678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.087353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.087631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.087907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.104527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.105335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.105629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.105906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.116395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:13.124010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:13.124862 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:13.125624 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:13.126443 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 42/83] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:13.127353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.134396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.156669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.158154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.170417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.230116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2be22-2f35-485a-b7ab-f566855729c5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.254045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 42/84] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:13.254696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.266431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.267199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.267494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.267781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.268537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.270011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.305175 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 43/85] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:13 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:13.305175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.341325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.365773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3fd92-2f1b-45ca-9887-e9dbafbcce7d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.404061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.404879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.405237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.405517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.412621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.420537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598908fb-231c-41f3-bfc6-8d4f33a1cc27 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.461109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.462002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.462285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.462563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.463812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.465343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.467155 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 44/86] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.467951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.487825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.489850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.580821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db640d20-d767-4f33-aad5-8d3492891197 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.588285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.616509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 43/87] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:13.616509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.634198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.635197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.635490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.635757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.636705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:13.637019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.639209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.649523 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.650578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.677672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.732694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54304ca-a87d-4ea0-960b-6ff5cad7f2b2 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.768315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.769380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.769730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.770121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.771416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.773080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.775203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 44/89] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.780638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a7027-b52d-48a6-b2d6-926f0f7d2186 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.780780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.828818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.829760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.830263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.830726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.832689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:13.833259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.835993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.839520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.851714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 46/90] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=7faa3dc09867417b8ea82703161cde19 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.853290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.924260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99a69b-0d05-49bf-bcc2-49cce4924fd1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.998155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.999059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.999352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.999633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.002343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.003856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.004819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.005741 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.006754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.029253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe67b0-e605-43d5-b713-d3bd6218c3da None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.096660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.097500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.097786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.098067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.102140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.103638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.105797 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 47/92] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.106459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.165059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e326987-2fae-44df-a26c-b3da031fa65d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.182539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.209700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.210823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.211319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.211778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.212845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=152e93db3c4b47f4a0815a7df2a050f8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:14.213481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.215140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.221715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/role_assignments?user.id=152e93db3c4b47f4a0815a7df2a050f8&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.222871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.304455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a18b3-827c-48f3-85fb-171c3b95c30b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.412540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb71abf-6513-4397-a437-d9331ca6810b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.441436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.441974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.442142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.442411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.443272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:14.443676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.445198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.458170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.459227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.459702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.460179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.466292 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 48/94] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.525344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.558431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.560304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.679350 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:14.689644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.729382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.852699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b2f36-6f03-4dda-be7d-214d140bdf26 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.901730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.902624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.902907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.903184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] PATH_INFO: `/v3/projects/faf6006bec684451bfaea2f941d3f744` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.904455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] RBAC: Authorizing `identity:get_project(project_id=faf6006bec684451bfaea2f941d3f744)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.905927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2293-8c48-4ed3-8989-b6799b03f87c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.907805 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 49/96] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/projects/faf6006bec684451bfaea2f941d3f744 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.913653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:15.022753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.045107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025849-7410-4adf-9c25-c02c20577a0d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:15.079229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:15.080259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.080757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.081232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.082272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=faf6006bec684451bfaea2f941d3f744, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:15.082779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:15.084573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05300b15-5a78-42dd-9e8a-52cd245234cb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:15.090371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=faf6006bec684451bfaea2f941d3f744&role.id=7faa3dc09867417b8ea82703161cde19 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:16.182602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55cc9-f63a-4405-96a9-556acaad2c76 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.183104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55cc9-f63a-4405-96a9-556acaad2c76 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.183104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55cc9-f63a-4405-96a9-556acaad2c76 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.184535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 50/98] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:16.189964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.190350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.190546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.212401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:16.213625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:16.298076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 49/99] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:16.338684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55cc9-f63a-4405-96a9-556acaad2c76 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.441513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.456517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55cc9-f63a-4405-96a9-556acaad2c76 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.502748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.503551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.503837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.504116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.516894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:16.524730 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:16.525562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:16.526406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 51/100] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:16.531787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.602471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.632969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80e32d-d47e-4133-aee3-3fb8c0fce816 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.666407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.667096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.667378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.667655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.668414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:16.668737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.670142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.682743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 50/101] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:16.688355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.818722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a05201-27ce-4b83-8729-a5ea25fa9e0d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.863997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.864947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.865306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.865557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] PATH_INFO: `/v3/users/d5a8bc365b2247c79ce612338b5a419a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.891751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a8bc365b2247c79ce612338b5a419a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.893262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb531773-cab4-4c90-81da-7fe51c337dd4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.895241 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 52/102] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/users/d5a8bc365b2247c79ce612338b5a419a => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:16.900700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.914379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a275-d222-4043-8f69-51508f697278 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.914704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a275-d222-4043-8f69-51508f697278 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.914935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277a275-d222-4043-8f69-51508f697278 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.916554 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 53/103] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:16.921999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.922292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.922571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.940380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.952558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:16.954440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:17.064778 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 54/104] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:17.072780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9940b-525f-4c03-a531-e687948c109d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.106343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.114759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.115504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.115793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.116066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.122799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.247817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.249349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.270647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a336-e610-4beb-b9a2-1d35717467da None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.309552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.310367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.310649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.310925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.312182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.313669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710a537-0578-4383-9bd0-e569cfda12f5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.315299 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 55/105] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:17.321410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59622f89-935f-41b3-980d-059755cdc872 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.321739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59622f89-935f-41b3-980d-059755cdc872 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.322027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59622f89-935f-41b3-980d-059755cdc872 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.328997 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 56/106] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:17.339157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.339444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.339721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.352789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.375371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:17.376601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:17.460467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 51/107] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:17.460467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.505890 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:17.506484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.534097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.666915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b26ec-5971-4002-95cc-139eb59a3b7f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.704586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.706104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.706901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.707422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.708941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.710917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.711388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f324c4-afc3-4167-bb24-8a4a34de7046 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.746452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 52/109] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:35:17 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:17.747669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.748921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.749950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.750314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.750602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.751967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.753673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2d9f7-69f8-41a3-b202-0684fadcfbec None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.755983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 58/110] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:17 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:17.757321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4994c3-a2f2-43ec-b8e0-4c26f1777612 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.757662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4994c3-a2f2-43ec-b8e0-4c26f1777612 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.757943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4994c3-a2f2-43ec-b8e0-4c26f1777612 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.759306 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 59/111] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:17.764149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4994c3-a2f2-43ec-b8e0-4c26f1777612 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.767554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.892857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.901127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1550a3-cbf4-4b96-b1a7-71eb996f32c7 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.941562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.942719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.943510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.944004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.957777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cfda4ae0-4305-44ef-95bc-06f3e649796a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:17.967768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:17.968692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:17.969446 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:17.971880 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 53/112] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:17.973666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.975534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.976070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.995651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:17.997292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:18.049873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4994c3-a2f2-43ec-b8e0-4c26f1777612 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.079882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 54/113] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:18.081107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.117593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.118970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.118970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.119158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.120039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=d5a8bc365b2247c79ce612338b5a419a) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:18.120381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.122841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5fcb-fb85-4dc3-9587-7486a5030309 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.130967 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 60/114] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:17 2022] GET /identity/v3/role_assignments?user.id=d5a8bc365b2247c79ce612338b5a419a&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.132183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f606f5-53f5-4992-afbb-ec7624639eba None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.134626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f606f5-53f5-4992-afbb-ec7624639eba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.134937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f606f5-53f5-4992-afbb-ec7624639eba None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.136484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 61/115] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:18.137122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f606f5-53f5-4992-afbb-ec7624639eba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.174536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.209183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9835c-1a96-4fe5-b5c9-67cd53fca42f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.239630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.262231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07689359-19a0-4452-a090-9dc285224832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.262962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689359-19a0-4452-a090-9dc285224832 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.263350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689359-19a0-4452-a090-9dc285224832 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.263616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689359-19a0-4452-a090-9dc285224832 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.264455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07689359-19a0-4452-a090-9dc285224832 None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:18.264884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07689359-19a0-4452-a090-9dc285224832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.272455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07689359-19a0-4452-a090-9dc285224832 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.294900 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 55/116] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.296527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.296874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.297165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.301619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f606f5-53f5-4992-afbb-ec7624639eba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.337056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:18.338333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:18.386792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.387620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.388035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.388311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.419363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:18.422974 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 56/117] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:18.423913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:18.439170 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:18.440057 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:18.440811 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 62/118] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:18.451643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.540854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.581806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466c4f-885d-44f3-90f6-4d8ee5c26b14 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.609160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91131-056d-4a7d-a884-f8fc3f3a292c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.626828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.628188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.628601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.628979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.630966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.633202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.636043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.636976 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 57/119] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.638512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.646744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.647546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.647925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.648296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.649175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:18.649596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.651094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d68cc-35a9-48f3-87b0-be6c5e9de0ab None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.660294 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 63/120] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.661824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216ea9-addb-4960-a155-56e5667b418a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.662270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216ea9-addb-4960-a155-56e5667b418a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.662643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216ea9-addb-4960-a155-56e5667b418a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.668165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 64/121] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:18.669115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10216ea9-addb-4960-a155-56e5667b418a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.758132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3f00e-95b6-4a92-b95d-6b9665afdf49 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.797118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10216ea9-addb-4960-a155-56e5667b418a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.801129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.805900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.806409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.806880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.813225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.821550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:18.833743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.834653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.834901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.835207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.836367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-834b3232-97a6-4496-89c2-c2f5fbda1eee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:18.836752 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:18.837636 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:18.838396 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:18.838960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.844295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 65/122] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.844295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.845764 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 58/123] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:18.847307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.847930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.848451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.878931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:18.881555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:18.908256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.958988 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 59/124] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:18.959654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.967980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a6f20-ecc7-495d-b0cf-51651a47a9db None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.007469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.008936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.009541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.010005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.011889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.014296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.016565 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 66/125] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.018376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.086314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa987bb-2e21-49ab-a601-73e508b411ef None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.112446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.123576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.124656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.125007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.125709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/87b176ccc8ce4412994fec22c00ea699/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.127480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, user_id=87b176ccc8ce4412994fec22c00ea699, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.129102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.152454 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 60/126] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:18 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/87b176ccc8ce4412994fec22c00ea699/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:19.152454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.156254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dee26-5242-4b81-bfab-0c8c0e2a0c23 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.194760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.218612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.219634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.220129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.220623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.221570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:19.222067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.223652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.237133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 67/127] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.245810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.284447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9816f-b6e3-499c-bdb8-3adfc5c9d0ec None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.326988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.327820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.328104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.328383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.356191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:19.370653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:19.371589 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:19.372345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:19.379474 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 61/128] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:19.380365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.459961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5974c-6137-486c-a5aa-10272cbfe232 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.484722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.508742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.509983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.510485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.510972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.513214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.514881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.516843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 68/129] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.517859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.547874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56b7fe-a8bd-482a-829d-761599093eb1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.588929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.594304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.595112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.596652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.596936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.598895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.603413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.608591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 62/130] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.609248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.674028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07e66-3464-47d9-9955-e0793810477f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.753641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bcd8b-c985-48d3-82ab-c55a515729b6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.769009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.769156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.769814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.770136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.770424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.771221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:19.771617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.773176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.791781 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 69/131] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.791957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.792562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.796805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.797106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.797398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/87b176ccc8ce4412994fec22c00ea699/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.799821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, user_id=87b176ccc8ce4412994fec22c00ea699, role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.801449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.831909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 63/132] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:19 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/87b176ccc8ce4412994fec22c00ea699/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:19.834200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.939510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b644f-8b7e-4c14-be26-5f64c0e4b021 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.968825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.988536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.989937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.990549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.991035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.992728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.994496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.996643 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 70/133] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.005768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.016934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ed2a-27ec-4145-9474-088e009a40a1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.062245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.063202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.063495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.063778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.065774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.067482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.070569 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 64/134] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.077158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.173533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.242314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f911-cc7e-4b2f-b817-5bb1602eb5d8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.307933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e4b7-f968-422b-ae27-15b475c00d65 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.318057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.319044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.319327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.319615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/152e93db3c4b47f4a0815a7df2a050f8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.326757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, user_id=152e93db3c4b47f4a0815a7df2a050f8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.326757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.354866 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:20 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/152e93db3c4b47f4a0815a7df2a050f8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:35:20.369414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.370352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.370639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.370919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] PATH_INFO: `/v3/projects/faf6006bec684451bfaea2f941d3f744` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.373916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] RBAC: Authorizing `identity:get_project(project_id=faf6006bec684451bfaea2f941d3f744)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.375449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad65584-1239-4d59-9b2c-b8722b2d5e64 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.377301 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 65/136] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/projects/faf6006bec684451bfaea2f941d3f744 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.383711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.447158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.532189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9f71-eb94-4376-8294-16055e993e0a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.590515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.591827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.592397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.592925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] PATH_INFO: `/v3/projects/faf6006bec684451bfaea2f941d3f744/users/87b176ccc8ce4412994fec22c00ea699/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.597851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=faf6006bec684451bfaea2f941d3f744, user_id=87b176ccc8ce4412994fec22c00ea699, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.600000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b0dbe-5b02-4330-9a87-f6590957e6a8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.621858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 72/137] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:20 2022] PUT /identity/v3/projects/faf6006bec684451bfaea2f941d3f744/users/87b176ccc8ce4412994fec22c00ea699/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:20.802062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321057-d23c-430e-9d00-8161ec34c26d None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.802402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321057-d23c-430e-9d00-8161ec34c26d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.802639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321057-d23c-430e-9d00-8161ec34c26d None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.804286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 66/138] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:20.823365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.823888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.824366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.832716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b287-e882-41d6-811b-4713ed243fc0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.833374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b287-e882-41d6-811b-4713ed243fc0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.833956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b287-e882-41d6-811b-4713ed243fc0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.835629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 67/139] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:20.841249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.841855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.842353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.873640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:20.876529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:20.878050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:20.881184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:20.993455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 68/140] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:21.014370 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 73/141] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:21.032911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.049718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.122280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.126677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.241446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652f2b-b9aa-4455-8d63-d8d3d56d7627 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.260176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2623c7-5fc0-4861-a722-0a128d28a21c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.290721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.292062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.292604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.293103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.294500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.296186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.298984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 69/142] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.304004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.362602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.363575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.363870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.364149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.401167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:21.409052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:21.409937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:21.411160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 74/143] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:21.416369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.489126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133d80-a71b-4cdd-a37a-ad092e108cb1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.520812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.532730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.533766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.534296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.535029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.536977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.538679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.571983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 70/144] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:21 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:21.659422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.668905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ec89-e226-4c1d-8665-b8536f2da4fc None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.714661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.715368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.715654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.715939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.716729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:21.717053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.718480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.733341 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 75/145] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.738967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.886484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16cb2-9361-4987-b78c-b0ea0f40bb5e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.932989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.934250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.934730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.935201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] PATH_INFO: `/v3/users/d5a8bc365b2247c79ce612338b5a419a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.938332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a8bc365b2247c79ce612338b5a419a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.940234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.942226 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 71/146] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/users/d5a8bc365b2247c79ce612338b5a419a => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.948205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.097586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605855cf-aaaa-42b7-87ce-1920fb258a40 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.146999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.147903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.148190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.148491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.149744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:22.151227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535af800-5f55-4c5f-84de-9e88da3432dc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:22.152981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 76/147] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:22.158995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.210224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:22.310394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa47d2-4383-4c54-bdff-024164680565 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.353740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.355021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.355510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.355980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/d5a8bc365b2247c79ce612338b5a419a/roles/21294a297d5045d8bfdbcba96605ea9a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.359730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, user_id=d5a8bc365b2247c79ce612338b5a419a, role_id=21294a297d5045d8bfdbcba96605ea9a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:22.361556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:22.383201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63816b-fb89-46e1-8abc-cd4441f88e2b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.383491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63816b-fb89-46e1-8abc-cd4441f88e2b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.383777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63816b-fb89-46e1-8abc-cd4441f88e2b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.385411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 77/148] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:22.389753 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 72/149] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:22 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/users/d5a8bc365b2247c79ce612338b5a419a/roles/21294a297d5045d8bfdbcba96605ea9a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:22.390838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.391145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.391407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.429690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:22.430990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:22.458587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:22.523036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 78/150] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:22.571638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.682059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:22.692616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd7b8-dc4f-4a85-b282-ea3eafcf1dc8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.731642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.732471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.732762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.733040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.743551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:22.751407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:22.752252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:22.753565 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 73/151] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:22.758598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.878415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8168d-cd45-47da-9dc7-572f1b685966 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.919724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.920688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.921102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.921525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.922410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:22.922845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:22.924395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:22.936197 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 79/152] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:22.941887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.064309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25200-6b6f-4ea0-9467-33277135a56b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.118192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.119018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.119303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.119583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.120848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.122340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.124296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 74/153] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:22 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:23.129689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.170431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.281071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685209-c6c8-4e37-a70e-f8eda6ea023c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.336479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.337171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.337455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.337737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.428035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.429470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.449969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.543894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 80/154] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:23.553274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.590609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.700364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb38b-71fc-4c47-898b-d99e83e8042e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.742350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.743228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.743511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.743786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.749193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.750695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc8ab7-f9da-49c2-9c3a-1d6928c508df None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.752804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 75/155] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:23.758610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.893949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce6d6-5c36-4d93-8ada-0e4b42809aa0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.895733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc786-cd73-48d9-a803-7736d6176e12 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.904442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc786-cd73-48d9-a803-7736d6176e12 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.905045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc786-cd73-48d9-a803-7736d6176e12 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.906979 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 76/156] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:23.912399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.912807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.912929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.913200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.930194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.930867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.931280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.931575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.932417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:23.932766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.934250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7603d1-5aa1-4bad-abf0-eaa6bf49d784 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.941388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 81/157] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=7faa3dc09867417b8ea82703161cde19 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:23.957668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:23.958950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:24.025556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee62d8d-1413-40ed-a00e-d8d9fd1a3ecc None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.025901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee62d8d-1413-40ed-a00e-d8d9fd1a3ecc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.026150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee62d8d-1413-40ed-a00e-d8d9fd1a3ecc None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.027686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 82/158] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:24.033347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.033617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.033903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.060123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:24.061470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:24.069344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 77/159] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:24.127266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.164458 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 83/160] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:24.168305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:24.209102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.358024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddd46a-e9aa-41c0-ae7f-0bba56ea2bb4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:24.382789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:24.408443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7283b-f878-4f24-b7e5-c92f72d30589 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:24.461817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:24.462570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.462854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.463130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.488067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:24.488961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.489258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.489519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.497625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:24.514731 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:24.515628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:24.516376 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:24.518420 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 84/161] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:24.518954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:24.527215 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:24.528049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:24.528874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:24.532828 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 78/162] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:24.534568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.541879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.716547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:24.739837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43ead-3183-4d09-877a-0fc936b1747f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:24.762679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae6eb-53a8-4e01-a1dd-371e5b2859be None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:24.809854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:24.810548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.810835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.811115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.811981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:24.812296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:24.813740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:24.832115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 85/163] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:24.837857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.856660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:24.857344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.857689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.857965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.858723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:24.859027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:24.860484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:24.876040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 79/164] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:24.882789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:24.899251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:25.058706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6c32-2640-4578-851d-a3d9698befc6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:25.111644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:25.112574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.112858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.113133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.114373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:25.116090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1e14e-b460-4fd7-9d8b-a500cf339f3f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:25.118148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 86/165] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:25.119337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf2fb-f753-42af-aa75-2ba302ba61bc None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.119620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf2fb-f753-42af-aa75-2ba302ba61bc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.119897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf2fb-f753-42af-aa75-2ba302ba61bc None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.125950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 87/166] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:25.126720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf2fb-f753-42af-aa75-2ba302ba61bc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:25.134798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0623d6-72fc-4fa3-93f1-6350e192e901 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:25.213575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:25.214480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.214759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.215091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] PATH_INFO: `/v3/users/87b176ccc8ce4412994fec22c00ea699` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.216321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] RBAC: Authorizing `identity:get_user(user_id=87b176ccc8ce4412994fec22c00ea699)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:25.218000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b9b8a-9a1e-42a5-bf01-4bbc63004c0b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:25.219629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 80/167] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:24 2022] GET /identity/v3/users/87b176ccc8ce4412994fec22c00ea699 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:25.229062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.229351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.229633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.255087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:25.256313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:25.258668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:25.318272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:25.326027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf2fb-f753-42af-aa75-2ba302ba61bc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:25.386126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 81/168] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:25.387322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:25.420461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:25.420461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.420461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.420461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.560562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac430f-1177-4fd9-b652-9871e5015cb4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:25.616475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:25.617486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:25.617961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:25.618441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:25.629976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:25.664913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:25.666406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:25.785493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:25.787096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:25.822296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:25.826684 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 88/169] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:25.827969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.055874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 82/170] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:26.056268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78864-c555-4524-8ec3-dfa7c10a630e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.057325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.130898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.146696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.147527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.147813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.148087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.173196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:26.181239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:26.182162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:26.182924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 89/171] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:26.183623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.258498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10988de-7f7d-440c-b940-587eedb33cdc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.310184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.310983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.311423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.311844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] PATH_INFO: `/v3/projects/faf6006bec684451bfaea2f941d3f744` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.316445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.317284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] RBAC: Authorizing `identity:get_project(project_id=faf6006bec684451bfaea2f941d3f744)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.319360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2838a-1e16-4779-b646-8ca58aa05e75 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.321340 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 83/172] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/projects/faf6006bec684451bfaea2f941d3f744 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.322821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91287-c7d0-47ff-8b0c-12610d111055 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.323265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91287-c7d0-47ff-8b0c-12610d111055 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.323695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91287-c7d0-47ff-8b0c-12610d111055 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.325103 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 84/173] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:26.325933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91287-c7d0-47ff-8b0c-12610d111055 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.349006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4325b9-c929-48a1-a991-e10b611d09c6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.385707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.387001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.387461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.387909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.389415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.391050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbbac7-a40c-4e2f-9b48-072b3ae2993a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.393108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 90/174] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.394462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.394923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.395375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.413074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:26.414628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:26.494366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91287-c7d0-47ff-8b0c-12610d111055 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.501613 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 91/175] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:26.502679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.503908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.549837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.550620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.550966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.551305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.552144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:26.552826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.554292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.563816 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 85/176] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.568799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.577095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.626719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2fb6d-5ed1-45a1-b94c-ff7d9a7bc73a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.665685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.666465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.666832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.667171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.668087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=faf6006bec684451bfaea2f941d3f744, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:26.668571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.670281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99943-d6da-41f0-b30d-d7c9b53eded5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.677490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 92/177] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=faf6006bec684451bfaea2f941d3f744&role.id=7faa3dc09867417b8ea82703161cde19 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.678850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34507-2bd6-4c50-83f5-c93d8016d528 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.679090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34507-2bd6-4c50-83f5-c93d8016d528 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.679570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34507-2bd6-4c50-83f5-c93d8016d528 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.680981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 93/178] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:26.685940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d34507-2bd6-4c50-83f5-c93d8016d528 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.692440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be48dc-2d68-4b08-9ad1-e8f8caa2a5b0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.730626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.731623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.732102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.732589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.733600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=87b176ccc8ce4412994fec22c00ea699) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:26.734109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.735752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.742886 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 86/179] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/role_assignments?user.id=87b176ccc8ce4412994fec22c00ea699&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.744036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.779851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.844460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d34507-2bd6-4c50-83f5-c93d8016d528 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.881390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:26.896453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a2727-291f-4e5c-ba3e-0e1b94c2edde None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:26.913428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.914264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.914546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.914824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.939461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-ed11892c-ea42-4497-8cba-eb8d690cb158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:26.949574 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:26.950586 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:26.951457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 94/180] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:26.952797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.953203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.953317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.981321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:26.983247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:26.987693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:26.989011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.989505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.990044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] PATH_INFO: `/v3/users/152e93db3c4b47f4a0815a7df2a050f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.991626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] RBAC: Authorizing `identity:get_user(user_id=152e93db3c4b47f4a0815a7df2a050f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:26.993541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e570bd-5af8-4a70-9b5f-0f2be07fca8b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:26.995574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 87/181] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/users/152e93db3c4b47f4a0815a7df2a050f8 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:26.997316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0995c-ffcc-4cfd-b97e-f46f01260abc None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.997848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0995c-ffcc-4cfd-b97e-f46f01260abc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.998346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0995c-ffcc-4cfd-b97e-f46f01260abc None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.999922 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 88/182] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.001147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0995c-ffcc-4cfd-b97e-f46f01260abc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.073755 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 95/183] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:27.074714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.112889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.117804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0995c-ffcc-4cfd-b97e-f46f01260abc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.168285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.169115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.169403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.169682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.170442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:27.170753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.172203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ec4f8-c4f0-42f7-950f-fd7ffa3d4c9e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.182309 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 89/184] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.187992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.188287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.188598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.207555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:27.208975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:27.231332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de467c7c-d078-4e0a-b4c9-a9f3c8ed4a10 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.244861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.266488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.267151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.267432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.267709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.276509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 90/185] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:27.278459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.343934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.345383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd2a10-14b9-4502-b0e4-61d27497f50f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.375123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.384570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866346e9-8e02-4f28-bd6a-f3c0b06a4b99 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.416859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.417661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.417943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.418221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.428778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.436467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.437408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:27.438159 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 91/186] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:27.438772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.450122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 96/187] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:27.451519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56f65-1c5a-4f4f-bc25-1beff51231a3 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.451817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56f65-1c5a-4f4f-bc25-1beff51231a3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.452089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56f65-1c5a-4f4f-bc25-1beff51231a3 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.456530 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 97/188] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.456530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56f65-1c5a-4f4f-bc25-1beff51231a3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.469526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.547687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683a77-8bd6-41c3-bdeb-893243bdc59a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.564332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56f65-1c5a-4f4f-bc25-1beff51231a3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.580411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.581328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.581613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.581890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.596952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.598376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.599629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.600448 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 92/189] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.600571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.600720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.600997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.605375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.611214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.617386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.619344 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.620216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.621060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:27.624569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 98/190] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:27.625862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.693801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.703099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5253aa-8805-45c9-9ac8-143169a6650d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.723003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49d8f-557c-453a-b2d9-36d228eb45a0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.736308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.737044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.737319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.737594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.738336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:27.738635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.740065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb306-99bb-4f56-a915-2d8a92910851 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.752386 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 93/191] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.752386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.752386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.752386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.760846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.761700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.762006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.762281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.763518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.765001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.766690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 99/192] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.766883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:27.767441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.768112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:27.835197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 94/193] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:27.836044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.838437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.873472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8ee5-fa38-4891-94a0-6b33ec17f83f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.907204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.907860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.908126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.908404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.919050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.935977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bd9a5-85c4-4d44-a285-53b0123c0276 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.969776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.970446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.970729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.971000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.971743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:27.972049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.973507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.975957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.977465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.982325 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 95/194] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.983109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.047572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.072636 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 100/195] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:28.073840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.092629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f82d-cf3e-47bc-9174-5aa519643e87 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.116406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.127825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.128682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.128967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.129242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] PATH_INFO: `/v3/users/d5a8bc365b2247c79ce612338b5a419a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.130514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a8bc365b2247c79ce612338b5a419a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.131988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.133711 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 96/196] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/users/d5a8bc365b2247c79ce612338b5a419a => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.134468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.174507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ae70-f1d3-4bbe-9134-0ffe4b2c5b28 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.208985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.209641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.209922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.210197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.211031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=152e93db3c4b47f4a0815a7df2a050f8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:28.211339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.212829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.218595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 101/197] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/role_assignments?user.id=152e93db3c4b47f4a0815a7df2a050f8&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.219520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.237168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fbb5d-fc38-4e0c-b61b-c0018d982814 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.269969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.275485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.276490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.276784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.277066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.278339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.279876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.281636 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 97/198] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.282518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.346204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ecd0e-34e3-48e3-9bae-1e914c5ed372 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.350361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.389107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.389916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.390201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.390479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.391839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.393382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.399851 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 102/199] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.400026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607c5a1-d5ec-420f-9fae-2f048ac63e00 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.400117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.437681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.438571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.438840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.439110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.440300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.441804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.447580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 98/200] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.447580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.517031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.522429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959ca1-e144-4ddc-894c-ef8ca5537979 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.552902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd318e0-67d9-401a-805f-bb4ccfecb7fa None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.555081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.555766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.556040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.556320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.586958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.587629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.587912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.588177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.588921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.590393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.599970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.616412 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 99/201] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:28 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:28.617458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.636074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.637685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.727332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647da3-92a6-45cc-bc13-8d0f380e741b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.750089 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 103/202] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:28.750753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.751873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.769609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.770309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.770594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.770824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.836764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.857464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.859010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.876299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4f21d-08a6-4be3-a26c-64030f533348 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.929827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.931247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.931682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.932083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.932960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=6a77f258196649ba8e7f46d257d35ccb) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:28.933428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.935514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.942153 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 104/203] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/role_assignments?user.id=6a77f258196649ba8e7f46d257d35ccb&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.943024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.989911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 100/204] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:28.997092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.026045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.098909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4fad-c8c3-4ce1-9191-018c2034c482 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.123787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0c17-2979-4a3e-8716-6aa8fd1c4b10 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.146866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.148558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.149193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.150002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.151752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.154339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.157014 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 105/205] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.160922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.161878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.162521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.162806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.163708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.164116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.165665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.167534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 101/206] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.170473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.173830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.289267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7b2f-7315-4f3a-b088-13e8a3a5c12c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.289934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.302847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3f33-1c61-4592-a02d-905d897edc23 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.334671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.335740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.336233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.336723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.337729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded, user.id=d5a8bc365b2247c79ce612338b5a419a) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:29.338236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.339903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cbbbe-b1a5-494c-a356-4a1422730be2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.347308 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 106/207] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/role_assignments?user.id=d5a8bc365b2247c79ce612338b5a419a&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:29.355920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.356638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.356976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.357252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.358167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=6a77f258196649ba8e7f46d257d35ccb) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:29.358479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.360051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e11c8-3790-4240-a903-1df7a0c4e01b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.367343 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 102/208] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/role_assignments?user.id=6a77f258196649ba8e7f46d257d35ccb&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:31.312475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ffd5-9461-4106-8967-9ce87deb1500 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.312997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ffd5-9461-4106-8967-9ce87deb1500 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.313105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ffd5-9461-4106-8967-9ce87deb1500 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.314857 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 107/209] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:31.320220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.320675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.320836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.338321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:31.339529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:31.356982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3690-1ed9-4b49-964d-4306d7f70670 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.357283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3690-1ed9-4b49-964d-4306d7f70670 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.357540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a3690-1ed9-4b49-964d-4306d7f70670 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.358994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 108/210] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:31.364358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42491ea-4d21-4f51-ac98-389fd67a0f3f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.364733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42491ea-4d21-4f51-ac98-389fd67a0f3f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.365021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42491ea-4d21-4f51-ac98-389fd67a0f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.382652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f42491ea-4d21-4f51-ac98-389fd67a0f3f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:31.383845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f42491ea-4d21-4f51-ac98-389fd67a0f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:31.423986 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 103/211] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:31.451018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.458821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:31.472483 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 109/212] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:31.472483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02fa3-3cc0-42aa-b6b1-27770016047d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.472483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02fa3-3cc0-42aa-b6b1-27770016047d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.472483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02fa3-3cc0-42aa-b6b1-27770016047d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.472845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 110/213] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:31.478253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.478547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.478829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.496232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:31.497458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:31.547928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:31.564333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1ca6-55e0-4bab-ba4a-e042210db1d7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.578470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 111/214] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:31.580666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.613087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.613910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.614187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.614480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.615653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:31.617188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:31.618821 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 104/215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:31.623986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.694873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d7123-efe0-4430-9cff-decf23f77143 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.726768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:31.730836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7104a36-96ac-449f-af65-9f9f9eb7e144 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.737602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.738576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.739033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.739501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.752045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:31.761890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:31.763554 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 112/216] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:31.765652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.775046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.775858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.776127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.776403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.788646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:31.796338 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:31.797408 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:31.798218 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 105/217] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:31.798866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.820131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:31.881884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74920662-5077-45d0-aaa2-29b531be6eb2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.903884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345303-e717-4c34-9fe9-c30a3ca9dc92 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.914922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.915601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.915886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.916167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.916892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:31.918357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:31.936695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.937365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.937645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.937920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.938615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 113/218] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:31 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:31.938711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:31.938951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:31.939424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.940342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c3a6-b701-4881-ab51-ee0ee9d47308 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:31.961914 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 106/219] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:31.963491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8e46-f7b3-4fa2-986b-5a9de2bca844 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.963784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8e46-f7b3-4fa2-986b-5a9de2bca844 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.964066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8e46-f7b3-4fa2-986b-5a9de2bca844 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.968481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 107/220] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:31.968481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f8e46-f7b3-4fa2-986b-5a9de2bca844 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.003384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.063953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.067765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205188-a5ea-4cce-9dba-fed58e7d8ffa None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.091981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f8e46-f7b3-4fa2-986b-5a9de2bca844 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.106349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.107042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.107323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.107588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.108343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:32.108681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.110098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e369f5-edcf-4e80-a663-10f47b19f6ff None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.119664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 114/221] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.120825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.121112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.121388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.138483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131964ad-461a-4508-852f-27d90152feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.139319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:32.139449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131964ad-461a-4508-852f-27d90152feca None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.144735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131964ad-461a-4508-852f-27d90152feca None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.144735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131964ad-461a-4508-852f-27d90152feca None admin] PATH_INFO: `/v3/users/f6791f5999ad461d96c95d5746d8fa51` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.144944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:32.156061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131964ad-461a-4508-852f-27d90152feca None admin] RBAC: Authorizing `identity:get_user(user_id=f6791f5999ad461d96c95d5746d8fa51)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.157594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131964ad-461a-4508-852f-27d90152feca None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.160215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 108/222] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:31 2022] GET /identity/v3/users/f6791f5999ad461d96c95d5746d8fa51 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.160845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131964ad-461a-4508-852f-27d90152feca None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.231083 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 115/223] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:32.232145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.277537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.299344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131964ad-461a-4508-852f-27d90152feca None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.340199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.341460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.341756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.342120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.343860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.346279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.347946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f050b-52c9-40c4-97d0-df2e0983b2bb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.348361 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 109/224] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.349568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.353495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.385798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.386565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.386939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.387201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.460591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.462079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.481638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393dbea-722f-477c-8453-9897bb60a19c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.498229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.529979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.530809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.531092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.531366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.546096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:32.556540 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:32.557434 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:32.558200 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:32.560507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 110/225] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:32.561611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.582446 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 116/226] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:32.588224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.635902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.680326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0ca5-c722-4129-8fa4-21e179ec9dad None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.713307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1823e5-5c7f-49a6-b01c-43a56436d27c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.721339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.722912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.723395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.724622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.727397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.729621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.731995 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 111/227] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.733277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.757420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.758414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.758705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.758985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.760397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:32.760744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.762675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.765757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.775637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.776997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.861695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b6d-4798-4f51-9918-a81372f3b7b4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.896231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d6fe-c856-4d48-b033-26d8978ec443 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.907046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.916583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.918085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.918657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.919111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.921017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.923261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.926242 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.928828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.939912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.940648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.940998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.941337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/6a77f258196649ba8e7f46d257d35ccb/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.943473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, user_id=6a77f258196649ba8e7f46d257d35ccb, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.945042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.964505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 118/230] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:32 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/6a77f258196649ba8e7f46d257d35ccb/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:32.965744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.093468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.121607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e114-89a7-49b2-afd6-ad591bf856e9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.161152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.162060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.162325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.162634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.164171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.167353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.167353 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.176040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.199996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a2746-cd3d-41ff-b205-1727e7794063 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.252535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.253524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.254239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.256383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.256914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.258241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=f6791f5999ad461d96c95d5746d8fa51) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:33.258711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.262060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.270037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 119/232] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/role_assignments?user.id=f6791f5999ad461d96c95d5746d8fa51&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=7faa3dc09867417b8ea82703161cde19 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.300637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e257-b096-4bda-8203-71cd935797a1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.340355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.342113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.342590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.343075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.344743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.346478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a1c5-c709-4e54-9ca6-e42ac81e5916 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.348898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 114/233] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:33 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.357837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.515187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe87ef8-4d95-4088-a54c-e486b5dd11c3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.539474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.556120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.557083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.557419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.557704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/6a77f258196649ba8e7f46d257d35ccb/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.559961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, user_id=6a77f258196649ba8e7f46d257d35ccb, role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.561449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d72d-16da-4b3b-9e83-8eabaeb7269e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.590934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:33 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/6a77f258196649ba8e7f46d257d35ccb/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:34.638732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a274-6ffc-43b7-8c27-d888215aba8b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.639262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a274-6ffc-43b7-8c27-d888215aba8b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.639262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a274-6ffc-43b7-8c27-d888215aba8b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.640948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 115/235] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:34.649292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.649723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.649899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.669487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:34.670717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:34.757052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf26d1-0932-49cb-ae64-82aa15fe3166 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.757376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf26d1-0932-49cb-ae64-82aa15fe3166 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.757613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf26d1-0932-49cb-ae64-82aa15fe3166 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.759412 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 116/236] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:34.763662 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 121/237] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:34.764472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.764838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.765109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.781903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:34.783238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:34.807746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.907088 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 117/238] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:34.962703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.973271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df3547-3320-4863-9ba6-bf377d0041ed None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.001298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.040831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.041643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.041924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.042200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.049142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.049629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.051950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.054165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 122/239] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.059835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.090512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f89a9-13a2-4fc0-933a-8ea78afa2844 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.129659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.130491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.130773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.131052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.141686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:35.149567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:35.150441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:35.151364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 118/240] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:35.161575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.270870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b783-4456-4a8a-b4fa-4d1222517d1d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.288808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb9e9-59aa-49c3-9ec6-7f6a91691c77 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.315495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.329303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.329977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.330255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.330532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.331278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:35.331582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.333034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.342759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 119/241] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.348255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.363034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.363717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.363996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.364266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.365049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.366505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.405690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 123/242] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:35 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:35:35.489767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af464c-919f-41a3-96ce-029a159bb35a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.528308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.529234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.529512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.529788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] PATH_INFO: `/v3/users/5e6908447460458bb54ea509794c3cd2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.545459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] RBAC: Authorizing `identity:get_user(user_id=5e6908447460458bb54ea509794c3cd2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.547039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8ef20-5257-4ba4-9f64-dce990da917c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.548846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 120/243] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/users/5e6908447460458bb54ea509794c3cd2 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.557618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.608202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.688857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8e2c2-556a-45e0-8659-0546053ffc78 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.733229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.733925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.734213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.734492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.813466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.814907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.854964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.892121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27222-29e9-4e27-b314-2e9bb67326ba None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.893070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27222-29e9-4e27-b314-2e9bb67326ba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.893618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27222-29e9-4e27-b314-2e9bb67326ba None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.895489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 121/244] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:35.901788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.902333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.902795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.930326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:35.931945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:35.939411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 124/245] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:35.946123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.989191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.024792 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 122/246] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:36.058846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.087771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ef848-3e85-45f3-bdea-beb51918614a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.139148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.140175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.140486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.141086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.142475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.144682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.146741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 125/247] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:36.152673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.158104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.194591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7c2f3-f47e-4e86-8a45-cfc4fa5b3547 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.247142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.247959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.248272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.248670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.261219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-b22fc6da-1e76-48c4-861a-7a995a9e5165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:36.269387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:36.270258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:36.271098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 123/248] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:36.272208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429218a4-a22c-42bb-b906-4f5537b21934 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.272372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429218a4-a22c-42bb-b906-4f5537b21934 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.276139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429218a4-a22c-42bb-b906-4f5537b21934 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.276139 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 124/249] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:36.279277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.279570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.279850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.289033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983a8c9-8cc1-4486-9fa3-0dbf6262e947 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.298574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:36.299764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:36.337029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.340705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.340994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.341278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.341556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.342439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=5e6908447460458bb54ea509794c3cd2) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:36.342966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.344456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.362507 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 126/250] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/role_assignments?user.id=5e6908447460458bb54ea509794c3cd2&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:36.363391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.419487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 125/251] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:36.471320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.479665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.551746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afefd5f-5625-4974-b2f3-ea8a86065c15 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.630680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.631290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.631576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.631858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.632665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:36.632980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.634387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.648080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc94fcf-6ae8-43d1-8a29-7d03f3a37fee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.651829 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 127/252] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:36.659601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.712832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.714124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.715279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.715911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.738851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:36.747046 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:36.747919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:36.748710 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:36.753734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 126/253] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:36.759348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.822009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.875117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fac7b-0c9f-4010-8fd8-7390e5497149 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.928592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.937588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.938483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.938767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.939045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.941094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.942773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6c1f5-4556-4759-b948-93dfc85eeb55 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.944479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 128/254] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:36.947380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc67-588d-4ee8-8b3f-9683b2e9e65f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.947673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc67-588d-4ee8-8b3f-9683b2e9e65f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.947955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc67-588d-4ee8-8b3f-9683b2e9e65f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.949367 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 129/255] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:36.951585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cfc67-588d-4ee8-8b3f-9683b2e9e65f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.981887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448ee4-72c8-490e-88e3-df2d9b111d57 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.032805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.033850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.034700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.035221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.036568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:37.037074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.038956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5a98-56a1-4fa4-8dde-d58d15602d20 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.052274 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 127/256] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:37.053915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.057594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.058090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.090867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:37.098930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:37.149717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cfc67-588d-4ee8-8b3f-9683b2e9e65f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.206489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.207480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.208533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.210005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.236620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 128/257] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:37.237845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.276614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.342522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.348407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.353542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.443232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6cbb1-d444-4a1a-8cb3-eafa9ee2db36 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.481505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 130/258] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:37.482361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.523724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.524635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.524916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.525190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] PATH_INFO: `/v3/users/f6791f5999ad461d96c95d5746d8fa51` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.529131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] RBAC: Authorizing `identity:get_user(user_id=f6791f5999ad461d96c95d5746d8fa51)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.530601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.532592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 129/259] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/users/f6791f5999ad461d96c95d5746d8fa51 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:37.533358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.595200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.608327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c4e7-b3d6-4871-b45c-1fd6fed1e6cb None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.639783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bdab1-e30d-47e0-bbf8-6d6522ffad47 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.642776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.677378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.678939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.679285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.679628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.681102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.682681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.685199 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 130/260] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:37.686322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.705415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.706531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.707104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.707605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.741611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:37.757036 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:37.758010 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:37.758778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:37.761481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 131/261] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:37.763673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.806434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd5f42-2d45-49cf-921b-4d070c7eaf33 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.845754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.846629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.847000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.847303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.848663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.851098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.853965 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 131/262] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:37.853965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.882792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.972242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62758c56-7fc4-49fb-8cf0-9e5972014066 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.993775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398bdf-cf65-43a3-9643-3e08751f50f0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.010909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.011585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.011868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.012138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.012914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:38.013216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.014664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.024349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 132/263] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.025705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.097435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.098126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.098418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.098769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.099931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=6a77f258196649ba8e7f46d257d35ccb) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:38.100249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.101823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.116788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.118424 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 132/264] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/role_assignments?user.id=6a77f258196649ba8e7f46d257d35ccb&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.119288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.155137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36072-d1bc-405c-994f-29a20fc8e181 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.184545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.212885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.213805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.214087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.214361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/f6791f5999ad461d96c95d5746d8fa51/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.216547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, user_id=f6791f5999ad461d96c95d5746d8fa51, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.218093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.234785 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 133/265] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:38 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/f6791f5999ad461d96c95d5746d8fa51/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:38.368981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ab78-2320-496f-86bb-3a5bfa173a96 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.426801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.427981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.428470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.428984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] PATH_INFO: `/v3/users/6a77f258196649ba8e7f46d257d35ccb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.430613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a77f258196649ba8e7f46d257d35ccb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.432316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519547a-11d0-43e2-9c5a-a748dbd21fa7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.434845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 133/266] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/users/6a77f258196649ba8e7f46d257d35ccb => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.440476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.586626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c315b1-f4ca-4d34-a64b-b945f36f81d8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.621903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.622487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.622767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.623044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.636276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.694518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.696014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.726316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b7f51-4d9f-444f-8288-d4d226d8df36 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.726650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b7f51-4d9f-444f-8288-d4d226d8df36 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.726882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b7f51-4d9f-444f-8288-d4d226d8df36 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.728552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 134/267] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:38.735462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.735757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.736038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.756562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:38.757932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:38.801718 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 134/268] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:38.810447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.857552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 135/269] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:38.876649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.887369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.913910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.002243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c25dc-874c-4e95-9d10-b77a29873d5d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.002854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11907cc-975b-427c-8a4f-daa0c4cf65cb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.041082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.042563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.043073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.043544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.055844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:39.064563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:39.065531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:39.066323 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:39.069841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 136/270] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:39.076202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.114157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.116883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.117138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.117426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.118929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.120251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246631c6-9d93-492a-a611-acd3c39eb499 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.128532 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 135/271] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.128532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a692-274b-4dff-8ac0-cdbf722afa6a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.128532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a692-274b-4dff-8ac0-cdbf722afa6a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.128532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a692-274b-4dff-8ac0-cdbf722afa6a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.128532 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 136/272] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:39.132267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.132596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.132879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.150152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:39.151445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:39.179974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.202659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407ab62-13f2-465d-accc-a2b894962800 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.237274 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 137/273] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:39.238495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.249696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.250392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.250898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.251005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.251679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.252072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.253408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.276105 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 137/274] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.280462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.293803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.360393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4476-0f3d-441b-bf40-94cc61ec87a6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.395284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f87e8-29ed-4a20-aa5e-325af8604b64 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.400901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.401568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.401851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.402129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.402962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=6a77f258196649ba8e7f46d257d35ccb) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.403274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.404770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.410726 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 138/275] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/role_assignments?user.id=6a77f258196649ba8e7f46d257d35ccb&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.420837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.437946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.439071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.439360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.440067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.441246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.443571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11299-2fd6-48fb-8799-2c3e5e08ff7d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.445908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 138/276] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.447362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f937-d72d-4a3c-b731-ab79c85ab79e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.447623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f937-d72d-4a3c-b731-ab79c85ab79e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.447877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f937-d72d-4a3c-b731-ab79c85ab79e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.449323 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 139/277] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:39.452894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f937-d72d-4a3c-b731-ab79c85ab79e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.471398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.566007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59944-a499-4323-a338-0404a2af2be4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.569789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.598663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f937-d72d-4a3c-b731-ab79c85ab79e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.619473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.620040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.620330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.621761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] PATH_INFO: `/v3/users/74e3f9a0c45a4403a52cc709b494f691` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.642997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.643348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] RBAC: Authorizing `identity:get_user(user_id=74e3f9a0c45a4403a52cc709b494f691)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.643737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.644025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.644305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.644827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d521716-a1e8-433b-a544-167f2bf07ffd None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.645043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.646635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.646731 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 139/278] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/users/74e3f9a0c45a4403a52cc709b494f691 => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.651599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.651599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.651599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.670537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:39.671962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:39.681483 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 140/279] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:39 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:39.682508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.775289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 140/280] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:39.776956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.801226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.838350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea679fa-0951-4413-903e-4df0c8ad44b7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.876332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.877057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.877440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.877721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.878563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, user.id=74e3f9a0c45a4403a52cc709b494f691, scope.system=all) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.878931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.880474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.886552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 141/281] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/role_assignments?user.id=74e3f9a0c45a4403a52cc709b494f691&scope.system=all&role.id=7faa3dc09867417b8ea82703161cde19 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.911384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.921969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efeade-f1ca-4072-a0b5-a86556126f82 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.960937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.961792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.962073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.962346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.975222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:39.983136 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:39.984063 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:39.985711 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 141/282] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:39.992011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.106489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce476-4b66-4eba-ba28-03b27be87104 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.138331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.145255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.145970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.146258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.146533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.147276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] RBAC: Adding query filter params (name=reader) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:40.147576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.149021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.158167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 142/283] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:40.163705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.266540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3e9-f2fc-4c46-9545-6536c30fdbda None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.307110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.308001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.308277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.308579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] PATH_INFO: `/v3/users/5e6908447460458bb54ea509794c3cd2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.309784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6908447460458bb54ea509794c3cd2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.311250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.313307 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 142/284] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:40 2022] GET /identity/v3/users/5e6908447460458bb54ea509794c3cd2 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:40.319235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.430255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268581e-7c73-48eb-a804-9daf0515f75a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.475340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.476212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.476517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.476796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.479043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.480571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215beffc-a568-41db-ab4f-30957c59c5ac None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.482281 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 143/285] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:40 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:40.488112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.514448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.607634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5113a-db0a-4673-b333-469231656ee9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.644714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.646069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.646567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.647028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/5e6908447460458bb54ea509794c3cd2/roles/21294a297d5045d8bfdbcba96605ea9a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.649574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, user_id=5e6908447460458bb54ea509794c3cd2, role_id=21294a297d5045d8bfdbcba96605ea9a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.651221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd360c-3cd1-4c38-a8a0-93fd743fd22d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.670350 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 143/286] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:40 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/users/5e6908447460458bb54ea509794c3cd2/roles/21294a297d5045d8bfdbcba96605ea9a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:41.055873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ef7-4eee-4e5a-8ed6-9b3e1079acec None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:41.056155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ef7-4eee-4e5a-8ed6-9b3e1079acec None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:41.056628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ef7-4eee-4e5a-8ed6-9b3e1079acec None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:41.058475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 144/287] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:41.063861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:41.064391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:41.064910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:41.086042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:41.087165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:41.186783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 144/288] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:41.230525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42ef7-4eee-4e5a-8ed6-9b3e1079acec None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:41.318843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:41.377231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e42ef7-4eee-4e5a-8ed6-9b3e1079acec None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:41.422890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:41.423703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:41.423986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:41.424264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:41.437936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:41.446007 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:41.446880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:41.447646 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 145/289] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:41.453351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:41.472781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:41.583432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eebd71-935c-4595-b342-8655e22cfb72 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:41.634210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:41.634830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:41.635117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:41.635392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:41.636163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:41.636488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:41.637910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:41.652911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 145/290] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:41.660104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:41.838791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871aac-ce71-4506-ba4c-b9016dc48e1b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:41.871328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:41.897038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:41.897960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:41.898250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:41.898583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] PATH_INFO: `/v3/users/f6791f5999ad461d96c95d5746d8fa51` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:41.905195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6791f5999ad461d96c95d5746d8fa51)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:41.906744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:41.908615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 146/291] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:41 2022] GET /identity/v3/users/f6791f5999ad461d96c95d5746d8fa51 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:41.914529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:42.017017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:42.057857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6358dc6-bb3a-4fd8-b94a-269e46feb86e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:42.103119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:42.103783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.104067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.104344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.215804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:42.217324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2d6fb-4b9e-4eef-baba-eeaabb0b611a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:42.308904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:42.349601 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:42.355237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:42.427928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f085a9-3203-486b-a0ce-d67daf772838 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.428278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f085a9-3203-486b-a0ce-d67daf772838 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.428507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f085a9-3203-486b-a0ce-d67daf772838 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.430132 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 147/293] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:42.435466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.435763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.436039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.469534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:42.470723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:42.490774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f8d4-6a28-4925-94b6-0d7fbaa572e1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:42.525251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:42.526133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.526421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.526698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.527901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:42.529394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:42.531433 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 147/294] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:42 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:42.536993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:42.597856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:42.643588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 148/295] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:42.668317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cba3d-05be-4c9b-8315-4bf2c26197e5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:42.700738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:42.737370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:42.737976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.738258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.738538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.739576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=f6791f5999ad461d96c95d5746d8fa51) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:42.739895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:42.741432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:42.753544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 148/296] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:42 2022] GET /identity/v3/role_assignments?user.id=f6791f5999ad461d96c95d5746d8fa51&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=7faa3dc09867417b8ea82703161cde19 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:42.858688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6c45d-77a0-4982-b44e-6f91f669e3b6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:42.860269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:42.905857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:42.906675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:42.906954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:42.907231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:42.932095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a571b0c6-f6ab-4410-a6c5-e95c189a7819 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:42.941998 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:42.942986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:42.943762 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:42.945165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 149/297] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:42.950648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.019093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33896be-0974-4c56-b0bf-f8d807248a11 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.019387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33896be-0974-4c56-b0bf-f8d807248a11 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.019558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33896be-0974-4c56-b0bf-f8d807248a11 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.021473 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 150/298] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:43.030291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.030934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.031430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.062151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.063739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.078244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dbc7-0357-47f0-9bf5-3b63a4084fcf None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.100157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.115699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.116525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.116815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.117138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.117892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:43.118202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.119759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.129373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 149/299] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:43.136168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.150816 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 151/300] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:43.187395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.271115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe04b-cf41-4396-af2a-da6cb56ed928 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.306326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.307452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.307884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.308162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] PATH_INFO: `/v3/users/74e3f9a0c45a4403a52cc709b494f691` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.309410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] RBAC: Authorizing `identity:get_user(user_id=74e3f9a0c45a4403a52cc709b494f691)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.310863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b9f80-3770-4767-bee4-56c746c5cf65 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.312693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 150/301] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/users/74e3f9a0c45a4403a52cc709b494f691 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:43.317956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca0f5-4240-432d-84b2-ee3df71db062 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.318255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca0f5-4240-432d-84b2-ee3df71db062 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.318541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca0f5-4240-432d-84b2-ee3df71db062 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.320004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 151/302] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:43.320569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca0f5-4240-432d-84b2-ee3df71db062 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.320781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.339263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14bef3-7ad0-4c5a-bae1-3d09e6a03573 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.377376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.381703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.382614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.382900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.383216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.384940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.387059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35a563-1111-4521-9862-534e90ccd7df None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.393145 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 152/303] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:43.393145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.393145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.393145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.407110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.408309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.440942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca0f5-4240-432d-84b2-ee3df71db062 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.477540 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 153/304] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:43.478197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.493182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.494102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.494356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.494623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] PATH_INFO: `/v3/system/users/74e3f9a0c45a4403a52cc709b494f691/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.497662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74e3f9a0c45a4403a52cc709b494f691, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.499315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.511121 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 152/305] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 25 20:35:43 2022] PUT /identity/v3/system/users/74e3f9a0c45a4403a52cc709b494f691/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:43.518393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.581633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.593166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608de0f-7389-40f8-9e17-0e117afeffec None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.635264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.635967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.636254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.636580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.637399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.639015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542f01b-0565-4ebf-bbfd-60374d0ed169 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.652158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f126-fa45-4f16-b86b-cac4f84e6577 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.659553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 154/306] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:43.661092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579d40-456b-4c4a-9480-5f7116f90328 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.661384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579d40-456b-4c4a-9480-5f7116f90328 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.661928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579d40-456b-4c4a-9480-5f7116f90328 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.663327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 155/307] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:43.672461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.672461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.672461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.672800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.699924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.700145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.700837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.701120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.701447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.701543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.717541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:43.726914 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:43.727876 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:43.728732 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 153/308] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:43.737448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.798300 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 156/309] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:43.834894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.877115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c047c1-aa62-43b3-90c3-eaf73372b010 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.919705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.920731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.921091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.921432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.922197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:43.922507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.925145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.936301 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 154/310] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:43.938210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.941712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.963565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de130d-a844-4a05-9c24-4a06faa40756 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.989002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.008174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.009025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.009312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.009611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.021466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:44.029703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:44.030591 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:44.031367 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 157/311] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:44.037064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.060695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe170d-c5c0-437d-8206-ad1399ad4611 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.103058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.104904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.105184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.105462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] PATH_INFO: `/v3/users/b9ab34456c3845afaaa30b7995358578` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.121653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] RBAC: Authorizing `identity:get_user(user_id=b9ab34456c3845afaaa30b7995358578)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.123147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.125758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 155/312] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/users/b9ab34456c3845afaaa30b7995358578 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.131082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.154442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883ea8-3f0d-415d-a492-b8fb2f3ad7c6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.198174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.199001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.199582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.199860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.200899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:44.201213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.203296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.213449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 158/313] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:44.218399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.221316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.240480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.249230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9266e-453f-44b2-9ffe-67c17ecdd1be None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.292856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.293936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.294308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.294676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.295752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, user.id=b9ab34456c3845afaaa30b7995358578, scope.system=all) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:44.296822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.298283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.313479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 156/314] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/role_assignments?user.id=b9ab34456c3845afaaa30b7995358578&scope.system=all&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:44.348134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1ebde-b285-4171-bb05-0ffdfd43e3be None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.385915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.386705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.386985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.387259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] PATH_INFO: `/v3/users/5e6908447460458bb54ea509794c3cd2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.388531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6908447460458bb54ea509794c3cd2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.390061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.392140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 159/315] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/users/5e6908447460458bb54ea509794c3cd2 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.401659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.511167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053264d8-4378-41ce-86f2-950c5c6b81ec None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.546528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.547197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.547764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.548040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.575600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.617452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.618940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.718469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 157/316] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:44.724936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.807335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.833489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc736-99e3-4df2-9426-8483bc4537e6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.868434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252401-1713-4421-9b94-16e500544434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.869317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252401-1713-4421-9b94-16e500544434 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.869602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252401-1713-4421-9b94-16e500544434 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.869880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252401-1713-4421-9b94-16e500544434 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.871072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252401-1713-4421-9b94-16e500544434 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.872561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252401-1713-4421-9b94-16e500544434 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.874571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 160/317] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.880510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.944871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.984786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d4e6-5543-4654-9d44-b56d603d6232 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:45.019559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:45.020326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:45.020642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:45.020931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:45.021763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, scope.project.id=db3f7cb86ffa414dab630129a55201d3, user.id=5e6908447460458bb54ea509794c3cd2) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:45.022080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:45.023526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab4f9-c649-4091-853f-f14bfa6b8550 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:45.029975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 158/318] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/role_assignments?user.id=5e6908447460458bb54ea509794c3cd2&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:45.888910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e150-ba64-4b67-a5c5-dd93653dc38e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:45.889572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e150-ba64-4b67-a5c5-dd93653dc38e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:45.889572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e150-ba64-4b67-a5c5-dd93653dc38e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:45.890763 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 161/319] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:45.896383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ace3-db5f-445b-b313-39ec783f404c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:45.896935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ace3-db5f-445b-b313-39ec783f404c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:45.897020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ace3-db5f-445b-b313-39ec783f404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:45.915105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-15f9ace3-db5f-445b-b313-39ec783f404c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:45.916571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15f9ace3-db5f-445b-b313-39ec783f404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:45.988465 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 159/320] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:46.013058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350e150-ba64-4b67-a5c5-dd93653dc38e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.077792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f47d-d018-49a6-a49b-68f9372bd9be None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.077987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f47d-d018-49a6-a49b-68f9372bd9be None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.078300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186f47d-d018-49a6-a49b-68f9372bd9be None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.079671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 160/321] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:46.085240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.085535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.086203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.104008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:46.105231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:46.125806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350e150-ba64-4b67-a5c5-dd93653dc38e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.157515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.161052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.161861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.162142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.162415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.170305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.175943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:46.179159 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 161/322] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:46.184050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:46.185142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:46.185937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 162/323] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:46.190988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.203397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.299174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda46d4-4a29-4483-911a-6519b867fc06 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.316723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb75-5adc-4800-9c17-baff7d105ce9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.334125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.334732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.335012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.335284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.336017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:46.336376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:46.337783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:46.350598 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 162/324] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:46.352006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.357266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.358064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.358343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.358616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.359781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:46.361354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:46.363110 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 163/325] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:46.368888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.415852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.440701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.476138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b715-e224-4cea-9059-220ee0786e68 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.478963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de7836-f28b-4ff2-a9c1-25775c64fdb1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.510085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.510755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.511038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.511310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.511986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:46.513545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529268c-cde5-4f38-943d-f133de400823 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:46.514142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.515024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.515303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.515574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] PATH_INFO: `/v3/users/74e3f9a0c45a4403a52cc709b494f691` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.516997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=74e3f9a0c45a4403a52cc709b494f691)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:46.518883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:46.520863 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 163/326] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/users/74e3f9a0c45a4403a52cc709b494f691 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:46.526641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.528848 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 164/327] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Jun 25 20:35:46 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:35:46.622968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5183-b296-4c56-9495-a549ddd43abf None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.623180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5183-b296-4c56-9495-a549ddd43abf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.623469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5183-b296-4c56-9495-a549ddd43abf None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.625078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 165/328] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:46.632252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.632583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.632870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.640788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8037c34-f009-4d7c-8cc1-509648ab4ff5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.651329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:46.652622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:46.655636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.685119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.686220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.686626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.687039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.687869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] RBAC: Adding query filter params (role.id=7faa3dc09867417b8ea82703161cde19, user.id=74e3f9a0c45a4403a52cc709b494f691, scope.system=all) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:46.688181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:46.689679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:46.703326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 164/329] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/role_assignments?user.id=74e3f9a0c45a4403a52cc709b494f691&scope.system=all&role.id=7faa3dc09867417b8ea82703161cde19 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:46.737475 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 166/330] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:46.761572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.881663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02375-0843-46e3-aa51-a67bb26127e7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.919601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.920440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.920742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.921021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.931988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:46.939718 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:46.940649 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:46.941436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:46.942131 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:46.947975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.024250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.072827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afdae3-b284-4bfb-9444-c6a5bc7d827a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.109066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.109799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.110146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.110470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.111228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:47.111535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.113120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.122407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 167/332] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.127946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.161417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.241642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636b8c8-d4d0-4dff-9049-52ee0c894612 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.282813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.283712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.283998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.284276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] PATH_INFO: `/v3/users/b9ab34456c3845afaaa30b7995358578` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.285531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] RBAC: Authorizing `identity:get_user(user_id=b9ab34456c3845afaaa30b7995358578)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.287045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1d9e3-a275-478e-9310-d3a737a8d120 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.289046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/users/b9ab34456c3845afaaa30b7995358578 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.294621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.427804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1eefe-731d-4edf-858b-27106cf73c7e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.445899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.468964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.469850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.470133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.470416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] PATH_INFO: `/v3/system/users/b9ab34456c3845afaaa30b7995358578/roles/21294a297d5045d8bfdbcba96605ea9a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.473026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b9ab34456c3845afaaa30b7995358578, role_id=21294a297d5045d8bfdbcba96605ea9a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.474774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1485c3-d3bb-47ef-87a6-87f2b343e22e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.486635 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 168/334] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 25 20:35:47 2022] PUT /identity/v3/system/users/b9ab34456c3845afaaa30b7995358578/roles/21294a297d5045d8bfdbcba96605ea9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:49.418716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8390b-4c5b-41cd-8279-8f4f571772e0 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.419226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8390b-4c5b-41cd-8279-8f4f571772e0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.419326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8390b-4c5b-41cd-8279-8f4f571772e0 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.420932 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 167/335] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:49.426202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.427040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.427497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.457755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:49.459313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:49.554709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:49.600173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8390b-4c5b-41cd-8279-8f4f571772e0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.721715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.733955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8390b-4c5b-41cd-8279-8f4f571772e0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.780038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.780938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.781223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.781502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.798861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:49.807191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.808078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:49.808890 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 168/337] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.821586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.969329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a895a-9ea9-48a1-b1b9-8281717e8c87 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.992873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.020099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.020863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.021119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.021402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.022188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.022504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.023955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f28cbe-cc43-43d6-b4c4-f0abe053d0e4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.033645 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 170/338] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.039465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.050755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d01206-bce8-4dab-b055-57e4e9bcf97e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.051079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d01206-bce8-4dab-b055-57e4e9bcf97e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.051382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d01206-bce8-4dab-b055-57e4e9bcf97e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.057593 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 171/339] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:50.059002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.059295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.059573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.093705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:50.094942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:50.174539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50cfa-d3e0-453c-9060-d0066ebca625 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.213900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.214573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.214860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.215146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.254127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.282209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 172/340] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:50.310438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.311937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe857-946f-4f7c-a717-52b14d14f121 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.325551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.427179 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 169/341] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:50.428750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3eae-fb9b-47c6-9411-aae07f29c6f6 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.429054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3eae-fb9b-47c6-9411-aae07f29c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.429433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3eae-fb9b-47c6-9411-aae07f29c6f6 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.431074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 170/342] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:50.435648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3eae-fb9b-47c6-9411-aae07f29c6f6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.462448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9fbcb-e81c-41bf-ab84-33db3b2061cc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.464919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.514797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.520408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.521575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.522049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.522515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.538304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cdb4e8f4-6104-410b-91ff-bb750fb35583 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:50.546874 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:50.547716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:50.548557 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:50.551387 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 173/343] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:50.552584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3eae-fb9b-47c6-9411-aae07f29c6f6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.553111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6d70-2103-4745-acb9-ee3db29b033e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.553610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6d70-2103-4745-acb9-ee3db29b033e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.554185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6d70-2103-4745-acb9-ee3db29b033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.577596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f97d6d70-2103-4745-acb9-ee3db29b033e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:50.578808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f97d6d70-2103-4745-acb9-ee3db29b033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:50.589388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.590409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.590702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.590988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.592219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.593979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31014d-b73c-4f07-8f95-aa5b6bbc9452 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.595962 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 171/344] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.597278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81965-7a2a-4f98-8ae1-fdb4b09872d6 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.597574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81965-7a2a-4f98-8ae1-fdb4b09872d6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.597855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81965-7a2a-4f98-8ae1-fdb4b09872d6 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.599731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 172/345] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:50.600363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e81965-7a2a-4f98-8ae1-fdb4b09872d6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.654643 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 174/346] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:50.656061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.656353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.656681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.673993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:50.675193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:50.711333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e81965-7a2a-4f98-8ae1-fdb4b09872d6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.750345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.751077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.751192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 175/347] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:50.751399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.751680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.751962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.752450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.752773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.754373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.765561 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 173/348] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.766355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.771490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.787954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.894445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7d37-1fef-4955-9259-7b9c1620728d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.905535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185baedc-af87-4ae5-8e88-1b6deeca5582 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.941198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.942558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.943282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.943698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.951614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.952213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.952466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.952751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.953029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.954376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.956716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 176/349] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.957689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.965905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:50.981598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:50.982725 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:50.983703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 174/350] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:50.984526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.064891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.078495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.094145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7005c5-6ead-44cb-987e-a4290381af35 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.119087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca362d-5069-42dd-b418-d15f295e52a4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.135765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.136770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.137228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.137936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.167886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.169095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.169509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.169929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.182865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:51.191894 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:51.192965 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:51.193931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:51.196121 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 175/351] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:51.197083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.214849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.216940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.309823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcfcd9-e6cf-4efe-a3a4-91171ded7cd5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.314993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.332504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 177/352] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:51.333947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.334055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.352359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.353080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.353364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.353638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.354472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.354784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.356243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.363883 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 176/353] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.364636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.477896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc447-ff17-440d-b3df-eafc68841c31 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.515915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b923-d1f6-40a6-a2e3-ca996030af9e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.528752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.529558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.529958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.530335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.531196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.531603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.533792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288375a-0770-4f26-a5c6-f1f6cd548127 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.546794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 178/354] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.548488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9264d-ff63-447a-a70e-90ddc5da8b5e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.548733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9264d-ff63-447a-a70e-90ddc5da8b5e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.549010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9264d-ff63-447a-a70e-90ddc5da8b5e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.550756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 179/355] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:51.552216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9264d-ff63-447a-a70e-90ddc5da8b5e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.561124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.561894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.562243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.562587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.563405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.563772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.565361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.575070 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 177/356] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.579949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.628079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.636959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.700974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39994523-0886-414b-ba7e-e42b52a4a8a2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.707345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9264d-ff63-447a-a70e-90ddc5da8b5e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.742740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.743764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.744160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.744470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.751629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.752828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.753405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.753875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.755579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.757093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697127c-a491-44bb-9108-cd3ec336ee31 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.758976 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 180/357] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.760020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3484ee-f889-457d-90d1-401240bce66f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.760302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3484ee-f889-457d-90d1-401240bce66f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.762399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3484ee-f889-457d-90d1-401240bce66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.781588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-da3484ee-f889-457d-90d1-401240bce66f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:51.782800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-da3484ee-f889-457d-90d1-401240bce66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:51.831027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.832877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed204aa-2655-4635-acdb-e5ce71d18942 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.874908 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 181/358] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:51.875864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.875986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3484ee-f889-457d-90d1-401240bce66f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.935393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.984779 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 178/359] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:51.986178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d4127-043b-411c-aed6-b2d4a2600d85 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.986470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d4127-043b-411c-aed6-b2d4a2600d85 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.986746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d4127-043b-411c-aed6-b2d4a2600d85 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.988170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 179/360] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:51.988830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d4127-043b-411c-aed6-b2d4a2600d85 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.005205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3484ee-f889-457d-90d1-401240bce66f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.045386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.046048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.046328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.046695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.118454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d4127-043b-411c-aed6-b2d4a2600d85 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.126125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.127587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a499881-9b50-4164-bd6d-b1a359c6783c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.161621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.162493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.162770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.163038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.164201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.165672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.167775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 180/361] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.168665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.175606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.179350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.244050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 182/362] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:52.245710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.245997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.246275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.263658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:52.265127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:52.314748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1492d-2842-4a9d-899a-cfcc41f8264f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.345378 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 183/363] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:52.346511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.353446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.354604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.355087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.355545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.366824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:52.376860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:52.377938 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:52.378837 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:52.381883 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 181/364] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:52.383115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.452525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.458979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.478418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5b817-b741-42f2-a46d-f444f8e839be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.509591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429428f7-56e8-4b2a-9c25-a5c1d6c3404b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.517267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.518957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.519276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.519648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.521569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.522513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.524416 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 184/365] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.525646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.559326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.559992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.560273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.560601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.561431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:52.561734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.563175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.571554 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 182/366] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=7faa3dc09867417b8ea82703161cde19 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.572392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.646272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123977a0-da77-4df7-873a-0b0043e49c0d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.695648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.696978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.697462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.698625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.700390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.703020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.706137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 185/367] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.707111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.717405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc8e31-e978-4842-8e73-c021d58e7aeb None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.734714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.751304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:52.769109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.771630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.772020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.772390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.787834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:52.797206 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:52.798190 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:52.798980 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:52.799580 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 183/368] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:52.800383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.859501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77e4ce-ed9d-4fcf-abb2-9eaca8006753 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.898299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.899056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.899435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.899806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.900703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:52.901108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.903903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.914563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 186/369] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.915620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:52.935634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a110b-bf81-475d-8b00-0a7c91044887 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:52.982512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:52.983539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:52.983827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:52.984101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:52.985936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:52.987385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:52.989840 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 184/370] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:52.990618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.015558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.030139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c241b-ad9b-4228-b019-0d84cfce41b5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.067445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.069852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.070989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.071286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.071563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.073170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.074920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.077083 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 187/371] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.077930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.119245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479a7f9-e785-454b-b309-8e7bdfc079c3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.160513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.161133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.161421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.161698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.162444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.162748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.164126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.173372 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 185/372] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.174510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.183591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2f92-66cf-4ee3-9f7d-95c9c9c0b5dd None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.220217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.221143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.221427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.221759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] PATH_INFO: `/v3/users/b9ab34456c3845afaaa30b7995358578` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.223200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] RBAC: Authorizing `identity:get_user(user_id=b9ab34456c3845afaaa30b7995358578)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.225033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.226997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 188/373] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/users/b9ab34456c3845afaaa30b7995358578 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.227773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.248819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.287860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b560-d5bc-4901-8807-cd253c481a89 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.305951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.325072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.325733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.326016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.326293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.327180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=db3f7cb86ffa414dab630129a55201d3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.327491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.329098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.336661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79418f0-9cfe-4a76-8502-6d8749f3f742 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.340874 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 186/374] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=7faa3dc09867417b8ea82703161cde19 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.341865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.376561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.377324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.377614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.377898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.378737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=db3f7cb86ffa414dab630129a55201d3) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.379047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.380785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.387050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 189/375] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.388283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.500871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.501781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ea6-8edd-4ffc-9ab9-a1f21033bbf2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.512268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fb0ae-a9d5-48d1-ae38-696b86223557 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.551767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.552709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.553033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.553411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.554375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] RBAC: Adding query filter params (role.id=21294a297d5045d8bfdbcba96605ea9a, user.id=b9ab34456c3845afaaa30b7995358578, scope.system=all) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.554817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.556499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.561219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.561900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.562183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.562459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.572437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 190/376] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/role_assignments?user.id=b9ab34456c3845afaaa30b7995358578&scope.system=all&role.id=21294a297d5045d8bfdbcba96605ea9a => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.652530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.688251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.689806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afabfc-c5a5-453e-9de1-03570142aff0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.805807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 187/377] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:53.813540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.938892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed047-c159-4589-a551-b1c55ae0be67 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.939532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed047-c159-4589-a551-b1c55ae0be67 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.939998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeed047-c159-4589-a551-b1c55ae0be67 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.943190 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 188/378] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:53.949526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.950042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.950463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.974553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967658-4b21-4c0f-b7e9-fb93501c76ca None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.975849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:53.977283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:54.041104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.042297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.042782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.043228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] PATH_INFO: `/v3/projects/7d98522b7634403f83ff66fd72edfd9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.046800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] RBAC: Authorizing `identity:get_project(project_id=7d98522b7634403f83ff66fd72edfd9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.048502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.051542 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 191/379] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/projects/7d98522b7634403f83ff66fd72edfd9e => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.056606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.064796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.103439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 189/380] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:54.143253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.159040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.214636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c9dc-6bc4-45a9-9b8f-3aeb427dabe6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.261802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.262746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.263033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.263307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] PATH_INFO: `/v3/groups/be854d1fa7b042a8bd10123b02fbebfb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.273162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] RBAC: Authorizing `identity:get_group(group_id=be854d1fa7b042a8bd10123b02fbebfb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.274749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.277040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 192/381] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/groups/be854d1fa7b042a8bd10123b02fbebfb => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:54.282316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.307804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef3cc9-c140-43a1-a311-3994c778ed30 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.380821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.403922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c79f0-6093-471b-a898-d61e00b19494 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.445191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.446429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.446920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.447395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.449218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.450042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.450329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.450601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.456478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] RBAC: Adding query filter params (group.id=be854d1fa7b042a8bd10123b02fbebfb, role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=7d98522b7634403f83ff66fd72edfd9e) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.456478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.456478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.460050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 193/382] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/role_assignments?group.id=be854d1fa7b042a8bd10123b02fbebfb&scope.project.id=7d98522b7634403f83ff66fd72edfd9e&role.id=54803232909643ca80ca0cfb291c7f49 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:54.477027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:54.493520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.494463 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:54.495245 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:54.495853 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 190/383] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:54.501609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.628601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae489-e2de-4c9a-925b-14f0de1ac647 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.659063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.665634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.666323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.666605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.666879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.667636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.667938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.669388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.678697 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 194/384] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.684298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.804970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.838991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a9a0f-8a79-4edf-b039-20db6b447e6a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.885234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.886040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.886325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.886607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.887820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.889369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.891369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 191/385] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.896813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.021600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de66d-979c-4c48-a404-f719482196eb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.059304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.060555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.061055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.061515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.062896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.064588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737a42-0ced-4497-9057-e433f1ac7599 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.066815 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 195/386] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.072952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.206733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbbf7b-1ca3-4195-b53e-982605db1fbe None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.244106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.245367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.245838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.246321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/groups/09069334fd2940f48f3496027bd48399/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.250589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, group_id=09069334fd2940f48f3496027bd48399, role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.252572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee050b-2105-421e-beb4-da2d3932c565 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.266952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.273577 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 192/387] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:55 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/groups/09069334fd2940f48f3496027bd48399/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:55.647789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1101-27c5-4369-b972-91a6f8bbb5d6 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.648767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1101-27c5-4369-b972-91a6f8bbb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.649267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc1101-27c5-4369-b972-91a6f8bbb5d6 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.650826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 196/388] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:55.657417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.657714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.657997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.676640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:55.677849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:55.754824 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 193/389] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:55.780292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc1101-27c5-4369-b972-91a6f8bbb5d6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.872849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.915182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc1101-27c5-4369-b972-91a6f8bbb5d6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.961944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.962774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.963057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.963328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.981421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:55.997261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:55.998201 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:55.998981 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 197/390] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.008473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.248068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc5956-d08f-411f-9ccb-0303861b8e5a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.306765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.329205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.330187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.330605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.331012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.331901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:56.332369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.333951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16375e-52ac-4d9c-89d4-6d530ac5f6a6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.348079 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 194/391] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:56.353629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.469992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47d76-2980-4e32-8750-17c5a6b0c7c5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.472287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec11d-9313-4477-b227-e39d406b8493 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.472809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec11d-9313-4477-b227-e39d406b8493 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.473284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec11d-9313-4477-b227-e39d406b8493 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.475083 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 195/392] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:56.480198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919edc-4278-420d-8d47-4286298fd48c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.480694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919edc-4278-420d-8d47-4286298fd48c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.481175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919edc-4278-420d-8d47-4286298fd48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.508840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-87919edc-4278-420d-8d47-4286298fd48c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:56.510256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-87919edc-4278-420d-8d47-4286298fd48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:56.521846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.546794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c882b9-ff31-4014-9031-573454405671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.548027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c882b9-ff31-4014-9031-573454405671 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.548630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c882b9-ff31-4014-9031-573454405671 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.550712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c882b9-ff31-4014-9031-573454405671 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.552227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c882b9-ff31-4014-9031-573454405671 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.559793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c882b9-ff31-4014-9031-573454405671 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.566082 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 198/393] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.573425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c882b9-ff31-4014-9031-573454405671 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.641897 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 196/394] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:56.687061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87919edc-4278-420d-8d47-4286298fd48c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.837179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c882b9-ff31-4014-9031-573454405671 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.867784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87919edc-4278-420d-8d47-4286298fd48c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.903866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.904774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.904878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.905061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.905321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.907689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.909507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.912581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 199/395] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.919125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.938219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.939059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.939342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.939618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.953729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-7766874a-badd-4117-affd-5fc0f1dcf3fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:56.963749 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.964713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:56.965566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 197/396] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:56.968381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b989e3b-29a8-4143-9ed6-7701b5e0dbe7 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.968768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b989e3b-29a8-4143-9ed6-7701b5e0dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.969089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b989e3b-29a8-4143-9ed6-7701b5e0dbe7 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.975718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 198/397] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:56.978360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b989e3b-29a8-4143-9ed6-7701b5e0dbe7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.021365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.078167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e98a7-12eb-4c07-b494-dc7c0c5955b7 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.088212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b989e3b-29a8-4143-9ed6-7701b5e0dbe7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.120151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.121124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.121399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.121674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/groups/09069334fd2940f48f3496027bd48399/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.123790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0e21eda36394cdda8fd37b5ebb03ded, group_id=09069334fd2940f48f3496027bd48399, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.125395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb125c-a695-4083-8a78-946c0fd19df5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.127013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.128063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.129078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.129749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.131030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:57.131785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.133705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.147601 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 200/399] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:56 2022] PUT /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded/groups/09069334fd2940f48f3496027bd48399/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:57.147895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 199/399] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:57.149325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.149734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.150087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.150186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.181850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:57.183167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:57.200472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.264900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d46d7-835a-4631-b1ba-907c00461303 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.300925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.302385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.302977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.303447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.305137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.306839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.309064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 200/400] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:57.314709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.318587 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 201/401] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:57.365184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.433259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ee759-989b-470c-af65-812247a2ad4c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.438642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.446571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.474931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.476301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.476866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.477335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.478729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.480396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.482621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 201/402] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:57.493451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.512479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74abd1-b732-41be-b519-504fb6f6165a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.544173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.545048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.545333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.545610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.557588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:57.566029 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:57.567024 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:35:57.567808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 202/403] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:57.577763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.630431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d57-3bc8-42ae-9415-d147966bd68d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.674676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.675574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.675908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.676756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/groups/09069334fd2940f48f3496027bd48399/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.679516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, group_id=09069334fd2940f48f3496027bd48399, role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.681415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3381aa-c05d-403a-96f5-13bbe69df63d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.699407 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 202/404] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:57 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/groups/09069334fd2940f48f3496027bd48399/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:57.700809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3dfcf-2591-4b12-b7a9-0a02b8070413 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.701096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3dfcf-2591-4b12-b7a9-0a02b8070413 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.701372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3dfcf-2591-4b12-b7a9-0a02b8070413 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.702979 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 203/405] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:57.708738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.709279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.709558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.721075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2de24-b663-46d1-8c15-6c3a873d7c7f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.731241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:57.732152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.734106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:57.773278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.796697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.797537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.797824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.798108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.798873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] RBAC: Adding query filter params (name=member) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:57.799233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.800790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.823017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 203/406] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:57.830221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.835494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 204/407] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:57.862924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.995230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960c0c-318d-48d9-b97a-41b3c14a88bc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.025983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7842-870b-4973-88ce-b22782a5a643 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.043846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.044170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.044370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.044684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.058376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:58.069176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:58.070060 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:58.070838 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 205/408] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:58.071470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.072063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.072063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.072284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.079212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.079212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.080857 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 204/409] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.083321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.093238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.135915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.170955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.267887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5157a8-f52a-4ecd-a1df-bfc050807f6a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.280686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbd270-a3a7-4d25-8987-a3ada926d9fd None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.302052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.302752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.303017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.303297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.304045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:58.304354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.305782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c814-250d-4d71-a4f6-618b416f873b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.318456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 206/410] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.319270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.319798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba737ff-a756-49a1-b34d-ebc2d7ed8c5e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.320090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba737ff-a756-49a1-b34d-ebc2d7ed8c5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.320190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.320381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.320492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba737ff-a756-49a1-b34d-ebc2d7ed8c5e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.320664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.321839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.323295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb74e21-b7b1-4c38-a1bb-3a2d38779127 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.325295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 205/411] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.326189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 207/412] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:35:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:58.326959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba737ff-a756-49a1-b34d-ebc2d7ed8c5e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.327451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.327826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.328212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.348369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:58.350425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:58.429269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.441296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba737ff-a756-49a1-b34d-ebc2d7ed8c5e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.460163 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 206/413] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:58.460163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.495400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.501911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.503107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.503608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.504183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] PATH_INFO: `/v3/groups/be854d1fa7b042a8bd10123b02fbebfb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.506854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] RBAC: Authorizing `identity:get_group(group_id=be854d1fa7b042a8bd10123b02fbebfb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.508598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.510903 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 208/414] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/groups/be854d1fa7b042a8bd10123b02fbebfb => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.511897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.571147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd48cb1-6e19-489f-a7b4-9aaf7238ae74 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.607084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.608096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.608450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.608806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3/groups/09069334fd2940f48f3496027bd48399/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.610929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] RBAC: Authorizing `identity:create_grant(project_id=db3f7cb86ffa414dab630129a55201d3, group_id=09069334fd2940f48f3496027bd48399, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.612483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.639730 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 207/415] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:58 2022] PUT /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3/groups/09069334fd2940f48f3496027bd48399/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:58.639730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.656595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157297a-4411-4d78-93e0-5beecead9713 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.733449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.734640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.735129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.735584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.751408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.760143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2d05-613d-4dac-8535-a20d14ec3c59 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.763754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:58.780453 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:58.781409 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:58.783266 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:35:58.786351 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 209/416] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:58.792217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.798728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.799613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.799895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.800170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] PATH_INFO: `/v3/projects/7d98522b7634403f83ff66fd72edfd9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.801525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] RBAC: Authorizing `identity:get_project(project_id=7d98522b7634403f83ff66fd72edfd9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.812477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.814850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 208/417] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/projects/7d98522b7634403f83ff66fd72edfd9e => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.821635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.842078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.989155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c793e-020c-4863-ac92-540bb47c9d00 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.034494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecd41e-2d6b-4c4e-82a4-38163a1e8348 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.035854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.037081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.037557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.038021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.038964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:59.040854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.042456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.059277 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 210/418] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:59.066251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.168889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.177194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed207f-7574-4dce-801e-0aaf06b9aeb6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.185302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.186317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.186515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.186793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] PATH_INFO: `/v3/projects/7d98522b7634403f83ff66fd72edfd9e/groups/be854d1fa7b042a8bd10123b02fbebfb/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.197316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d98522b7634403f83ff66fd72edfd9e, group_id=be854d1fa7b042a8bd10123b02fbebfb, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.198744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.220526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.224066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 209/419] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:58 2022] PUT /identity/v3/projects/7d98522b7634403f83ff66fd72edfd9e/groups/be854d1fa7b042a8bd10123b02fbebfb/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:59.224958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.225468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.225937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.301192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.303047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.388781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.410905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 211/420] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:59.417055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.444501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.554407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac712b2-87c6-46ce-a924-85738c4c4eb4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.588579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.589464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.589743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.590023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.591220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.592706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.594727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 210/421] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:59.600679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.704330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b7d8d-4a1d-44ff-9292-97c8fbce963d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.739789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.741159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.741448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.741726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.742994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.744529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f41f1-dcb4-4e7e-b346-62111f316f47 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.746777 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 212/422] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:59.752583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.853977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.871765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1aa3d-aa34-4c52-9094-f3548de8f4c1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.919847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.920556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.920843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.921124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.921965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:59.922280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.923743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18cd97-5d2c-4b16-bec7-4dddc68baf70 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.930614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 211/423] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.171871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f732cf-58e9-4b70-8a1e-dd5de73c11d9 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.172396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f732cf-58e9-4b70-8a1e-dd5de73c11d9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.172494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f732cf-58e9-4b70-8a1e-dd5de73c11d9 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.174143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 213/424] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:00.179537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec489e-97d0-47ee-a62c-717eaf5ca25d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.180020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec489e-97d0-47ee-a62c-717eaf5ca25d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.180095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec489e-97d0-47ee-a62c-717eaf5ca25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.201614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-21ec489e-97d0-47ee-a62c-717eaf5ca25d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:00.202864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-21ec489e-97d0-47ee-a62c-717eaf5ca25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:00.286526 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 212/425] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:00.311459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f732cf-58e9-4b70-8a1e-dd5de73c11d9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.370825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.409419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0901fc-89d7-4f4f-a0a8-e2c1ff6f7a65 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.409735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0901fc-89d7-4f4f-a0a8-e2c1ff6f7a65 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.409987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0901fc-89d7-4f4f-a0a8-e2c1ff6f7a65 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.412653 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 213/426] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:00.417386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.417672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.417948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.425863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f732cf-58e9-4b70-8a1e-dd5de73c11d9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.436115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:00.437428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:00.465516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.466430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.466717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.467088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.478828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:00.486724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.487678 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:00.488651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 214/427] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.494089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.526122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 214/428] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:00.552621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.569520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.599664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456f565-3bf1-46e2-8d45-a983229422d8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.609092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.634959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.635631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.635914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.636194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.636974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.637278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.638661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.647700 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 215/429] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.653119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.670348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4677f5-59bb-4241-9306-af6c87929cf5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.708142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.709413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.710012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.710452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.722366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:00.731985 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.733081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:36:00.733863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:00.735981 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 215/430] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:00.742867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.756974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13c440-9174-4b1b-bcb6-90e2c7df1f5a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.791853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.793178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.793178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.793178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.827993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.840001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.864089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e4994-c868-482c-b794-28ec6003c4ac None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.873584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.875161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.908117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.909186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.909468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.909741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.910592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.910894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.912291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.925353 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 216/431] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.933386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.990031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 216/432] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:36:00.996560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.047673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327fe7b-757b-44b0-beca-9a1eaf72fd43 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.066645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.084132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.085301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.086026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.086508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.092049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.109991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcf8b-e950-4c60-ae88-233f19be5738 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.153190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.154054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.154383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.154664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] PATH_INFO: `/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.155989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] RBAC: Authorizing `identity:get_project(project_id=b0e21eda36394cdda8fd37b5ebb03ded)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.157551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.159749 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 217/433] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/projects/b0e21eda36394cdda8fd37b5ebb03ded => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:01.165059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.170052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.171650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.280807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 217/434] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:01.286029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.292570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930286b-a799-43c8-850f-f7334e99fdd0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.320101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.336616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.337717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.338140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.338554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.339938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.341574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.343698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 218/435] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.356508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.361656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.402183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa666-84a3-4b3b-b3fc-a2984c5a4d72 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.437137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.438032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.438309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.438583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.439793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.441349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd8644-9678-4757-b20b-945008162f43 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.443045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 218/436] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.444415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19771-8d91-45d3-8295-5af87733af6e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.444743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19771-8d91-45d3-8295-5af87733af6e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.444988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19771-8d91-45d3-8295-5af87733af6e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.446337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 219/437] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:01.451163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d19771-8d91-45d3-8295-5af87733af6e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.472053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b2ec6-79bf-4f9e-92a8-23a6fc3801c2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.507623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.508717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.509225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.509650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.510611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.510987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.512483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0af20-0510-4a97-888d-c786165413d4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.518725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 219/438] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=b0e21eda36394cdda8fd37b5ebb03ded&role.id=7faa3dc09867417b8ea82703161cde19 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.518725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.518725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.518725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.546012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:01.547146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:01.574290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d19771-8d91-45d3-8295-5af87733af6e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.577818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.617193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.618139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.618422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.618746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.619971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.621531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.628627 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 220/439] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.629932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.648934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.648934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 220/440] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:01.675200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.796539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd91ec3-ad77-4f0a-b406-ba8ccfa3e57d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.843365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.844182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.844521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.844797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] PATH_INFO: `/v3/roles/member` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.857010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:01.865986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:01.867075 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:36:01.868030 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:01.872858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 221/441] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:01.874103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.908914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7f80a-7985-4560-8d23-a97dd909d1cb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.947563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.948493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.948932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.949327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.950304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=db3f7cb86ffa414dab630129a55201d3) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.950753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.951752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.952201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921b29-0230-4fce-bac2-8cc6e0146094 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.958711 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 221/442] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 611 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:01.962165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9512c-c81d-4c78-a845-c23cbf90d257 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.962165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9512c-c81d-4c78-a845-c23cbf90d257 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.962165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9512c-c81d-4c78-a845-c23cbf90d257 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.966055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 222/443] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:01.967567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.967852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.968125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.986315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:01.987527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:02.009438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0e790-2a62-4f00-8dce-ce40ee60838c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.025060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.061517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.062120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.062941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.063222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.064860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.065171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.067929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.080654 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 222/444] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:02.081330 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 223/445] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:02.089501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.111235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.208182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe393b-c582-4b55-b174-802033b342a8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.235257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.239585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ed28-302b-4fcc-ba96-43854f7a0122 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.249172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.249827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.250110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.250384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.278886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.279688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.279971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.280247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.290592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:02.298189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:02.299156 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:02.299924 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 224/446] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:02.305192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.327732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.329179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.331421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.401988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80fc86-50c3-47ec-b0d5-439e98a50feb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.425399 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 223/447] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:02.431112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.435363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.436004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.436287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.436588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.437329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.437630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.439045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.447483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 225/448] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:02.453574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.458568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.534119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2aa1-d00e-412b-b302-3866bc844141 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.541824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.554201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc08-a200-43f1-9c69-aa61489e6ff9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.567421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.568291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.568595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.568865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] PATH_INFO: `/v3/projects/db3f7cb86ffa414dab630129a55201d3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.570047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] RBAC: Authorizing `identity:get_project(project_id=db3f7cb86ffa414dab630129a55201d3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.571496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.573231 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 224/449] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/projects/db3f7cb86ffa414dab630129a55201d3 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:02.578953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.587983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.588677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.588952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.589232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.656066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.658835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.676056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.686962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f240a8-ad0c-4e6d-9c0e-22f3b9fa2d2e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.722853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.724019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.724295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.724600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] PATH_INFO: `/v3/groups/09069334fd2940f48f3496027bd48399` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.725769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] RBAC: Authorizing `identity:get_group(group_id=09069334fd2940f48f3496027bd48399)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.730515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.732059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 225/450] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/groups/09069334fd2940f48f3496027bd48399 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:02.738650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.750115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.763076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 226/451] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:36:02.768259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.850042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9224-66a2-444f-810c-9c25c54bf045 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.868702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c558e4-14bc-4e7a-b8c9-e3fa0f1c4111 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.883546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.884209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.884509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.884764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.885585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] RBAC: Adding query filter params (group.id=09069334fd2940f48f3496027bd48399, role.id=7faa3dc09867417b8ea82703161cde19, scope.project.id=db3f7cb86ffa414dab630129a55201d3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.885897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.887324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.892980 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 226/452] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/role_assignments?group.id=09069334fd2940f48f3496027bd48399&scope.project.id=db3f7cb86ffa414dab630129a55201d3&role.id=7faa3dc09867417b8ea82703161cde19 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:02.901937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.902825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.903106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.903378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] PATH_INFO: `/v3/projects/7d98522b7634403f83ff66fd72edfd9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.904663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] RBAC: Authorizing `identity:get_project(project_id=7d98522b7634403f83ff66fd72edfd9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.906151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.907935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 227/453] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/projects/7d98522b7634403f83ff66fd72edfd9e => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:02.913980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.941529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.022908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be47b-1de0-47a0-9c65-8eafa1fa1d64 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.060855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.061885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.062169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.062446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] PATH_INFO: `/v3/groups/be854d1fa7b042a8bd10123b02fbebfb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.063752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] RBAC: Authorizing `identity:get_group(group_id=be854d1fa7b042a8bd10123b02fbebfb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.066551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67662e5-345c-4ac6-8108-cb5ae16ecbc2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.068295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 227/454] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/groups/be854d1fa7b042a8bd10123b02fbebfb => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.074364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.138640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.184243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a63868-6701-4dee-8125-71d2b59c1325 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.231847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.232558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.232845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.233120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.233966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] RBAC: Adding query filter params (group.id=be854d1fa7b042a8bd10123b02fbebfb, role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=7d98522b7634403f83ff66fd72edfd9e) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.234279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.235761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612cdad-7d2e-4f93-8843-0919946c5b36 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.246552 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 228/455] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/role_assignments?group.id=be854d1fa7b042a8bd10123b02fbebfb&scope.project.id=7d98522b7634403f83ff66fd72edfd9e&role.id=54803232909643ca80ca0cfb291c7f49 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:06.181372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d010fb-614f-425e-8085-77c307ed66b1 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.182378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d010fb-614f-425e-8085-77c307ed66b1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.182866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d010fb-614f-425e-8085-77c307ed66b1 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.184858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 228/456] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:06.191331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76512a-f9db-43d6-8533-982889c60d26 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.192210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76512a-f9db-43d6-8533-982889c60d26 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.192737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76512a-f9db-43d6-8533-982889c60d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.212505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ae76512a-f9db-43d6-8533-982889c60d26 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:06.214037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae76512a-f9db-43d6-8533-982889c60d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:06.314833 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 229/457] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:06.370066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d010fb-614f-425e-8085-77c307ed66b1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.381931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9630c2-d890-4a42-9ba8-fb8ed73d5a63 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.384617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9630c2-d890-4a42-9ba8-fb8ed73d5a63 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.385117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9630c2-d890-4a42-9ba8-fb8ed73d5a63 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.389359 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 230/458] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:06.393266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede399-3f3e-483d-a29b-c69372182b01 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.393781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede399-3f3e-483d-a29b-c69372182b01 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.394368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede399-3f3e-483d-a29b-c69372182b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.424386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-48ede399-3f3e-483d-a29b-c69372182b01 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:06.425672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48ede399-3f3e-483d-a29b-c69372182b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:06.501405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.536453 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 231/459] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:06.536453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9c79-0963-48ce-81f5-218110ab18bc None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.536453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9c79-0963-48ce-81f5-218110ab18bc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.536453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9c79-0963-48ce-81f5-218110ab18bc None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.540233 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 232/460] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:06.542286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.543199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.543491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.543771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.565641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d010fb-614f-425e-8085-77c307ed66b1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.569462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:06.570852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:06.602651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.603448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.603918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.604331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.616133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.617868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:06.636597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:06.637691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:06.638545 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:06.638545 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:06.638545 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:06.638545 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:06.646084 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 233/461] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:06.646084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.646964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 229/462] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:06.648044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.753901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201679-5f22-4ef3-859c-88d5872cf06e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.766405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.772310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586d74-bb8e-4658-97f4-794b2e5c9055 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.791411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.792249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.793491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.793778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.810058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.811546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.814412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.815087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.815369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.816505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.818503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.818503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.818690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.837067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 230/463] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:06.837067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-239d60c6-7a01-44d7-8c67-a6620200a02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:06.837295 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:06.838080 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 234/464] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93687-85e7-4183-8be1-99d80cd16d3c None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93687-85e7-4183-8be1-99d80cd16d3c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93687-85e7-4183-8be1-99d80cd16d3c None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.838935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 235/465] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:06.843824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.845744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c93687-85e7-4183-8be1-99d80cd16d3c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.942307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544897-c1ad-4a1f-a28f-85b60ede3342 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.957095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c93687-85e7-4183-8be1-99d80cd16d3c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.978841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.979632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.979911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.980185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.990264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.991711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.993074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.993747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.994028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.994463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.995005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.996453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442ea9d-e4ca-42fe-b972-91e759a6a744 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:07.010235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:07.011103 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:07.011931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:07.011931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:07.011931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:07.011931 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:07.016229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 231/466] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:07.016928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.028854 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 236/467] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:06 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:07.028854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.028854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.028854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.046641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:07.047962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:07.066750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.093465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.140637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 237/468] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:07.141808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.154788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fbea7-dbbd-4f38-9c91-eb2cf3a80c0b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.203906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.204675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.204915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.205593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.206664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:07.206983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.208718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.228521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 232/469] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:07.229466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.277432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9783-1b4a-4458-b1cd-e894c57dc010 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.320740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.321413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.321692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.321964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.322686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:07.322986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.324456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.344377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 238/470] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:07.345245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.357492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5848-9efb-406c-b59c-2247ed06de29 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.361423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.373321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.395783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.396766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.397050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.397324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.408926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.410453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-c9735da6-7596-4744-9f99-058fc8adadb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:07.427529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:07.428391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:07.429265 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:07.429265 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:07.429265 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:07.429265 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:07.429265 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 233/471] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:07.430015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a2d1-979f-4a25-8eb0-f930cb69b830 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.430313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a2d1-979f-4a25-8eb0-f930cb69b830 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.430587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a2d1-979f-4a25-8eb0-f930cb69b830 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.432011 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 234/472] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:07.436976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a2d1-979f-4a25-8eb0-f930cb69b830 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.461498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d593f-61fb-426e-933f-87b4293cc626 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.500140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.500847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.501240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.501514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.502342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.503937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.536811 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 239/473] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:07.538485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.549257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a2d1-979f-4a25-8eb0-f930cb69b830 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.599895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.600651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.600936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.601218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.601988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.604203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3968f-2d29-4b23-ac78-ae49e4ebb9f4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.614716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.637901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 235/474] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:07.639438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.639735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.640015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.664927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:07.667038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:07.669420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec9eb-1f7a-4e54-ab7f-a94b4f3e50f8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.692254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.726494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.727575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.728048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.728535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.729732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:07.730128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.731737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.762449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 240/475] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:07.765062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 236/476] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:07.780241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.795607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.915797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d385d-e9a3-4ed6-854a-c8dee0385577 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.935151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f974e-3c02-46bb-9578-39bfc9723c30 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.948013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.961654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.962875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.963213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.963495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.964228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.966265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.978962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.980004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.981309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.981309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.981927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.983640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.992327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.sql.core [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 25 20:36:07.992327 ncdv-master-1 devstack@keystone.service[97720]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 25 20:36:07.992327 ncdv-master-1 devstack@keystone.service[97720]: [parameters: {'id': 'b7afd3d0f5e3482491f5e94a4e98a4eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 25 20:36:07.992327 ncdv-master-1 devstack@keystone.service[97720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 20:36:07.999647 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 241/477] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:08.010325 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return ref.to_dict() Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:08.011240 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application yield resource Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise self.value Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application session.commit() Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 20:36:08.012349 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.flush() Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application compat.raise_( Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:36:08.013427 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:08.014500 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:08.015542 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [parameters: {'id': 'b7afd3d0f5e3482491f5e94a4e98a4eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:08.016617 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 25 20:36:08.017688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:08.018679 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 237/478] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 25 20:36:07 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:08.019890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:08.136362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfc05-6982-40b4-a34a-2391fc5d2dd6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:08.174050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:08.175244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.175833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.176332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.192868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8e87faed-005f-4c1c-bae6-37c97e796376 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:08.201977 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:08.202909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:36:08.203668 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:08.206531 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 242/479] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:08.211997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:08.241583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:08.327376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da9eb-0536-4733-a852-2af60d527c48 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:08.374928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:08.375638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.375922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.376200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.377018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:08.377327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:08.378938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bee87-af81-4b63-aea2-6f210de298d8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:08.388314 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 238/480] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:09.866354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3ee4-ae50-41eb-b09f-432280882339 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.866900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3ee4-ae50-41eb-b09f-432280882339 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.866900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3ee4-ae50-41eb-b09f-432280882339 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.868567 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 243/481] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:09.874003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.874409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.874576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.900673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:09.901949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:09.998519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 239/482] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:10.040438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3ee4-ae50-41eb-b09f-432280882339 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.092731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.174100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3ee4-ae50-41eb-b09f-432280882339 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.218998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.220194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.220703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.221272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.238401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-138a95fc-37f0-4dbc-a7c3-af927a9ffdd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:10.246756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:10.247606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:10.248393 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:10.251119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 244/483] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:10.256802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.274416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.402298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f687df2-4690-4fde-843c-b0292958a471 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.415517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef705-cb23-43df-b33e-a13da8cfb294 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.416133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef705-cb23-43df-b33e-a13da8cfb294 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.416651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef705-cb23-43df-b33e-a13da8cfb294 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.418509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 245/484] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:10.425048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.425838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.426369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.464998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:10.466277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:10.466518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.467354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.467649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.468138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.469282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:10.469602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.471668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.490940 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 240/485] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:10.492140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.565982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.601067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b6b30-9daf-4070-b690-479bf00ada9b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.624462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 246/486] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:10.636715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.637527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.637812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.638093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.650000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.651525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:10.669672 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:10.670529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:10.671439 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:10.671439 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:10.671439 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:10.671439 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:10.671439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 241/487] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:10.678238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.678792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.728858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.790998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2b4af-fc1b-4089-9fee-a6f0858a632e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.791194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4962b-c0cc-4b6c-a100-9ae13c3ccc65 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.814562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.826728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.827544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.827831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.828107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.839082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:10.842802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.843638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.844062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.844522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.845387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:10.845835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-fd170902-0614-45db-9cc8-f49ab75c07d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:10.846754 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:10.847840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:10.849017 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:10.850454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.852782 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 242/488] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:10.854172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6cdd-779b-4c88-bc4d-ef25db2f9ac4 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.854465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6cdd-779b-4c88-bc4d-ef25db2f9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.854749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6cdd-779b-4c88-bc4d-ef25db2f9ac4 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.860776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 243/489] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:10.861993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.862280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.862554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.864994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 247/490] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:10.870542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.886352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:10.887550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:10.967592 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 244/491] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:10.968728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.000404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.012350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f19d11-5aa3-42a1-8a4a-0a099da70a2d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.057807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.058799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.059349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.059635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.060408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.060763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.062323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.074216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 248/492] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.075055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.106991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080a91-cb95-4f8e-8918-aef05788f321 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.121113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.143554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.144570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.144928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.145274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.152922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.154493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:11.170687 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:11.171638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:11.172537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 245/493] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:11.173100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.189983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db826-bcdc-4f7b-bd08-f8d5ea622727 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.227159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.228673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.228974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.229252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.243499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:11.253979 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:11.254858 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:11.255673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:11.260000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 249/494] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:11.260694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.276208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.282991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf02e4-0362-4d18-8e13-2e986dfcc0a7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.318331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.319123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.319416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.319687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.330042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.331534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.363192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c863d-e66e-4011-af8a-b7b2565dfcd4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.406691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.407400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.407686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.407964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.408847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.409161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.410743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7476b-5e68-4347-9cc3-60fa264c1f70 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.450270 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 250/495] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.451695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82206-1444-47d3-a181-60baea6bd5d7 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.451992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82206-1444-47d3-a181-60baea6bd5d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.452274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82206-1444-47d3-a181-60baea6bd5d7 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.453678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 251/496] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:11.455191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82327b1-9503-4827-a933-77cb993740fa None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.455191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82327b1-9503-4827-a933-77cb993740fa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.455396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82327b1-9503-4827-a933-77cb993740fa None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.456834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 252/497] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:11.457956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82327b1-9503-4827-a933-77cb993740fa None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:11.470236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:11.471097 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:11.471918 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:11.471918 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:11.471918 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:11.471918 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:11.471918 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 246/498] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:11.472680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.499676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.533308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.565174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82327b1-9503-4827-a933-77cb993740fa None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.574285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ec85-53ac-4bdc-9832-7f86d1ec8c5a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.599507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.600182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.600472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.600754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.601501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.601813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.603200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754966c-1f88-4f26-aeaa-130922d56718 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.607914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.608606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.608890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.609163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.614653 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 253/499] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.614653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb645-8b7a-416b-b278-71f19c3b9e6b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.614653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb645-8b7a-416b-b278-71f19c3b9e6b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.614653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb645-8b7a-416b-b278-71f19c3b9e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.629016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-57fbb645-8b7a-416b-b278-71f19c3b9e6b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:11.630228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-57fbb645-8b7a-416b-b278-71f19c3b9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:11.679869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.681372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.698478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 254/500] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:11.699730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.700013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.700277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.705819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.726458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:11.727655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:11.781501 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 247/501] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:11.782272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.786280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.793238 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 255/502] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:11.794037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.887178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20550c55-f8cc-44bf-9546-fe1d4ea409e1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.902060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c5c7-d922-4163-9887-76d43ab464d2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.920661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.932574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.933256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.933540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.933818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.934543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.934851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.936099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.936239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.936930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.937214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.937490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.947400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.947714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 248/503] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.948532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.948972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:11.968050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:11.969128 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:11.969960 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:11.969960 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:11.969960 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:11.969960 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:11.969960 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 256/504] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:11.970262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.015470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.047770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9961a-e1b5-4f6c-b231-af8c182c86d6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.069308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a178a24-3aac-4820-9657-6b84fd17d35b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.082893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.083691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.083980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.084251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.094268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:12.102441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.103420 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:12.104235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 249/505] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.104916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.106324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.107120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.107403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.107682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.118670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.120150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:12.137756 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.138745 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.139642 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:12.139642 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:12.139642 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.139642 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:12.139642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 257/506] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.139897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.155139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.215290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cc15-a6ba-4f27-aa23-3be0ed54e40d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.235963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.242472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e88-f682-4632-ad8e-e67b2c4c47c5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.250341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.251167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.251454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.251732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.262691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.264165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.277650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.278457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.278736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.279011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:12.281022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.281902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.282729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:12.282729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:12.282729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.282729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:12.282729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 250/507] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.283008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.288918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.290385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:12.306041 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.306916 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:12.307784 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 258/508] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.308323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.381174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.387231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d34d-2356-4128-893c-685141cb5e20 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.414894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837bc5-61fa-41d6-8c24-a676670eef08 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.421793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.422459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.422739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.423016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.423728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.424035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.425504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.437162 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 251/509] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.437939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.449513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.450218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.450502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.450776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.451500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.451814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.453225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.461262 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 259/510] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.462037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.481970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.540123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03fec0-e59d-49de-92af-32d25ad9db31 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.561632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fb1a-780e-43a0-a265-84afa1019d64 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.572719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.573387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.573667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.573943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.574656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.574960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.576329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.587512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 252/511] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.588314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.596253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0708-1067-430f-9176-2320d126904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.597141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0708-1067-430f-9176-2320d126904d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.597446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0708-1067-430f-9176-2320d126904d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.597729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0708-1067-430f-9176-2320d126904d None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.598831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb0708-1067-430f-9176-2320d126904d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.599173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb0708-1067-430f-9176-2320d126904d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.600647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb0708-1067-430f-9176-2320d126904d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.605838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.612495 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 260/512] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.613377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0708-1067-430f-9176-2320d126904d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.685783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1768c-3f0b-48f5-8711-934a62f5e1ff None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.695028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.716561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0708-1067-430f-9176-2320d126904d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.719393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.720067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.720355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.720681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.721499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.721812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.723636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.750266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.751155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.751499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.751777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] PATH_INFO: `/v3/users/glance` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.759117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.760014 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 253/513] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.760659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.761059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:12.775533 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.776609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:12.777506 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 261/514] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.778053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.841285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.867203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf97f-52db-48a6-a0a9-2efe849eea4a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.875170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c56a0-5b36-44c6-ac4d-18a27c636dbc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.900842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.901675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.901956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.902229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.910582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.911379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.911658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.911925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.912163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.913648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.918915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.920515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.922266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:12.930982 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.931816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.933006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:12.933006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:12.933006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:12.933006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:12.933006 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 254/515] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.933420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:12.936075 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.937851 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 262/516] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.938882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.036783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ebd28-de50-4bb7-8345-446169b5cffd None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.045795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16190e-fdf3-43fa-88c7-da2e2cd2dd7a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.061077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.070488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.071161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.071445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.071771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.072474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.073921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.077956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.078595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.078876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.079149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.095326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 255/517] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:12 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:13.096136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.151595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.156721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.158520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.215159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b22f-479f-4386-9773-305b20b14fd5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.252557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.253244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.253531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.253801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.254644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.254950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.256408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.274566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 263/518] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:13.275866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.284189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 256/519] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.285119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.336031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.390321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.394709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136c6d-d3fb-4127-a493-ab724eec2141 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.397727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a294b1-49dc-4808-8cd8-c22288738e35 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.435455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.436122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.436384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.436709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.437429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.437733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.438959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.439087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.439626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.439909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.440186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.441189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.441602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.443057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.451435 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 264/520] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.457221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.463349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 257/521] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.464248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.564283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.566773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9989c-c88d-47d2-a877-967135ff1a7c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.567724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42632f4f-c106-47a9-9a2d-6b12df4c839b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.601788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.602509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.602793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.603076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.611417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.612577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.612903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.613180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.614216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.615682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:13.632866 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:13.633758 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:13.634582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:13.634582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:13.634582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:13.634582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:13.634582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 265/522] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:13.634835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.648584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.698010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.699889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.741581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3a2d3-3611-4c24-9c2d-c71bb68e23aa None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.776728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.777553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.778114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.778482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.786575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.788050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.797403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:13.804491 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:13.805377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 266/523] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:13.806224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.806835 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 258/524] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:13.809076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.889496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.917590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacedb3-588e-4d88-9e74-27a2944e1163 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.923933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126e43-f865-4cc2-ba3f-d21624352ea8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.954828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.955455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.955792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.956012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.956825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.957134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.958515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.959119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.959940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.960232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.960548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.961812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.962131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.963614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.974714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 259/525] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.974714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.980638 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 267/526] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.981688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.055430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.104981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bebe8-2a01-40b7-9002-4b6582865cf2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.129628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3797e41-e775-4ea8-b62e-9010bc6e5017 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.154237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.154974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.155260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.155539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.169551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.170131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.170827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.171296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.171593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.172007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.173102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.173414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.174881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.176995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:14.201296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.202324 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.203180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:14.203180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:14.203180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.203180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:14.203403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 268/528] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:14.204229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.207523 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 260/528] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.208993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.329106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0f621-d20b-48ca-99e7-5780a4ce4dec None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.332307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feada-07b6-4a1c-9460-6650c8ead2aa None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.342626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.366891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.367822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.368246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.368691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.373719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.374522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.374803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.375079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.382657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.384128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:14.401441 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.402450 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:14.403430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 269/529] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.403911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.461272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.462968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.469252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.532138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b258c-5bc2-4fd3-8464-d36d951b95a1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.576082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.576937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.577344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.578035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.578995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.579533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.581051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.585395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 261/530] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:14.586953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.594698 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 270/531] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:14.595686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.613195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.718220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7ba57-736c-4bfe-96a8-06e5131fe085 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.733692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2ed-7c4d-49eb-8504-5141a1d37560 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.752273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.756957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.757929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.758384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.758828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.759782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.760287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.761762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.779407 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 262/532] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:14.780292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.780586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.781749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.782202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.782647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.801948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.803730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:14.826746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.827526 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.828366 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:14.828366 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:14.828366 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.828366 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:14.832353 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 271/533] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.833251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.869927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.903566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9dadc-2997-4354-b516-fa223f32e795 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.942188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.944347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.944961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.945504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.950448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a0cc-6294-4752-a97c-04cf3d91c4f4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.955283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.956961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:14.977597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.978671 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:14.979709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:14.987102 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 263/534] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.987102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.996782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.997458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.997895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.999069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.000544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=083565d7e7e3423486d9bfd51efaf318) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.000963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.002792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.011432 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 272/535] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/role_assignments?user.id=083565d7e7e3423486d9bfd51efaf318&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:15.012263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.077160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.162267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17df01-5280-4841-ab46-a994521edbc8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.189828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeaeb8-9fec-4975-8852-f22e62573634 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.201888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.202998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.203578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.204058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.205294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.205866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.207686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.222793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.229428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.230031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.230323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.230599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.231341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.231649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.237721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.238143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 273/536] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:15.239741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.246380 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 264/537] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:15.251836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.339493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.354378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a947-c25b-4648-a74a-6cc4ff0904d5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.390316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.391324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.391845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.392324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.393626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8cddedee376f4cf4a01caffdea20716d) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.394245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.396001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de03f7-01f1-4451-8ec4-92db8990cc3f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.406521 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 274/538] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/role_assignments?user.id=8cddedee376f4cf4a01caffdea20716d&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:15.488251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c905c1-70ee-46fb-8a71-92bd9f72e211 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.536472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.537712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.538215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.538695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.551836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.553667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.566762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523498e-84f5-4b42-b210-a893209b3159 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.567095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523498e-84f5-4b42-b210-a893209b3159 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.567334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523498e-84f5-4b42-b210-a893209b3159 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.569000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 275/539] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:15.574020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.574322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.574604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:15.580924 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:15.581848 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:15.583144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 265/540] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:15.588269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.616710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:15.617950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:15.645734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.693643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7bce-0f5c-4516-8369-20e084ac665d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.756722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.757316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.757603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.757904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.758662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.758972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.760444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.769759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 276/541] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:15.787796 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 266/542] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:15.793630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.850852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.914995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.950445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab85d7-7af1-460a-a8d1-ee1efd83a53e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.017775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.018908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.020183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.022126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.023171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=f07213aded8c456785f17c358a348083) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.024929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.026615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.037001 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 277/543] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/role_assignments?user.id=f07213aded8c456785f17c358a348083&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.056132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5e653-ce89-4be2-b148-8cd81c8ffc59 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.081500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.119042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.120928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.121648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.122430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.145202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:16.153478 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:16.154441 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:16.155236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:16.157413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 267/544] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:16.163550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.294509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c3e5-97d6-418e-841b-637be86aaf57 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.341184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.341861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.342142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.342415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.343161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.343463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.344910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088fe0-ef8a-4ea1-b460-1a0c3a838a55 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.353974 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 278/545] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.362059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.529135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a087-a25f-4095-9f89-b19051d587fa None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.552145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9c24-741e-4f28-b0e4-2e260634b83d None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.552346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9c24-741e-4f28-b0e4-2e260634b83d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.552659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9c24-741e-4f28-b0e4-2e260634b83d None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.554306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 279/546] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:16.559234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.559520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.559799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.576894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:16.578115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:16.580165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.590841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.591667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.591955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.592236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.612598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.614355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:16.637562 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:16.638509 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:16.639371 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:16.639371 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:16.639371 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:16.639371 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:16.641887 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 268/547] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:16.647308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.696811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.706278 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 280/548] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:16.753952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.795068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c7d18-119a-498b-adee-b04103ae8307 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.885580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.886619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.887049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.887469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.888343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.888871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.891410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.917525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373d7db-8cab-4995-a717-0f91bc937bde None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.923017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 269/549] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.939802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.989117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.990540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.991653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.992637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.005828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.008965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:17.017553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:17.019218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:17.020384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:17.022902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 281/550] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:17.033494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.060171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.075847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83eae3-7dfe-4afa-9380-2a4391beae33 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.109185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.109987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.110262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.110529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.118186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.119736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:17.142151 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:17.143326 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:17.149460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:17.153381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 270/551] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:17.158516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.225967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143dfbb-bf87-4d18-85fe-5e5c5b92e51e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.267539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.268696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.269202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.269673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.270634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:17.271130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.272731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.281925 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 282/552] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:17.289392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.374083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136def-bd09-48f9-87bb-4506312fa450 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.416846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.417042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.417530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.417811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.418084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.418926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:17.419236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.420716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.459468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7278b5f-1151-47de-ae29-c92bf1059571 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.465475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 271/553] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:17.470953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.477306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.496272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.497903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.498396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.500220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.521198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.522671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:17.554384 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:17.555302 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:17.556149 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:17.556149 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:17.556149 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:17.556149 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:17.559437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 283/554] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:17.564686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.648989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d5b4-c3a6-45dd-b703-b9fc14c8f1c1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.718165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.718817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.719096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.719369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.742085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3579-bfbb-46e8-ba5c-a62ca942506f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.764795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.809260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.811341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.811623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.811896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.812650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:17.812957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.814370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.846282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 284/555] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:17.852183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.856715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.858182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549c4e-4e2c-419a-baea-a7d38942a122 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.865460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.993984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 272/556] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:36:17.995548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4138-932c-44ea-8f7a-82f140a70458 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.995839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4138-932c-44ea-8f7a-82f140a70458 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.996114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4138-932c-44ea-8f7a-82f140a70458 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.001687 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 273/557] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:18.001687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4138-932c-44ea-8f7a-82f140a70458 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.003126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e4807-45bb-4eb3-9964-d7ac0f694293 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.039110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.040339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.040862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.041340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] PATH_INFO: `/v3/users/nova` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.049790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.051707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-daea00fd-a867-4b26-a2f7-ec37ea163fad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:18.067920 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.069403 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:18.070336 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:18.073215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 285/558] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.074760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.075266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.075733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.093540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:18.095087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:18.106365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4138-932c-44ea-8f7a-82f140a70458 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.107942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.126759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.145360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.146158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.146439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.146713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.157416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.159114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.172989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 286/559] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:18.172989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-58a16a03-fc8b-4608-851f-1ed1819e9690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:18.183218 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.184252 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.185413 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:18.185413 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:18.185413 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:18.185413 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:18.185413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 274/560] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.186032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163c9e-6dd4-4112-b8d3-dca6fe2a0fc0 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.186306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163c9e-6dd4-4112-b8d3-dca6fe2a0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.186582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163c9e-6dd4-4112-b8d3-dca6fe2a0fc0 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.188079 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 275/561] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:18.196215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0163c9e-6dd4-4112-b8d3-dca6fe2a0fc0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.295657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f1f42-7df6-42a8-9d6f-8c8f7f2bb6c3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.304744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0163c9e-6dd4-4112-b8d3-dca6fe2a0fc0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.335276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.336477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.336978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.337571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.338635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.338951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.340479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.343759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.345221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.345503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.345785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.346521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.346873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.348636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b5f14-6c3d-4af2-8ea3-35699b1b1bc8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.365179 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 276/563] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.365382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 287/563] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.365382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.365537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189ae9-4302-42f9-8003-5df743812abd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.365537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189ae9-4302-42f9-8003-5df743812abd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.365537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189ae9-4302-42f9-8003-5df743812abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.382866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-40189ae9-4302-42f9-8003-5df743812abd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:18.384064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-40189ae9-4302-42f9-8003-5df743812abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:18.388658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.395522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.459946 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 277/564] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:18.460863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189ae9-4302-42f9-8003-5df743812abd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.474488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580a04-68c0-477b-906e-efbf0cb5d77c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.510929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.511736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.512019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.512296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.524350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:18.532142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.533092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:18.533893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 288/565] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.534592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.577990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189ae9-4302-42f9-8003-5df743812abd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.610928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.611725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.612019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.612392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.618253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.619626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.621397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:18.635417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.636520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 278/566] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.637719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.641432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8bc21-9b0d-4c54-875e-59ffe39dec42 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.641943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.674503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.675364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.675643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.675919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.686405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.687883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:18.704868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.705876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 289/567] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.711587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.738299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592460ef-d11c-45c4-a731-f66d2c6523ad None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.774759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.775619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.775912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.776194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.786744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-efed89fd-0fc1-4f01-919f-86184fb7185f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:18.794524 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.795596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:18.796499 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 279/568] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.797183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385e77-fd04-4042-b6f6-edf481d1f827 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.797366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385e77-fd04-4042-b6f6-edf481d1f827 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.797633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385e77-fd04-4042-b6f6-edf481d1f827 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.799019 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 280/569] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:18.799638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e385e77-fd04-4042-b6f6-edf481d1f827 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.814298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c974-a1a4-4633-a6de-50ffa842a0aa None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.843690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.849661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.850337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.850626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.850906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.851655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.851963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.853376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.861314 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 290/570] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.862095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.871920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.910603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e385e77-fd04-4042-b6f6-edf481d1f827 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.944561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.945220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.945506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.945808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.946590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.946903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.948343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.960135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0015ebe-f326-42d9-bd63-cf81a2b1f627 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.960579 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 281/571] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.961369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.995102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.995802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.996084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.996358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.997117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.997425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.998813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93312221-58a5-4167-b29b-0ad68e2da4fd None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.010464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 291/572] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.011642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.011925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.012197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.028036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:19.029311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:19.067975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51f2b-b865-4ae9-8cb7-eb0401c7a7e9 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.079398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.091860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.096697 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 292/573] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:19.097461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.102976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.103643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.103924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.104192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.104958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.105263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.106623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.119519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 282/574] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.119519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.196623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a97e-267c-4848-a35f-d8902573852c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.224619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3ded-1438-44c4-9fea-f4cdd682bdb9 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.230609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.231448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.231730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.232009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.242270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.243786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.258165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.258823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.259108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.259386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.260211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=c226aaf467e44e59b368c6b5c9db1cf8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.260556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:19.261050 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.262108 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.263189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:19.263189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:19.263189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.263189 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:19.263481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.263561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 293/575] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:19.263561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.271016 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 283/576] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/role_assignments?user.id=c226aaf467e44e59b368c6b5c9db1cf8&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.272111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.302372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.339168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.379362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a9ee9-8b9d-4984-8321-6403288f764c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.396157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94e64-1680-4d7b-a424-beecf2761706 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.416302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.417154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.417435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.417742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.425580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.427085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.434347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.435165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.435447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.435724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:19.441819 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.442743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:19.443615 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:19.448095 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 294/577] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:19.449072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.450574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.452062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:19.471031 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.472022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.473269 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:19.473269 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:19.473269 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.473269 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:19.473269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 284/578] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:19.473567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.548288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.556545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eaab9-35cf-4d35-aabf-0e292622e54f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.583936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013901-d889-4742-b55a-fb6124a9258c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.585638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.592497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.593542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.594004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.594473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.608191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:19.616453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.617373 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:19.618180 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:19.622430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 295/579] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:19.623259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.624048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.624765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.625051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.625330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.626123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.626444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.627937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.644842 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 285/580] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.644842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.735534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480cb4-9f79-4f01-971a-ad87b9f77d21 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.749247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5ed8d-675c-42e4-bd53-91e7941a348d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.769897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.770908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.770908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.771102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.771933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.772249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.773737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.785202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.790366 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 296/581] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.790499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.790499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.790499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.790682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.790769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.790769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.790769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.808629 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 286/582] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.808629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.813572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.838095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.893878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536d6b-1a41-4a4d-8d10-12a151516b2f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.918356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0cd03-2c89-4ec4-a128-11df129c6d37 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.927681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.928362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.929016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.929298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.930364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.930673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.932208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.946161 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 297/583] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.946161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.959659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.960784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.961064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.961357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.969368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.970864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:19.986883 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.987954 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 287/584] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:19.989568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.027788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.050099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280f551-c3d1-4159-ae77-de54042244a3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.074278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.084564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.085467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.085746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.086021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.093759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352f98-3715-4820-9112-3db4ac32800d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.101083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=bce2e604e9444a99b194c1a5a9f96683, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.102542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.115073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 298/585] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:19 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:20.116223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.137591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.139169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.139687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.140133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.149556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.151524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:20.169343 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:20.170310 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:20.171239 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:20.174137 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 288/586] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:20.175293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.273228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a8850-ec36-4c6a-bc86-93e835f553af None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.302408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05bc8-4a02-47ee-b29f-37415de05fa8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.313544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.325981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.326875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.327275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.327625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.340869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.342374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.347888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.349003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.349270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.349544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.350394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:20.350732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.352200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:20.363241 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:20.364140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:20.365042 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:20.365042 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:20.365042 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:20.365042 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:20.365042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 299/587] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:20.366032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.380450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.381255 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 289/588] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:20.382123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.495788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf489-17a3-413a-84a7-40ec2e39ea3e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.506785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf76c-4c60-44f2-a9e1-6bc0f43eaf1d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.538999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.539965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.540641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.540924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.542029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:20.542344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.543804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.545414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.546157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.546603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.546945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.547756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:20.548123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.549584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.562584 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 290/589] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:20.563522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.570094 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 300/590] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:20.570939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.629265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.633515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.685351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa7d85-67b7-40ac-819d-2a559de1c9d3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.708803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd61c9-e697-48a8-9913-72a0acda02c8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.725051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.726759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.727188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.727604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.743707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.745662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.747579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.748463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.749029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.749320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.758188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.759892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:20.771112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:20.772063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:20.773493 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:20.773493 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:20.773493 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:20.773493 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:20.776070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:20.777018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:20.777921 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:20.779544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 291/592] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:20.780593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.782297 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 301/592] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:20.784179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.902753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.906823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c729c-2dca-4bfd-b8e9-0ac103a1f7a3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.924885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb875b-f384-4881-a74d-bc3f3162a1f4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.938811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:20.950933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.952664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.953153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.953861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.955598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:20.956188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.957908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.964844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.965658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.965953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.966221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.978427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.979672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.983347 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 302/593] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:20.984417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:21.002994 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:21.003889 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:21.004816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:21.004816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:21.004816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:21.004816 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:21.015716 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 292/594] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:21.018016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.114724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467efe-b1fd-4a5a-9f6d-945e4f333772 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.141593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644bd21-b372-4f83-bb46-788e048d2561 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.152544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.153194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.153549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.153931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.154733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:21.155110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.156611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.168901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 303/595] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:21.169949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.187954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.189247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.189679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.191149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.191633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.208736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.210148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:21.229729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:21.230990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:21.231864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:21.231864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:21.231864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:21.231864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:21.236168 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 293/596] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:21.237479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.261368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.297029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3807e-fa40-462c-8673-e09134726205 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.346887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.348514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.348982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.349685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.351558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:21.352093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.353654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22ac0-55ea-40fe-8cab-a1ddb48fd759 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.353961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.372203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 304/597] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:21.373387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.403660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.405063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.405525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.406352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.416174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.417922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:21.438148 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:21.439076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.440027 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:21.442185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 294/598] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:21.443157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.465402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.495605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a08e4-fed7-498a-9285-be413242d8b2 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.529664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.539146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.540436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.540924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.541414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.542346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:21.543278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.545164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.555571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88ff79-b2c8-4160-b4d7-57b6a5298f06 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.560884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 305/599] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:21.561898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.598792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.599589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.599888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.600142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.607090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.608570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:21.623215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:21.624104 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 295/600] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:21.625869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.670094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c3f41-facc-4bf0-8daf-efed571eac28 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.703108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.703769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.704054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.704325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.705152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:21.705446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.706902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648b92-83ca-4a24-92c6-5bf568ea73b7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.709324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.724280 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 306/601] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:21.725892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d808-354f-4077-b14b-c6d10d895edf None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.726186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d808-354f-4077-b14b-c6d10d895edf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.726461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d808-354f-4077-b14b-c6d10d895edf None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.727840 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 307/602] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:21.729755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d808-354f-4077-b14b-c6d10d895edf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.731946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52acbe4-026d-440f-8e4a-57d7fc425e69 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.767173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.767970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.768253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.768608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.771596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.776178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.778029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:21.793508 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:21.794386 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:21.795253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 296/603] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:21.795728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.850596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d808-354f-4077-b14b-c6d10d895edf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.883887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.884593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.884882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.885157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.885944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:21.886253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.887703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f525-3379-426d-b0e6-2bc1f7a8f8b0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.899046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 308/604] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:21.900240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.900558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.900849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.917373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a63c8-7085-4cd8-9a44-f332e14efeb8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.918110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:21.919304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:21.954272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.955169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.955456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.955734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/083565d7e7e3423486d9bfd51efaf318/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.970599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.971824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=083565d7e7e3423486d9bfd51efaf318, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.974084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.988090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 309/605] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:21.989327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.989698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 297/606] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:21 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/083565d7e7e3423486d9bfd51efaf318/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:21.990484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.076778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.108916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0cca8-fd3f-4851-b138-ce5d4c52db70 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.148274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.150067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.150560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.151033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.151390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b067b-18ce-4a41-b522-57f428101d9b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.152715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:22.153253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:22.154961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:22.169754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 310/607] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:22.175203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.201235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.202146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.202478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.202761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8cddedee376f4cf4a01caffdea20716d/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.218292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=8cddedee376f4cf4a01caffdea20716d, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:22.219742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:22.231979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.236340 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 298/608] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:21 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8cddedee376f4cf4a01caffdea20716d/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:22.237224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.323517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0733ef-49dd-4df1-9a56-43452ad1d18a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.374039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.374794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.375081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.375361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.395172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.400784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:22.408962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e42834-4ac0-4043-bd64-ee5157fa8e00 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:22.415312 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:22.417212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:22.418258 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:22.420634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 311/609] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:22.425859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.491607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b788f-dd28-4701-af86-743cde05173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.492619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b788f-dd28-4701-af86-743cde05173c None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.492905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b788f-dd28-4701-af86-743cde05173c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.493182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b788f-dd28-4701-af86-743cde05173c None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/f07213aded8c456785f17c358a348083/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.524602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b788f-dd28-4701-af86-743cde05173c None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=f07213aded8c456785f17c358a348083, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:22.526072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b788f-dd28-4701-af86-743cde05173c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:22.544648 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 299/610] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:22 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/f07213aded8c456785f17c358a348083/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:22.553161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc24c-8cb7-4f97-ab85-ef41cd72cfd3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.561396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.574137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583ea5d-7225-4de5-bbd6-419d14efc57f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.574472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583ea5d-7225-4de5-bbd6-419d14efc57f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.574698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583ea5d-7225-4de5-bbd6-419d14efc57f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.576265 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 300/611] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:22.586121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.586440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.586672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.597607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.598630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.598914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.599186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.600021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:22.600366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:22.601859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:22.610650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:22.611756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 312/612] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:22.612280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:22.618636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.726956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 301/613] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:22.768645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.768973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8391af-22ab-457c-82de-edf07d5dad3d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:22.826541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:22.827383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:22.828033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:22.828324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:22.844135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:22.846537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:22.869617 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:22.870563 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:22.871422 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:22.871422 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:22.871422 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:22.871422 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:22.871422 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 313/614] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:22.878742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:22.904933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.907642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:22.938879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feef52-74bb-415c-ad20-fbd085a569fb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.006562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.007773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.008244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.008739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.021183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:23.029752 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:23.030642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:23.031459 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:23.034698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 302/615] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:23.039886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.055598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f253-4d54-4400-8b29-a8dc52de44a2 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.120569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.121613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.122088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.122556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.123459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.123976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.125687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.138713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 314/616] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.144364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.221841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7390f-85d1-4e13-af08-ef882a6a80a7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.285672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.289493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.290232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.290512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.290782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.292871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.293446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.294848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.297376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.311047 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 303/617] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.319348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.330394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85151-3016-4259-ac28-31d42ab38fd9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.394232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.395051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.395335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.395610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.407134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.408645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:23.431939 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:23.432950 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:23.433872 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:23.437248 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 315/618] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:23.439185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.521211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7e98-5d3c-4a48-b743-43f4ee11c005 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.575090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e818f-b6c8-471f-b778-6503f15c35e1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.591965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.592804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.593090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.593366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.612171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.616370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.643816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.644518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.644866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.645146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.645981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.646289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.647729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:23.651764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:23.652658 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:23.653522 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:23.653522 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:23.653522 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:23.653522 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:23.653522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 304/619] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:23.658944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.672238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.682884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 316/620] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.687983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.754952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.856568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ab9-e32c-4ec7-bc1e-70b4ed69e176 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.869850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7dd4d-1e99-469c-a3ee-9d7347b18704 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.923519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.924733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.925207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.925704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.926625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.927127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.928724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.934919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.936058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.940482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.941012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.953187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.955368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.955521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 305/621] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.961022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:23.989170 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:23.990115 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:23.990975 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:23.990975 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:23.990975 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:23.990975 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:24.001389 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 317/622] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:24.007146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.067374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd851e5-dd32-423c-9532-3556cbbd8595 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.083632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.094252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.140737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.142755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.143799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.144221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.146950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2fa50-6a77-4e33-b647-361be023c7a8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.155882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.163127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:24.187016 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:24.188012 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:24.189000 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:24.201933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 306/623] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:24.213493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.217335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.218291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.219414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.219902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.221811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.227599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.229310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.249038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 318/624] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:24.257394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.375199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51f79-85c9-4e95-bb7d-3871a7aea64d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.387815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.424392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.425625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.426119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.426611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.443487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.445326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:24.466688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:24.467644 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:24.468553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:24.471074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 319/625] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:24.477034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.510680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6549-8f44-43c1-8bf6-2818e9bab3e4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.592184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.593309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.593810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.595837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.596996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.599213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.600919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.641015 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 307/626] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:24.646272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.693464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6734d-2c6f-4566-9173-bd624f9207bf None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.708798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.746878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.747937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.748462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.748935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.749938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.750571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.752254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc47224-2314-4dd4-a6aa-6f442b9b7dc6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.780898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 320/627] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:24.782973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052627b3-7c49-4302-9027-c4f325a849e1 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.783467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052627b3-7c49-4302-9027-c4f325a849e1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.784040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052627b3-7c49-4302-9027-c4f325a849e1 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.786189 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 321/628] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:24.787153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052627b3-7c49-4302-9027-c4f325a849e1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.827126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c2e18-4201-40e6-b5ee-a75d75da4710 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.832234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.862596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.863370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.863722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.864071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.924754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052627b3-7c49-4302-9027-c4f325a849e1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.947643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.950216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c28eb-fa25-480e-912e-674a7aefacb9 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.960626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.961614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.961964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.962310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/c226aaf467e44e59b368c6b5c9db1cf8/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.979554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=c226aaf467e44e59b368c6b5c9db1cf8, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.981484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f370d44-6449-4014-b142-230ced6036bc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.990642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.998137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 322/629] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:24 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/c226aaf467e44e59b368c6b5c9db1cf8/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:24.999818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0ed-1721-4b3a-bf2c-98be916d85f1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.000179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0ed-1721-4b3a-bf2c-98be916d85f1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.000554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0ed-1721-4b3a-bf2c-98be916d85f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.026399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5b5ff0ed-1721-4b3a-bf2c-98be916d85f1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:25.028040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5b5ff0ed-1721-4b3a-bf2c-98be916d85f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:25.073684 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 308/630] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:36:25.076490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97c14-7edb-492f-9feb-ed6d2d83fbb3 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.077193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97c14-7edb-492f-9feb-ed6d2d83fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.077954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97c14-7edb-492f-9feb-ed6d2d83fbb3 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.080025 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 309/631] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:25.081337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97c14-7edb-492f-9feb-ed6d2d83fbb3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.126428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 323/632] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:25.128059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.128417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.128787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.168694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:25.170307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:25.174707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.240816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97c14-7edb-492f-9feb-ed6d2d83fbb3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.255385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 324/633] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:25.257927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.269400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.279438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.280526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.280809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.281212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.295598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:25.297279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3dc461fe-9fe6-417d-b275-a555e71c5d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:25.316497 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:25.317477 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:25.318367 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:25.318367 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:25.318367 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:25.318367 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:25.318367 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 310/634] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:25.319253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ced47-8a87-42b4-aa1e-f69a587e918b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.319253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ced47-8a87-42b4-aa1e-f69a587e918b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.319498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ced47-8a87-42b4-aa1e-f69a587e918b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.321010 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 311/635] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:25.321936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ced47-8a87-42b4-aa1e-f69a587e918b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.373601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c00ed-aac9-4a1c-b73e-10d8e994514f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.407530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.408989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.408989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.408989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.418359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.421527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3d00285b-f340-472c-aa0c-cc1c1060d9a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:25.430967 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:25.431931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:25.432791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 325/636] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:25.433479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.434034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.434034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.448375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ced47-8a87-42b4-aa1e-f69a587e918b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.450575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:25.451772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:25.485281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.486577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.487086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.487553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.498939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:25.506987 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:25.507915 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.508813 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:25.511122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 312/637] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:25.512472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.528239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 326/638] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:25.529299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.561882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.624941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d5da3-b2ee-4ff6-a8e9-dc347f1c88fb None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.639238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649027a4-7e02-42ee-a858-b0690a191010 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.659020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.659721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.660005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.660283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.661039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:25.661346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:25.662731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:25.668258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.674589 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 313/639] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:25.675371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.676128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.677263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.677263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.677526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.678228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:25.678540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:25.680202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:25.692782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 327/640] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:25.692782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.788027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.791862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc954a0-a162-4e45-9761-803d92da4d59 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.793813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31c4c0-d1d2-4231-bad3-5bb038d4679b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.829763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.830442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.830748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.831048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.831789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:25.832094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:25.833165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.833601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:25.833971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.834254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.834527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.842022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 314/641] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:25.845273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:25.847038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:25.853841 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:25.854778 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:25.856056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 328/642] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:25.857141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.912678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:25.960828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349320-36e9-4cb1-8e67-343c510f5227 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.961733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bbeb6-b880-4e61-9e03-339aa82399df None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.997069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.997870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.998169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.998434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.999233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.000022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.000308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.000609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.007405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.008896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.009444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.010855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:26.023666 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.024825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:26.025702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:26.028296 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.029142 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.030750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:26.030750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:26.030750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.030750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:26.031334 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 315/643] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.031334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.031722 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 329/644] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.033072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.054523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.134759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3dcdd-159b-49e6-9296-4db0a1a75e31 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.138953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7849c-494d-4901-9324-79ffb78007e8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.142050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.172942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.173739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.174021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.174291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.174918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.175597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.175885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.176341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.177125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.177442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.178906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.187014 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 330/645] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.187481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.187835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.189313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:26.212288 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.213263 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.214137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:26.214137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:26.214137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.214137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:26.214137 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 316/646] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.214407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.294764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.306921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d6e2-7285-46ec-a174-57b71ca08332 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.324994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838aef-c4b9-4383-9ccb-79515d2e27cf None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.346667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.347368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.347659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.348255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.349494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.349810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.351274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.362897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.363575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.363675 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 331/647] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.364213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.364530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.365319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.365634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.365903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.367011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.379154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 317/648] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.379945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.400295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.477281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08258c4d-beee-4e3b-aca2-5416dcd50a8e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.484863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d93e6-c146-49ec-9e6b-f2a2c39d94f7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.513203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.513933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.514391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.514495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.518977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.519719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.520067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.520407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.521200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.521943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.523715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.525238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.525377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.526717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.537603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 318/649] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.538615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:26.550021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.550923 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.551820 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:26.551820 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:26.551820 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:26.551820 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:26.551820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 332/650] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.552723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.635959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.650341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd39ec-dac4-48b0-b7c5-5236d2038363 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.660023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196a02f-242c-4ed5-89cc-67f2b37a994a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.685916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.686576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.686865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.687337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.687962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.688277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.689763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.694990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.695913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 319/651] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.696490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.696666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.697264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.697740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.712919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.715839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:26.739248 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.740234 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:26.741209 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:26.744634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 333/652] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.746441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.765772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.825462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d3634-d87c-492c-9e28-ccc18efcbfe3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.862783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.863612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.863900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.864184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.874030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.875256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:26.890911 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.891981 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:26.892940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:26.896612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 320/653] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.897536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.899511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d9ee2-7fca-48e5-917c-c8508b2c3bca None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.936684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.937741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.938215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.938676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.939582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.940179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.942641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.949763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.960040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 334/654] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.960040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.031420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ec193-c668-4677-864c-7f0105350fe4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.051036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.071779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.072985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.073431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.073851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.074835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:27.075306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.077255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.086969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515cf-443c-48d1-9d2b-08579c74d5db None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.097381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 321/655] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:27.099051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.133608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.134735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.135111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.135488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.136767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:27.137799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.139738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.165554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 335/656] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:27.166659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.211336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052dfa-fac0-44be-9a71-fc2de03720ea None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.227830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.247257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.248067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.248351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.248657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.256390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.257872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:27.272688 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:27.273860 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 322/657] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:27.275052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.280950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dec24-0faf-49b4-8c19-6acdf105384e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.311001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.325229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.326201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.326665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.327116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.383717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5735-4b37-4bd5-8f0a-d26b8fc0de89 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.396833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.398312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.419212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.419802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.420075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.420355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.459877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.493877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.495383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3a97b-fb6a-4ab0-8c02-2d3035444b83 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.506955 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 336/658] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:27.508417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.536711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.607295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 323/659] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:27.608675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b283-5e4e-4088-b721-dfe1e8f33837 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.608964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b283-5e4e-4088-b721-dfe1e8f33837 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.609234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b283-5e4e-4088-b721-dfe1e8f33837 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.612618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 324/660] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:27.612618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22b283-5e4e-4088-b721-dfe1e8f33837 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.624976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ac97-3ec4-4320-bcfc-2ca3a0c3aa0f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.658518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.659207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.659488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.659750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.660608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:27.660917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.662356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.683334 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 337/661] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:27.683334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.700502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.726086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22b283-5e4e-4088-b721-dfe1e8f33837 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.760693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.761489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.761773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.762078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.764778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.774710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.776216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.794097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f1e0-e7f0-4ec8-80c6-4c52662ca16e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-2fc539b4-8bb4-4da1-b0d7-8e56e8009846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:27.794232 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:27.795063 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:27.796723 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:27.796723 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:27.796723 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:27.796723 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:27.796723 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 325/662] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:27.797011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.797280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.797553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.814899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:27.818847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:27.842653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.843463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.843756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.844025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.855396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.856908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:27.876394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:27.877425 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:27.878400 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:27.878400 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:27.878400 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:27.878400 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:27.878400 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 338/663] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:27.878680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.894686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 326/664] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:27.901896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.946287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.982937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e2de-3cc4-4c5c-b97e-1cf2ac36035d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.011267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11d6dc-4711-4cdb-805a-d39f11de17e9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.020239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.020945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.021228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.021512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.030489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.047985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.048701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.048975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.049251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.050052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.050359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.051842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.063291 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 327/665] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.065412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.094967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.096508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.166206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.168762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8d4a5-4295-4c60-b243-53649214a74d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.203909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.204526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.204808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.205082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.210464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 339/666] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:28.210609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.210609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.210768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.210839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.229807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 328/667] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.231289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.271785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.307520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f288d-5a15-4db1-8cc6-dee1d42c6e17 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.340648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45ed56-52a8-4023-ad82-0e02a839fc80 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.347458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.348876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.349526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.349807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.360345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:28.368333 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:28.369419 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:28.370377 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:28.377085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 340/668] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:28.377505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.378283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.378397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.378575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.378850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.385844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.387303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:28.401467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:28.402543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:28.403599 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:28.407408 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 329/669] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:28.408235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.410116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.489598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fd74-ef44-4129-b58c-ea67749ac722 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.514855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.519283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675109ec-6291-4266-a0f7-0accdbbd6089 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.525126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.525936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.526214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.526483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.538047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.539513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.555234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.556027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.556304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.556619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:28.556936 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:28.557801 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:28.558660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:28.558660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:28.558660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:28.558660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:28.562935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 341/670] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:28.563610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.564229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.565975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:28.581919 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:28.582838 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:28.583804 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:28.587806 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 330/671] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:28.588514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.654953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.678528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5516f-03ec-484c-88fd-4b9a41760cf1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.694654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498eff0-d5cd-4028-85d5-d511a315377e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.713729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.714415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.714729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.715009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.715762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.716070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.717932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.730859 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 342/672] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.730859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.734113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.734780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.735062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.735335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.736124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.736436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.737952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.750580 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 331/673] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.751642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.773639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.840408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fe3f1-5faa-4ebb-82cc-619863a2537d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.865331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6655d-b301-4d72-988a-dae79538f23a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.874515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.875181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.875463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.875735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.876477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.876783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.878254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.892608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.902862 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 343/674] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.906135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.906831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.907114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.907669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.907922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:28.908493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:28.908872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.910386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.929318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 332/675] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:28.929318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.011308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.020567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59d5d4-3531-4e00-b670-fd075a2a25e5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.036014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b62e2-52c4-4883-8995-a394c444b7f7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.055824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.056657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.056940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.057216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.068334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.069835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.071171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.071824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.072104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.072381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.073237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=083565d7e7e3423486d9bfd51efaf318) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:29.073544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.074956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.088457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 333/676] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/role_assignments?user.id=083565d7e7e3423486d9bfd51efaf318&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:29.088457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:29.088728 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:29.089673 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 344/677] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.090743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.155093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.206918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59982-2c46-466d-8da6-c13ec52e226b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.210495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeef6e-ff5c-4c0e-87f8-b1df5beb5118 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.244138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.244991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.245277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.245552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.247649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.248395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.248777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.249129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.249983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8cddedee376f4cf4a01caffdea20716d) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:29.250302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.251797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.253492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.255010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.268921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 345/678] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/role_assignments?user.id=8cddedee376f4cf4a01caffdea20716d&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:29.268921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-714bdcc4-c54f-489a-b93d-a2eb177f1da6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:29.278234 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:29.279374 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:29.280381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 334/679] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.281024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3f3e-78cf-4f51-b944-d88406408029 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.281185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3f3e-78cf-4f51-b944-d88406408029 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.281465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3f3e-78cf-4f51-b944-d88406408029 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.287383 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 335/680] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:29.288922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.289215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.289496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.294757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.310263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:29.311513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:29.399270 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 336/681] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:29.400149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.435925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18893-16f4-4f9f-bb52-f4af253b59f1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.463565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.488750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.488972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.489299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.489641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.490453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:29.490816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.492298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.506169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 346/682] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:29.507463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.555170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ee93e-735e-463d-858a-1c2928ea4fc4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.593299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.599814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.600545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.600829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.601105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.601898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:29.602205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.603649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.623610 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 337/683] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:29.623610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.644717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378ec1-82a0-4881-8a95-8b5b73923406 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.697360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.698713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.699710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.700310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.715573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:29.728910 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:29.729895 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:29.730742 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:29.731363 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 347/684] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.732227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.754427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8f0c-4adb-48ee-8916-d7912e869130 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.775261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.798806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.799667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.799951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.800224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.815159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.822329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:29.839843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:29.841043 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:29.842077 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:29.844669 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 338/685] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.845548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.861324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609a22-9cb4-4432-89d5-ce9dd4baac96 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.898531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.899447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.899875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.900293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.901293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=f07213aded8c456785f17c358a348083) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:29.901777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.903371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.907909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.912403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 348/686] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/role_assignments?user.id=f07213aded8c456785f17c358a348083&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:29.913526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.965258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac88d-c449-436a-9b2b-52dbd4bec498 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.006776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.007853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.008139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.008413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.009202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.009509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.011492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.022857 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 339/687] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:30.036406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.038470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.039857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5b4d2-5a5b-4ca4-9ff4-c1f3deca39ec None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.079639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.080732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.081165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.081585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.082585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.083029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.084683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.106028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 349/688] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:30.121834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.195220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707bd9-cb73-4fad-95da-0befd8f9060c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.214502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.237010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.237940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.238299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.238650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.250362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.252018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:30.272772 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:30.273902 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:30.274960 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:30.274960 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:30.274960 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:30.274960 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:30.275201 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 340/689] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:30.280993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.321504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536ad8-e515-4dd8-a9d7-d160aa778bad None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.360923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.361609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.362040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.362431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.398627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.404662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ed66-e665-4c38-99e6-e46d9a052bba None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.443570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.444391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.444796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.445171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.446002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.446429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.447980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.460691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.462387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.463135 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 341/690] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:30.473816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.550785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.581502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 350/691] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:30.587522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.655143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.704559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666f723-0d5b-4f73-a197-0dd5ecf295b4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.744183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.744754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3e508-c5aa-4fe2-974c-f342fafe8f04 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.745950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.746621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.747094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.760187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.761978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:30.785394 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:30.786322 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:30.787268 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:30.787268 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:30.787268 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:30.787268 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:30.789652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 351/692] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:30.795821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.853321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.854197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.855350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.855638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] PATH_INFO: `/v3/users/nova` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.881515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.882863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.916373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874303-24cc-4f4c-b3ea-01abbe5c8126 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:30.916583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:30.917462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:30.918377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:30.924950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 342/693] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:30.930270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.952804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.959053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.960038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.960564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.961040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.962234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.962737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.964607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.979554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 352/694] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:30.985261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:31.094926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713c69c-8aee-4c9b-9f86-60d78688315a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.130440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.131618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.132100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.132601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.139802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.141802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.144804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:31.158660 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:31.159606 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:31.160522 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:31.163054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 353/695] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:31.168851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:31.178087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e3099-f0e0-4d17-bc4d-360b26c38eff None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.232786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:31.254671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.255491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.255907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.256186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.257126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:31.257435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.258871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.293369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 343/696] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:31.295694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:31.349656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a3b8-b7b2-457c-b034-cb8a98e0ad59 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.416848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.417548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.417830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.418105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.418969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:31.419222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.420778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.448653 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 354/697] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:31.458608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:31.495457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8d7a-ed56-4a32-a83f-fa59783ea7e0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.564684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.565416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.565700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.565973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.595177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:31.658794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadff6f-a841-46a4-b531-027e3738a90c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.682562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.683957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.688782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:31.696822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.697496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.697784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.698063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.699016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=c226aaf467e44e59b368c6b5c9db1cf8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:31.699335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.700961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbca65-f709-454d-8bf3-15cefbbe39d7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.710671 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 355/698] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:31 2022] GET /identity/v3/role_assignments?user.id=c226aaf467e44e59b368c6b5c9db1cf8&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:31.717753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42904-f78f-48d9-8c00-d5ed0735a92b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.718045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42904-f78f-48d9-8c00-d5ed0735a92b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.718328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42904-f78f-48d9-8c00-d5ed0735a92b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.724224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 356/699] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:31.726438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.726730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.727010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.758994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:31.760343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:31.818073 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 344/700] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:31.825674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:31.889379 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 357/701] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:31.916805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:31.943014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.008366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40f4d-210e-42c3-844e-0e5e817ac23e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.057774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.069561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.070393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.070686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.070927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.079603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa82d-e11a-4b50-99b7-af2e070b15ee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.081773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.083240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:32.102419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:32.103360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:32.104250 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:32.104250 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:32.104250 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:32.104250 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:32.109654 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 345/702] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:32.110577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.119831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.121072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.121577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.122059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.123016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.124736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.146643 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:32.147685 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:32.148571 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:32.150660 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 358/703] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:32.160469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.219361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.228914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8be7-e3ea-4b82-a523-8da778f25911 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.268851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.269538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.269835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.270344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.271399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.272401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.273283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5871e05-e24d-40de-a487-2c381fe087f2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.277869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef599-911b-43ab-9f74-205a3f6a65ea None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.287012 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 346/704] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.288368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfe2d-f675-4d52-86a6-51a9214b517b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.288686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfe2d-f675-4d52-86a6-51a9214b517b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.288960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfe2d-f675-4d52-86a6-51a9214b517b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.294198 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 347/705] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:32.294198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dfe2d-f675-4d52-86a6-51a9214b517b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.326759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.328397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.328890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.329312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.330171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.331092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.333894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540ac9-0bd4-43a8-9690-3f316133cbce None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.339361 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 359/706] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.341438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.341882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.342308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.365484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:32.367609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:32.378767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.421040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dfe2d-f675-4d52-86a6-51a9214b517b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.463457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.464346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.464661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.464939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.476846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 360/707] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:32.478301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.478538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.480902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:32.508215 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:32.509191 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:32.510078 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:32.512605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 348/708] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:32.513656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.532736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.592703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa360-00a2-4a65-a489-260598ad6d2b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.624015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c1e3-a16b-4402-9310-82cb7c3779ae None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.628184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.628891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.629208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.629482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.630188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.630489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.631876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.637944 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 361/709] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.638982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.649754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.667049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.668297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.668805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.669280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.682234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.684208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:32.704551 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:32.705565 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:32.706449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:32.706449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:32.706449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:32.706449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:32.708886 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 349/710] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:32.717590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.754329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4fb57-c275-4380-bc77-b145b0e93726 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.792215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.793013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.793297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.793567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.794357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.794662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.796158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e88ca-5367-4445-84b4-24daec733016 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.801999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.810921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 362/711] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.812358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0b23-4413-4d3e-ac57-54065b6ed4f2 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.812671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0b23-4413-4d3e-ac57-54065b6ed4f2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.813011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0b23-4413-4d3e-ac57-54065b6ed4f2 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.814537 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 363/712] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:32.816950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a0b23-4413-4d3e-ac57-54065b6ed4f2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.846203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df892b-79ef-4929-bc91-522c5fa65219 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.886302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.887006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.887336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.887564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.888298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.888655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.890049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778d19-015d-4307-b57b-6334030ac87e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.896837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.904193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 350/713] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.905606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.905905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.906187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.926298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:32.927604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:32.939802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a0b23-4413-4d3e-ac57-54065b6ed4f2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.975535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.976290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.976687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.977038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.978044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:32.978486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.980130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.986483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 364/714] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.987520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.003158 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 351/715] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:33.026839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.144839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:33.187976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d7286-8a09-4962-b3ea-4a934a171925 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.240613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a8e8-2551-4cf1-83d2-185ff7893edf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.242341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:33.248813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.250647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.251121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.251603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.252589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.254926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.280005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 365/716] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:36:32 2022] POST /identity/v3/users => generated 254 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:33.321121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.321964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.322247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.322526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] PATH_INFO: `/v3/services/network` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.323193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.324647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:33.345217 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:33.346465 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:33.348071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 352/717] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:33 2022] GET /identity/v3/services/network => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:33.353249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.518602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646841-5376-43ac-a5af-d3fd565a6b32 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.556085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.557222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.557710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.558205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.559157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] RBAC: Adding query filter params (name=network) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:33.559669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.561452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f67031-aa1a-46b5-b2a1-cdaa12788fda None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.567076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 366/718] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:33.572267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.676717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88021da-3e82-4c21-bceb-c7f5507be50f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.701223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:33.714958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.715634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.715921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.716189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.720054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] RBAC: Adding query filter params (type=network) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:33.720054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.720054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8575-bfa8-43fc-96b6-6932c5737e06 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.727022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 353/719] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:34.614299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e055f-2ebd-4c68-a69a-37d5a4a0ee50 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:34.614834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e055f-2ebd-4c68-a69a-37d5a4a0ee50 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:34.614834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e055f-2ebd-4c68-a69a-37d5a4a0ee50 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:34.616226 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 367/720] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:34.621813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:34.622576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:34.623008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:34.645384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:34.646789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:34.733883 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 354/721] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:34.759343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e055f-2ebd-4c68-a69a-37d5a4a0ee50 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:34.813124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:34.905224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e055f-2ebd-4c68-a69a-37d5a4a0ee50 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:34.939374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:34.940234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:34.940550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:34.940831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:34.951270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:34.959067 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:34.960021 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:34.960931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:34.963408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 368/722] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:34.966605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.087194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f96211-b917-473d-a1f5-b6680e0acdad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:35.110331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:35.136990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:35.137678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.137960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.138236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.138984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:35.139289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:35.140700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:35.152194 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 355/723] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:35.157629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.299320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead34fe-3cce-42c4-b465-eb13f858842c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:35.313930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:35.348190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:35.349020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.349299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.349570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.365809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:35.367290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-6a6a22e8-97f6-4a44-a677-5b72910dd97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:35.389655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:35.390645 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:35.391611 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:35.391611 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:35.391611 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:35.391611 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:35.391611 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 369/724] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:35.396671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.473674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874bc-74d8-4a8d-8ecb-d0ef78bfd50b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.473956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874bc-74d8-4a8d-8ecb-d0ef78bfd50b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.474396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874bc-74d8-4a8d-8ecb-d0ef78bfd50b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.476235 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 370/725] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:35.483794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.484278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.484729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.511056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:35.515312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:35.551661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ecbd1-3a8a-4fe7-ae01-aa0cf1495abe None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:35.615734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:35.616711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.617129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.617563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.618423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:35.619055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:35.622100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:35.646277 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 356/726] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:35.649435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.661103 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 371/727] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:35.695019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.712793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:35.786524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13361c-56c1-4e9e-9e49-e875ef5ba47b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:35.804684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:35.815176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e2eb-972d-41c3-899b-2e545768b06d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:35.835028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:35.835842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.836132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.836413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] PATH_INFO: `/v3/users/swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.847324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:35.849499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:35.854573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:35.855458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.855951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.856359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.857254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:35.858760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110c63-dddc-42a6-aaa5-c904fd515f26 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f14218ff-8c0b-4e0e-bd32-a0ed0e1a571e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:35.866604 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:35.867706 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:35.868696 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:35.873988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 357/728] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:35.873988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afd370-9574-49bf-808b-403f65ffcbfe None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.873988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afd370-9574-49bf-808b-403f65ffcbfe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.873988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afd370-9574-49bf-808b-403f65ffcbfe None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.876498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 358/729] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:35.877623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afd370-9574-49bf-808b-403f65ffcbfe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:35.896452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 372/730] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:35 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:36:35.896452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.896452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.896452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.935162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:35.936387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:36.011388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.032554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afd370-9574-49bf-808b-403f65ffcbfe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.079042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.081028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.082283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.082952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.085377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:36.086181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.088787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.105573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 373/731] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:36.123444 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 359/732] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:36.125424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.147492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.258907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.281094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a763-d589-4419-b7df-0f5e0aa76141 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.293178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ebb3-3511-4519-8d89-d054cf3c0429 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.333402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.334556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.335042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.335548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.347158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.348150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.348486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.348751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.351403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:36.359449 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:36.360462 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:36.361316 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:36.364130 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 360/733] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:36.371134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.391310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.445832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.447602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9b13-dfef-41f1-a47e-ba1433f68609 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.494866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0ca12-30bc-44a7-97fe-fb5a97e6f769 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.530712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.531861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.532349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.532873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.533893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:36.534420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.536188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee6ad-92f7-4535-b49e-c2b0b32f96fe None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.545814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 361/734] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:36.547530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89671-9365-43a9-8710-a73c19ad999f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.547828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89671-9365-43a9-8710-a73c19ad999f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.548181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89671-9365-43a9-8710-a73c19ad999f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.553399 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 362/735] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:36.553399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89671-9365-43a9-8710-a73c19ad999f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.560722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.587323 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 374/736] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:36.587323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.587323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.587323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.603947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:36.605459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:36.663886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.696447 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 375/737] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:36.696447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.711245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89671-9365-43a9-8710-a73c19ad999f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.754729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.755546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.755830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.756104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.768044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.769715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:36.788639 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:36.789662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:36.790529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:36.790529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:36.790529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:36.790529 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:36.790529 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 363/738] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:36.791225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.829206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adb943-1d30-40fc-ba66-c80974f47b16 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.843665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.867825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.869888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.870845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.871762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.888062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.889639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.903595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc536-6cf6-42e7-8cd8-f725ea846f77 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:36.907199 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:36.908053 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:36.909027 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:36.909027 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:36.909027 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:36.909027 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:36.909027 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 376/739] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:36.909687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.934774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.944611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.945421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.945706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.945980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.956413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b0524238-843b-4bd2-9656-ebbfa603790d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:36.964096 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:36.965055 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:36.965872 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 364/740] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:36.966567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb051f-36bd-4be8-af0a-cb5075d6173d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.966959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb051f-36bd-4be8-af0a-cb5075d6173d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.967047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb051f-36bd-4be8-af0a-cb5075d6173d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.968460 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 365/741] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:36.973351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb051f-36bd-4be8-af0a-cb5075d6173d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.025816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b285-97a1-41c7-92ed-90e59a476f68 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.064866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.066026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.066586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.067009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.068171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.068656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.070598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.083748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb051f-36bd-4be8-af0a-cb5075d6173d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.086460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 377/742] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.087438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.115441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.122617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.123288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.123574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.123854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.124608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.124918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.126313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5211dc-a20c-4240-b9f4-0ff23b827fe8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.138375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 366/743] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.139422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.139709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.139987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.156987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:37.158180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:37.198852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.201233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e3dc-f284-4c30-bcf0-90ae522aceed None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.224152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 367/744] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:37.224943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.247568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.248504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.248931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.249210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.249957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.250270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.251657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.260061 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 378/745] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.260883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.338638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b3240-3b2b-44f4-aed7-424c6d4811f9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.348345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.364320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233613a-35a5-4222-9f19-b60021541919 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.377517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.378264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.378546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.378826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.386379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.387899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.399178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.400171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.400636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.401071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:37.402589 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:37.403674 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 368/746] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:37.404677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.414279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.416015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:37.432688 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:37.433913 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:37.435010 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:37.441838 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 379/747] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:37.442850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.446481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.514943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99deb32-9ffc-4c72-a147-940c5468eea6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.547969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.548674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.548874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04f4ca-4303-4454-94af-2376f7d69f7b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.549126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.549372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.550088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.551463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.567498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 369/748] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:37 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:37.568313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.600732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.601946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.602441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.602871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.615477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.617257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.619497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:37.642958 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:37.644070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:37.645210 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:37.645210 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:37.645210 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:37.645210 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:37.648201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 380/749] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:37.649527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.687480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.696333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c209ad6-9f4f-4cfb-8333-5ea2a2141035 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.738544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.739750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.740212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.740809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.741689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.742006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.743554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.769357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 370/750] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.770395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.795940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e524-176c-4201-86a9-1ac00ba05252 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.834304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.835330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.835330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.835526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.836286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.836643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.838284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.855181 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 381/751] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.855181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.902262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946244b8-469f-4d0a-b90e-1f76a9dda4dc None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:37.926867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.937932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:37.938612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:37.938893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:37.939166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:37.939943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:37.940247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:37.941895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:37.954022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 371/752] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:37.955442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:37.980810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:37.990943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc57e5-11ec-438a-aca5-de8bb27bb92b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.028269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.029495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.030124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.030596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.042434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.044194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:38.062216 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:38.063144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:38.064030 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:38.064030 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:38.064030 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:38.064030 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:38.070744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bfe3-2a88-4966-b8d4-69f88b256397 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.071055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 382/753] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:38.072162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.106182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.106850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.107134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.107413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.108242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=c226aaf467e44e59b368c6b5c9db1cf8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:38.108613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.110101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.120730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 372/754] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:37 2022] GET /identity/v3/role_assignments?user.id=c226aaf467e44e59b368c6b5c9db1cf8&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:38.121734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.184479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca8191-8fc4-4c66-9c19-9213c2e11d01 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.193456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.237339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.238574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.239058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.239525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.257707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.260143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.269576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:38.300361 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:38.301406 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:38.302317 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:38.306638 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 383/755] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:38.313709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.329291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325f4d-47a0-4bf8-8622-09633a2077d2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.422624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.423671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.424721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.425214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.426150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:38.426654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.428848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.446261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 373/756] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:38.451644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.458588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd79412-6d7e-4b33-b36e-0ecc77a14082 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.532304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.532684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.532908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.533251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.534090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:38.534401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.535847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.574745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd44d-489f-4e98-bdf5-5a6f02260301 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.576007 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 384/757] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:38.581729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.629009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.629940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.630223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.630493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.639581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.641604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.643388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.643993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-5fb08a2f-6e6f-4f5f-bc7e-8844a9875433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:38.662183 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:38.663111 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:38.663991 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 374/758] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:38.665707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334512c0-43b4-427c-9e1b-97b0dec8737d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.666055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334512c0-43b4-427c-9e1b-97b0dec8737d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.666396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334512c0-43b4-427c-9e1b-97b0dec8737d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.668492 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 375/759] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:38.669404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334512c0-43b4-427c-9e1b-97b0dec8737d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.718154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8af9-0e5d-497d-9b2f-c92d536430c9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.762906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.763697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.764454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.764454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.795481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334512c0-43b4-427c-9e1b-97b0dec8737d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:38.832197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:38.832926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.833206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.833479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.834262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:38.834566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.835997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee6f6-14a7-46c9-9512-6291667f43ec None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.842967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:38.844711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:38.849011 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 376/760] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:38.850466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:38.850757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:38.851034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:38.869510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:38.870813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:38.871615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.931365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:38.947017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 377/761] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:38.947952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:38.969136 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 385/762] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:36:38.975594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.054479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c1061-c8cc-4582-8a71-b2779e5f49c9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.091351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.092412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.092811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.093157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.093900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9cb21-67bc-4e05-9eff-e6e89df1b37f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.095292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=bce2e604e9444a99b194c1a5a9f96683, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.097365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.113029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 378/763] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:38 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:39.118627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.125392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.133121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.134201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.134548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.134891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.145998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.147616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:39.167382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:39.169240 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:39.170803 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:39.170803 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:39.170803 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:39.170803 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:39.170803 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 386/764] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:39.177452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.213252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.296244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d73f-588b-4d01-bb18-2318c99947ac None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.330708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ff417-1f44-49f2-a414-a81079bee6df None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.334749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.335659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.336049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.336333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.337044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.338530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:39.352166 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:39.353198 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:39.354306 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 379/765] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:39.360509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.413237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.413938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.414220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.414499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.415243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:39.415548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.417104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.440861 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 387/766] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:39.446848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.476302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68820c6-f245-4954-986f-4c0897ffa9fa None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.487864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.504827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.521118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.521842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.523487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.523780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.524827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:39.525933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.527337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.532902 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 380/767] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:39.541545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.566138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20323-ec50-4236-ae86-826ee977dd67 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.607766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.609903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.610326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.611706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.629005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.630837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:39.682255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:39.683387 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:39.684530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:39.690921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 388/768] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:39.697042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.768417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef0b1-4685-4d99-b1cc-f1bc617a4317 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.813257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.814689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.815128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.815547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.816743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:39.818520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.820086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.834223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 381/769] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:39.836805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.905376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.936797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.950615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b31b7-37c0-4fcf-b856-aded988769e3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.975047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3a532-b9b1-429d-82a7-5c6f5d154570 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:40.018475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.019449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.020939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.021388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.023370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] RBAC: Adding query filter params (interface=public, service_id=fc9a6f0a2d8342a789e6e53c496722a3, region_id=RegionOne) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:40.024213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.027640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.037316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.038215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.038642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.039918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.041699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:40.044121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.045822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.046235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 382/770] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/endpoints?service_id=fc9a6f0a2d8342a789e6e53c496722a3&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:40.049154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:40.074917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 389/771] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:40.080519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:40.204019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfb79-26fb-4a74-9051-0d6f9389f3cb None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:40.207550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:40.233908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96042f90-3b6b-4a96-a9c5-fe41a3e9d565 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:40.244744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.245712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.246241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.246710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.247546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.249206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ec997-92de-439c-a4d1-e757386120e5 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.255409 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 383/772] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:40 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:40.257102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622ba5a-2f1b-4189-b4fb-ac806502a60c None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.257540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622ba5a-2f1b-4189-b4fb-ac806502a60c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.258156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622ba5a-2f1b-4189-b4fb-ac806502a60c None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.264341 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 384/773] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:40.267156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.267780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.268248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.287702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:40.289490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:40.291322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.292016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.296469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.296469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.296469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8942fa716189487aa6c949730a9de90f) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:40.296469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.296469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.303590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 390/774] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:40 2022] GET /identity/v3/role_assignments?user.id=8942fa716189487aa6c949730a9de90f&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:40.425984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 385/775] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:40.472941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:40.502817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:40.588227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c957d9-456d-4e59-b0b9-c64343d02e21 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:40.629027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.629901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.630190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.630471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] PATH_INFO: `/v3/services/network` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.631147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.632678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:40.645682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:40.646739 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:40.647781 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 391/776] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:40 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:40.653060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:40.793887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:40.798770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fc1a-9f34-4b4e-a311-005949d9fbcc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:40.848986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:40.850485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.850968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.851442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.852346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] RBAC: Adding query filter params (name=network) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:40.852884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:40.854518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd4ac-3470-4a06-93dc-1d666f1ca1ce None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:40.863569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 386/777] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:40.868894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:40.976731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092963-5bdc-4560-8365-6df2489a41ce None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.977373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092963-5bdc-4560-8365-6df2489a41ce None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.977878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092963-5bdc-4560-8365-6df2489a41ce None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:40.979442 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 387/778] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:40.992833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:40.994241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:40.994533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:40.994811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.016135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:41.017372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:41.033124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00663f-04f8-4be6-940a-e792cdcc5bdc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.077297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.077894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.078178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.078452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.079165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:41.079472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:41.080959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:41.092712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 392/779] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:41.099656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.134644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 388/780] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:41.165353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.274915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2dd1-464b-4418-9973-ad108e5828a7 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.316410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.317413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.317705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.317987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.318788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] RBAC: Adding query filter params (interface=public, service_id=e151c65745e945c6930578eb0026f05e, region_id=RegionOne) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:41.319105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:41.320527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:41.328894 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 393/781] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/endpoints?service_id=e151c65745e945c6930578eb0026f05e&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:41.334623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.362982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:41.441765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:41.445391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821cccc-0003-4339-9fd0-b96b2490bcd6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.482805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d75877-006d-45e6-8d66-0a946dabcd08 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.483962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.485012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.485450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.485821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.486705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:41.488186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:41.494712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 394/782] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:41.530589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.531419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.531705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.531987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.544726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:41.552746 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:41.553742 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:41.554567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 389/783] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:41.560221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.705690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:41.716226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2accc-7ae5-4297-a543-1d3c05086ed7 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.753742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.754427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.754763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.755049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.755804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:41.756113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:41.757558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d3175-4eb7-4632-9b66-aac45c589c97 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:41.766793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 395/784] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:41.772414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.891558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f7d7-4a15-4d2c-8cf0-27a4a26efd7d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:41.903500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd47f-a154-4124-890a-a3cf8002c82b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.903808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd47f-a154-4124-890a-a3cf8002c82b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.904068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd47f-a154-4124-890a-a3cf8002c82b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.905773 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 396/785] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:41.912448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.912751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.913017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.929844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:41.930743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:41.930873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:41.931052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:41.931299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:41.933313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:41.943115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:41.944626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:41.962482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:41.963375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:41.964255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:41.964255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:41.964255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:41.964255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:41.964255 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 390/786] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:41.971454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:41.975785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.009514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 397/787] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:42.035152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.112942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.154632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128315d6-1a0e-461b-982c-6d40373ed0ee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.179903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402571c5-9e59-42e9-b3b8-083d1aaf8252 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.223574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.224301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.224615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.224896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.234233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.234914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.235198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.235477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.236291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:42.236683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:42.238106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:42.249815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:42.259220 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:42.260165 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:42.261022 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:42.262126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 398/788] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:42.269015 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 391/789] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:42.269921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.285557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.400814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.443336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f949-1179-401a-9ace-56f3b56e828a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.471688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.479980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.480662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.480953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.481483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.482239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:42.482556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:42.484003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:42.494642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 399/790] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:42.500043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.514015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec3da-8606-463b-8cab-60dafbac864b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.583324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.584186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.584492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.584773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.601577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:42.603104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:42.636669 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:42.637676 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:42.638598 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:42.643160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 392/791] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:42.648808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.701082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa906f2-8d95-4ee4-a745-4e43dd5a70e4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.772091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.773967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.774264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.774550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.793327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:42.794832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:42.830212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:42.831087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:42.831993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:42.831993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:42.831993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:42.831993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:42.837080 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 400/792] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:42.841056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:42.857465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bb9f-e397-4f58-ab37-6b42de9acc6a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:42.900796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.926100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:42.926814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.927101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.927380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.928237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:42.928655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:42.930161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30523a-73de-4e0f-937e-092866fdba0b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:42.930390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:42.953752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 393/793] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:42.955507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607bad-bb24-4208-9159-8d6ccf433e01 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:42.955941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607bad-bb24-4208-9159-8d6ccf433e01 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:42.956339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607bad-bb24-4208-9159-8d6ccf433e01 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:42.958092 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 394/794] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:42.960310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607bad-bb24-4208-9159-8d6ccf433e01 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.008512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6eb9-e261-40bc-b548-8af8e8b96160 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.046213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.046823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.047072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.047351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.048073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:43.048382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.050037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095d693-ada2-42b2-8ad6-2368d01985aa None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.067040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 401/795] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:43.068844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.069208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.069493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.086938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607bad-bb24-4208-9159-8d6ccf433e01 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.087514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:43.088813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:43.125154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.126386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.127046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.127603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.140886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.142761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.164815 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 402/796] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:43.165726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:43.169118 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:43.169991 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:43.170872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:43.170872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:43.170872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:43.170872 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:43.173095 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 395/797] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:43.178265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.197292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.216475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.275412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039561bf-e7c3-4469-8a2e-59ec054fb483 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.285992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c7f1-5203-40f5-9a65-accc9c8be20d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.312815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.314012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.314671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.315187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.319381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.320038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.320323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.320632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.321348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:43.321657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.322846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.323028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75769-f5ae-4274-b038-31fd44a45983 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.324406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 396/798] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a452-baa1-41c7-b077-65e1831af66e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a452-baa1-41c7-b077-65e1831af66e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a452-baa1-41c7-b077-65e1831af66e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 397/799] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:43.340511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421a452-baa1-41c7-b077-65e1831af66e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:43.341031 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:43.341873 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:43.342769 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:43.348596 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 403/800] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:43.348596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.443808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.446458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.455444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126ac69-7571-4136-83ce-c05e6ce400f0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.456159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421a452-baa1-41c7-b077-65e1831af66e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.490009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.490816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.491090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.491360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.496412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.497478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.498051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.498649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.501368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:43.505557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.507021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:43.509114 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:43.510014 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:43.510841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 398/801] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:43.511561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-41cc1495-8b97-45c8-9284-20168ac72398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:43.526600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:43.527719 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:43.528825 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 404/802] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:43.533910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.534105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.534376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.551054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:43.552234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:43.617490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f922d5f-866b-4240-a753-b66d83e189e7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.625122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 405/803] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:43.633327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.661768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.662445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.662729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.663007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.663842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:43.664153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.665655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.683286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 399/804] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:43.684121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.700520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.729392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.749294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71e793-d757-4a3f-9f73-ce994c7bbc61 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.787152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.787828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.788113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.788390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.788941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508d939-b1f0-4a37-bdd0-bfa47722cc89 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.789168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:43.789477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.790865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.799362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 406/805] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:43.809800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.833022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.833695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.833996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.834248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.835144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:43.835453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.837028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.854843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 400/806] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:43.854843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.919801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff55f8-03fc-4e0a-885d-45ddb029b9ce None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.930852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:43.955178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:43.955990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:43.956273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:43.956579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:43.957226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:43.958629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:43.964521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5673-795c-4bb8-8c46-1bffb9527b74 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:43.970682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:43.971629 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:43.972794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 407/807] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:43.973626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:43.986775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.005068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.005724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.006003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.006440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.080295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.081807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.085522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08d37f-a884-4ce2-b57a-167c8fe9aab8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.123989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.125139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.125576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.125861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.137927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.139177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.153995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:44.156214 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:44.157420 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:44.158467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:44.158467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:44.158467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:44.158467 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:44.162390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 408/808] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:44.162958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.188314 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 401/809] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:36:44.188980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.239299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.282335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebac2-90ab-447e-910e-9111612d5920 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.294251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b139d-0de1-474d-9872-4fa84462c54d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.318325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.319237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.319524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.319804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/c226aaf467e44e59b368c6b5c9db1cf8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.321996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=c226aaf467e44e59b368c6b5c9db1cf8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.323475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.328238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.329049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.329317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.329622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.330412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:44.330722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.332095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.336565 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 402/810] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:44.337335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.337825 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 409/811] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:44 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/c226aaf467e44e59b368c6b5c9db1cf8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:44.338460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.382569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.467711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911c1f-0bdb-40a6-9487-4d89f98d53a8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.482348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53579e-2fb8-4967-83fa-526f2467974e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.505083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.508228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.509055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.509344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.509626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.510399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:44.510829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.512688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba73ad7-2e64-4667-91e5-287486530f53 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.527047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.527047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.527047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.527397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.531839 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 403/812] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:44.533357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888efe-976f-4201-89c9-17515481e22f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.533672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888efe-976f-4201-89c9-17515481e22f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.534019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888efe-976f-4201-89c9-17515481e22f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.535660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 404/813] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:44.536450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49888efe-976f-4201-89c9-17515481e22f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.540017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.541604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:44.559261 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:44.560444 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 410/814] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:44.561582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.643461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.652396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49888efe-976f-4201-89c9-17515481e22f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.667413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef45ee-0c4e-4f11-aff0-a66fd61e9466 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.688611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.689816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.690105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.690553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.691250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:44.691528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.692951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2890-d8e3-4ace-b2e2-f4898e9c67d0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.698422 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 405/815] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:44.699714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.700040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.700341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.709065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.709888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.710169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.710441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.718501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:44.718640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.719745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:44.720083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:44.737750 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:44.738772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:44.739744 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 411/816] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:44.740325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.772771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.801396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 406/817] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:44.802289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.865578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb4e12-29c6-4e85-bd96-def62d423a1b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.901327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.902104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.902448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.902790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.903576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:44.903941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.905512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.906409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:44.916561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d29bd-ea39-4195-8d09-cd2fbc42dd8a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:44.925570 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 412/818] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:44.925570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:44.951611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:44.952292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:44.952922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:44.952922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:44.953593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:44.955038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:44.978587 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 407/819] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:44.979731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.033185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.044290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cfc79-cca5-445b-b8b1-dadae333851e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.096384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.097268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.097983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.098961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.099946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.100337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.102501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.131575 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 413/820] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.131575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.138443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700b82-2979-4809-95df-ac518ea10a1c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.187833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.188845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.189254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.189609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] PATH_INFO: `/v3/services/network` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.190277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.191674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:45.204392 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:45.205582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:45.206433 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 408/821] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:44 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:45.207205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.225670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.268760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f8541-dd06-4113-8ab0-207f01ffd2fe None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.305515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.306320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.306601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.306883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.314296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.315840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:45.330260 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:45.331144 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:45.332015 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 414/822] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:45.336701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.340145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39066-a6ef-4211-9e89-372b3d0695aa None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.347235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.382645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.383710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.384163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.384614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.396984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.398805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:45.417855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:45.418964 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:45.419858 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:45.419858 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:45.419858 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:45.419858 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:45.426201 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 409/823] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:45.427471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.448858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76423ca-0092-4b06-8d8b-a3f0d7a7be1b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.485763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.486519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.486810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.487091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.487815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] RBAC: Adding query filter params (name=network) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.488125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.489722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.499772 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 415/824] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.499772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.521971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.543436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82479de-44fe-4b08-a286-7734128f6555 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.568737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.581988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.583047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.583503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.583959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.585048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.585544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.587285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.601346 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 410/825] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.602431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.606815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78aa25-e965-4af8-a3d4-5b772a0d2e6c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.641461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.642163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.642682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.643019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.643742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.644093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.645681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.663561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 416/826] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.664473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.715225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac746-320a-4df7-8e31-53f49f8734c4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.748633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.763229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.764748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.765313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.765794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.766936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] RBAC: Adding query filter params (type=network) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.767912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.770012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.773627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60dd98-c59a-4af3-aefc-b48163bba082 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.781630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 411/827] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.781630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.814388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:45.825501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.826171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.827151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.827151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.827677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:45.827996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.829539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:45.845005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 417/828] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:45.845876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:45.905963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976a4f6-6a0d-4541-9701-00a58fc40e0b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:45.957297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:45.958964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:45.959445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:45.959913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:45.979070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:45.981048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:46.002833 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:46.003795 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:46.004705 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:46.007976 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 412/829] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:46.017880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:46.055932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c365d0-828d-40ea-98c0-c78b808c0294 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:46.105910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:46.106659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:46.106870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:46.107150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:46.107902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:46.109605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:46.124660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:46.140457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 418/830] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:46.195641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635839cc-8ea6-4c51-a845-756285956a1c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:46.244323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:46.245092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:46.245378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:46.245654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:46.246473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:46.246784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:46.256136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab315f-7253-46f4-b643-1dc3285df005 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:46.271364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 413/831] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:46.277707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:46.337073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:46.394818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697adc2a-d0d7-4af6-afdb-ea9263d31dd5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:46.430456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:46.431405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:46.431694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:46.431969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8942fa716189487aa6c949730a9de90f/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:46.447329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=8942fa716189487aa6c949730a9de90f, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:46.448838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d96c9-ea8e-44e2-9c2c-1727231425fb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:46.475438 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 419/832] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:46 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8942fa716189487aa6c949730a9de90f/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:46.759972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e15-353c-4a5d-8317-ba8ccab7a667 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:46.760274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e15-353c-4a5d-8317-ba8ccab7a667 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:46.760775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e15-353c-4a5d-8317-ba8ccab7a667 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:46.762483 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 414/833] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:46.768035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:46.768328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:46.768639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:46.785644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:46.786828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:46.861136 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 420/834] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:46.885650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36e15-353c-4a5d-8317-ba8ccab7a667 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:46.993898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36e15-353c-4a5d-8317-ba8ccab7a667 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:46.996116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.031635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.032710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.033192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.033636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.044635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:47.052384 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:47.053502 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:47.054520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:47.056890 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 415/835] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:47.062754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.093558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.173537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938b6e-81e7-4cf5-9a42-f1d2aa16e0b8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.211713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.212751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.213207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.213639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.214558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:47.215020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.216615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.227447 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 421/836] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:47.232967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.345321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1e6f-f367-46ae-811f-cbd943174ef4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.380824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.381892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.382407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.382923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.394704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.396440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-981274da-ef3b-4054-95a2-5f7cb225f9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:47.414769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:47.416013 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:47.417216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:47.417216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:47.417216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:47.417216 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:47.419274 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 416/837] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:47.424945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.445326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b065-016a-4bd3-920a-2eda20c87364 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.445870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b065-016a-4bd3-920a-2eda20c87364 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.446299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b065-016a-4bd3-920a-2eda20c87364 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.448613 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 417/838] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:47.452730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.453068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.453393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.472640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:47.473831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:47.484261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.527283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.537427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cfc76-96e0-40a8-ba5b-54845490a8ca None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.576525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 418/839] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:47.578358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.579307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.579840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.580315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.581288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:47.581788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.583377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.596114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.596802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 422/840] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:47.602655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.712646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb5cf4-5904-4ba1-a8b9-2ba153974bbe None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.718887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53a71-1ade-4597-b0a7-dbefb8ab024a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.748893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.750106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.750495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.750782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.758858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.759636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.760386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.760529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.760750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.761031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.761677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.763194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:47.777595 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:47.778885 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:47.780048 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:47.780902 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:47.781770 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:47.783382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 423/841] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:47.788955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.789537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 419/842] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:47.790211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.808615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.813175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:47.912473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216eaac-426e-4bcd-9d9b-7de9757610c3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.913989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2decc99-d12c-4d5d-9f46-8aec46252188 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:47.953088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.953322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:47.953930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.954207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.954478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.954990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:47.955407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:47.955687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:47.955799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.956261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:47.957183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.957419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:47.957912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:47.959683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:47.964977 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 420/843] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:47.971157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:47.985315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 424/844] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:47.996441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.050312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.074023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.084572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed423-facf-42a0-89ff-14f548c4a6cf None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.118047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548659d-0322-4c92-b8ac-37c7d9307e9f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.130913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.132166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.133143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.133661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.134814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:48.135533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.137415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.142772 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 421/845] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:48.158520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.159249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.159534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.159806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.236614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.238227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.312813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.348411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 425/846] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:36:48.355264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.465128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59dee1-57e7-4eb5-8555-9b6dd2eb3364 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.500084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.500847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.501131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.501410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.505590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.516536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.518316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6f03acc1-a6d1-412a-b0e4-d2da5d9e9ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:48.537138 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:48.538278 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:48.539405 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:48.539405 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:48.539405 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:48.539405 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:48.541312 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 422/847] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:48.548748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.590809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5a9c-f9fe-43b7-bd67-3310611e9e5e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.591118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5a9c-f9fe-43b7-bd67-3310611e9e5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.591378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee5a9c-f9fe-43b7-bd67-3310611e9e5e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.594024 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 423/848] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:48.598538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.598841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.599115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.617014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:48.617849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:48.650783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9b574-8d8e-4651-937f-950e30520675 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.686429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.687375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.687818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.688242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.689279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:48.689741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.691273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.692525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 424/849] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:48.703741 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 426/850] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:48.710471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.710915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.754826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.836097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13867438-618b-4cfa-a23d-5690ca06750d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.837326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42da8d-e2a6-487f-8642-f2648b77cb71 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:48.853388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:48.874189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.875079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.875372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.875649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.875881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:48.876938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:48.877402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:48.877915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:48.878830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.880388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.883076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:48.885134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:48.893922 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:48.894896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:48.895716 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:48.898382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 427/851] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:48.899613 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:48.900496 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:48.901375 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:48.903872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:48.904502 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 425/852] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:48.906309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.008309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.015427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8de7-0722-481f-9714-3abf34134c99 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.030535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46e0d-a85d-4054-bc7c-f117b99b4c9a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.051332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.052164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.052476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.052769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.053473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.053787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.055176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b05f69-2ec2-49f3-8299-cef12673715b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.059657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 428/853] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:49.060877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f9a1-2b23-4112-b959-0a2190fc62a4 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.061162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f9a1-2b23-4112-b959-0a2190fc62a4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.061438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f9a1-2b23-4112-b959-0a2190fc62a4 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.066770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 429/854] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:49.067556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267f9a1-2b23-4112-b959-0a2190fc62a4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.070093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.071417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.071700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.071972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.072791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.073097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.074533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a92f9-7564-444f-bebd-51b7fb889b32 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.092456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 426/855] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:49.092456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.092456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.092456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.105828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:49.107010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:49.136597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.177775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 427/856] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:49.178903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.189221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267f9a1-2b23-4112-b959-0a2190fc62a4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.227359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.228030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.228310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.228610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.229314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.229616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.230992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.235573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 430/857] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:49.236352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.306849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.307827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565d4b-0268-4f4b-baa7-edb787570a72 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.348041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.349016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.349438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.349877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.350882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=c226aaf467e44e59b368c6b5c9db1cf8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.351338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.353053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.364891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 428/858] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/role_assignments?user.id=c226aaf467e44e59b368c6b5c9db1cf8&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:49.373990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53975979-7919-4e7d-bec1-84236cef01d0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.419114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.424481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.424481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.424481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.437797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:49.446087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:49.447276 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:49.448252 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 431/859] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:49.454425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.495847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.574292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c22bd-5063-48df-bd0b-4c7d3c60c6e7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.611732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.612699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.613121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.613530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.614429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.614871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.616373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.625703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 429/860] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:49.631327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.721183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.741252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336399-ead6-4ee7-8136-171734f87f22 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.776011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.776850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.777132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.777411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.790352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.791840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:49.816504 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:49.817634 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:49.818535 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:49.818535 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:49.818535 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:49.818535 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:49.818535 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 432/861] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:49.828263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:49.930664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.939525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa4c9-5395-4eec-afa9-125331df946c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:49.975422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:49.976673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:49.977163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:49.977628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:49.978533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:49.979042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:49.980716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:49.993870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 430/862] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:49.999039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.111350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c08b6-4a74-44bb-b6e6-bbe49ad5f30d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:50.145321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:50.146144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.146425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.146700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.148642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:50.154850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:50.156373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:50.171689 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:50.172684 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:50.173691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 433/863] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:36:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:50.180685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.292474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1808-989a-4689-bfac-64c9773d4569 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:50.327668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:50.328338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.328642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.328912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.329814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:50.330122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:50.331564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ad59-9270-45c0-83b2-f402463c0fce None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:50.349779 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 431/864] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:36:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:50.357506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.469312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcede0-0a76-4ec9-a4da-f743d471a052 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:50.474244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd955bc-9202-42b8-b47c-4a06f679d188 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.474533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd955bc-9202-42b8-b47c-4a06f679d188 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.474825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd955bc-9202-42b8-b47c-4a06f679d188 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.476363 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 432/865] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:50.481554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.482088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.482560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.500380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:50.502041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:50.510627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:50.512858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:50.514824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.515106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.515380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.579784 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 433/866] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:50.589413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:50.591986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:50.593725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:50.607538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.698327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 434/867] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:36:50.709634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.714690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99cf1-8bab-43d9-a66a-39c014a6c2c0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:50.750657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:50.751637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.752092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.752681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.753742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:50.755385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:50.776774 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 434/868] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:50 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:36:50.824875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2bef-1479-43be-a96b-bf58c69e139c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:50.840879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:50.870011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:50.870969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:50.871274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:50.871545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:50.883276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:50.884810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:50.904081 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:50.905060 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:50.905946 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:50.905946 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:50.905946 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:50.905946 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:50.905946 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 435/869] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:50.911425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:50.914428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:51.021887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428dc49-e33d-4612-b92b-1133b26fa4c0 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:51.056404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:51.057107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.057390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.057665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.058385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:51.058692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:51.060167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:51.072741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 435/870] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:51.078274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:51.179675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbe4ca-eb2a-4ef6-b4f6-968f060b1264 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:51.214900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:51.215785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.216064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.216378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.223760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:51.225243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:51.239192 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:51.240095 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:51.241013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 436/871] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:51.246833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:51.309734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:51.351060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c8430-e6ae-4e36-a232-4988d0dd2671 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:51.387591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:51.388261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.388603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.388875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.389659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:51.389966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:51.391394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed57bd5-dc0e-4d25-89b1-e6bee7dd0f04 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:51.407270 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 436/872] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:51.418039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:51.428009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:51.545954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382572f3-f801-477e-bcb2-46c9f054f2ba None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:51.581054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:51.581634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.581914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.582185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.583008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8942fa716189487aa6c949730a9de90f) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:51.583317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:51.584793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96a98-8851-46c6-b457-87d49592ade5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:51.591112 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 437/873] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:51 2022] GET /identity/v3/role_assignments?user.id=8942fa716189487aa6c949730a9de90f&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:51.754657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249c96-0827-448f-b05d-bd55a641e3b8 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.755012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249c96-0827-448f-b05d-bd55a641e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.755217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e249c96-0827-448f-b05d-bd55a641e3b8 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.757506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 437/874] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:51.767157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.767514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.768816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.769797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3734-bffc-411c-b8f5-e24c91e641a4 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.770084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3734-bffc-411c-b8f5-e24c91e641a4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.770495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3734-bffc-411c-b8f5-e24c91e641a4 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.772209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 438/875] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:51.780096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:51.780464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:51.780698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:51.791847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:51.793143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:51.802188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:51.803470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:51.888180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:51.893472 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 439/876] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:51.900152 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 438/877] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:51.918533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:51.924181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:51.983056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:52.033349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda40785-a065-4434-a370-bb44fe1e12a0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:52.045810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba56b25-868a-46c1-b7f5-936c97dfce96 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:52.080526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:52.081620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:52.081925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:52.082417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:52.083486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:52.085458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:52.091404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:52.092198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:52.092613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:52.092986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:52.093888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:52.095622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:52.101755 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:52.102888 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:52.103727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 439/878] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:52.112112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:52.119315 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 440/879] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:51 2022] POST /identity/v3/services => generated 269 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:52.180339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:52.227575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8bab6-6059-44d3-9d27-f8761685b3b3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:52.273738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:52.274422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:52.274738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:52.275031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:52.275745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:52.276063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:52.277540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d766-b36f-4674-9f3e-9f2e7f241c11 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:52.283603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 440/880] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:36:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:52.289588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:52.399660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c4020-91a5-4d16-ae12-b0fd079b8844 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:52.413941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:52.436606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:52.437204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:52.437491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:52.437768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:52.438475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:52.438896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:52.440235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00bf1-3085-4f6e-9b72-afa4ead8c887 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:52.445439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 441/881] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:36:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:53.218195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b566-427d-471b-80dd-bbe746f3a34b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.218707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b566-427d-471b-80dd-bbe746f3a34b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.218786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b566-427d-471b-80dd-bbe746f3a34b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.220504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 441/882] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:53.225964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.226255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.226530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.243502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:53.244714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:53.319599 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 442/883] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:53.343228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b566-427d-471b-80dd-bbe746f3a34b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:53.451244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b566-427d-471b-80dd-bbe746f3a34b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:53.474145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:53.490701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:53.491788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.492277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.492791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.493684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:53.495290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:53.507845 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:53.509163 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:53.510009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:53.512715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 442/884] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:53.520481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:53.620381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb5326-de6f-417c-ae97-81090d8d244d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:53.629647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:53.662574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:53.663333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.663655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.663960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.664793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:53.665156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:53.666720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:53.672558 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 443/885] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:53.681863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:53.793466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f5d9-8aaa-4ce3-80ca-d7a7ebcc59bd None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:53.829018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:53.829831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.830121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.830401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.831280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:53.831597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:53.833025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:53.838440 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 443/886] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:53.844066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:53.954070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ede8-2f3c-4ed9-b69e-36f20ae72e9e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:53.989176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:53.989844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:53.990131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:53.990412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:53.991204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] RBAC: Adding query filter params (interface=public, service_id=dd3f304bdcf84365ae44b327ae8e2ff4, region_id=RegionOne) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:53.991517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:53.992941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810a16a-0a57-4f82-984d-1a6dda8c6441 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:53.998586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 444/887] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:53 2022] GET /identity/v3/endpoints?service_id=dd3f304bdcf84365ae44b327ae8e2ff4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:54.005736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.062782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.100209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bfe78-16ae-4c53-bab0-f6d1cfa2ea02 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.100552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bfe78-16ae-4c53-bab0-f6d1cfa2ea02 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.100816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bfe78-16ae-4c53-bab0-f6d1cfa2ea02 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.102531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 445/888] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:54.107344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.107631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.107912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.119489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1cef7-399d-43af-b72a-d79e17804daf None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.125099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:54.126347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:54.154670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.157129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.158427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.159105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.159967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.161352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:54.163211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:54.169689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 444/889] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:54.205080 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 446/890] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:54.230113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.356253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f89ecc-80f6-42b7-8a5f-1d16bc91d709 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.370675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.394350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.395183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.395452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.395730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.406727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-276e56f9-9212-4baf-b020-878316755fbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:54.415204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:54.416116 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:54.416992 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 445/891] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:54.424167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.509033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787ee2d-e4c5-4aba-9aa5-62ccd46b1a2c None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.509971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787ee2d-e4c5-4aba-9aa5-62ccd46b1a2c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.510556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787ee2d-e4c5-4aba-9aa5-62ccd46b1a2c None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.513019 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 446/892] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:54.519062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.519590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.520064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.536690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa636b-dabc-4563-93ec-ecf403f5a09e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.537960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:54.539371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:54.575395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.576080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.576364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.576670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.577429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:54.577729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:54.579281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:54.594427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 447/893] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:54.596568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.624836 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 447/894] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:54.629682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.645928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.720842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb4888-1ec2-4e73-b055-7575a1419b97 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.762183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59b366-3a63-4b64-b517-8c39438b9959 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.763950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.765541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.766850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.767338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.767872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.781541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:54.783581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:54.802359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.805942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.805942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.805942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.805942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:54.805942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:54.809875 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:54.810785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:54.811686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:54.811686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:54.811686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:54.811686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:54.821122 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:54.822087 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:54.822945 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:36:54.825133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 448/896] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:54.826255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.828525 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 448/896] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:54.830075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:54.916103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:54.940854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff40b-2231-404e-9197-763ebf1f386e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.971125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f313b-2c8e-488b-b57c-345d9a1834b4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:54.981263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:54.982480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:54.983066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:54.983584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:54.984478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:54.984786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:54.986371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9545-6afe-4c11-b6ed-f6dea6638cdc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:54.999094 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 449/897] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:55.004929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ca87-a342-44a6-8bbc-9c3153e3ba1e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.005223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ca87-a342-44a6-8bbc-9c3153e3ba1e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.005503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ca87-a342-44a6-8bbc-9c3153e3ba1e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.006863 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 450/898] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:55.007554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ca87-a342-44a6-8bbc-9c3153e3ba1e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.015975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.017502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.017964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.018420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.019750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:55.020655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.022505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da6434-d595-4417-b2ed-6f02132c2c88 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.029119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 449/899] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:55.031140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.031853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.032309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.054858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:55.056642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:55.082810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.115355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ca87-a342-44a6-8bbc-9c3153e3ba1e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.129708 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 450/900] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:55.131581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.157931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.158817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.159105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.159382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.167021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.168415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.170251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:55.184137 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:55.185307 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:36:55.186257 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:55.190212 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 451/901] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:55.190929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.249036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9bf36-29b2-462e-adf6-6458ab7116e4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.281853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.282629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.282914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.283189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.283893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:55.284197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.285609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.290802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 451/902] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:55.291574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.306044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bbe48-2262-4ed3-a377-0fd030006412 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.322130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.345550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.346203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.346489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.346784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.347822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.349473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.363226 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 452/903] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:55 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:55.364063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.418835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fc5a-f836-40dc-a32b-deff8a31c24f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.458296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.479231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.480021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.480367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.480738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.481670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:55.482044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.483614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.508994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 452/904] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:55.511004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.511734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082df8-67d6-45f9-b96b-de7e3f51fe7f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.549344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.550018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.550296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.550569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.551368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] RBAC: Adding query filter params (interface=public, service_id=4b81083a918043acbd317719fe1dea59, region_id=RegionOne) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:55.551744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.553213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.559205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 453/905] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/endpoints?service_id=4b81083a918043acbd317719fe1dea59&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:55.564936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.599259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.625289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25b5b-7549-40b0-8c1e-4ef88099829b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.663746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.664769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.665243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.665694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.693879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb784-7043-4953-8ca0-77ac89ccb682 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:55.720160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.738811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:55.740365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:55.740864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:55.741558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:55.741997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.742687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:55.743488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.744476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:55.753406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 454/906] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:36:55.849204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:55.876035 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 453/907] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:36:55.881663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:55.993942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8656bc-244c-4f70-9288-54f3f9475fe8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.029088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:56.029889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.030170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.030434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.041783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:56.043230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:56.060582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:56.061491 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:56.062364 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:56.062364 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:56.062364 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:56.062364 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:56.062364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 455/908] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:56.068876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:56.176553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822ee94-c943-4681-a1d6-ecb2c165488a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.260527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:56.260527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.260527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.260527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.261318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:56.261318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:56.261318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:56.276447 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 454/909] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:56.284445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:56.350672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:56.421564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a887-d86a-47be-8b77-b5129b0a09ee None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.457096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:56.457906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.458272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.458557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.465839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:56.467310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a5651445-1696-425b-a4b0-6577800c5e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:56.481583 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:56.482469 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:56.483336 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 456/910] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:56.492245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:56.535390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:56.603447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852cf2-4d3d-4008-95c1-24f2bef748cc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.609490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf175dd-2f98-4f89-b676-abdea14441a7 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.609776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf175dd-2f98-4f89-b676-abdea14441a7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.610055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf175dd-2f98-4f89-b676-abdea14441a7 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.611695 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 457/911] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:56.616978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.617647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.618120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.637742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:56.639271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:56.645168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:56.645841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.646121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.646392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.647234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:56.647541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:56.649506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:56.672415 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 455/912] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:56.675521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:56.760387 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 458/913] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:56.780742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:56.821678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:56.895196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:56.903642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88970af-8b7b-4dbb-b22f-afe013077136 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.951648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e764d-3a57-4215-a5aa-23824846aa0b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:56.957763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:56.958435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:56.958721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:56.958992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:56.959824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] RBAC: Adding query filter params (role.id=3d1339cfb6334cad9e57c421c5d7f210, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8942fa716189487aa6c949730a9de90f) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:56.960137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:56.961650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:56.977255 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 456/914] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:56 2022] GET /identity/v3/role_assignments?user.id=8942fa716189487aa6c949730a9de90f&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=3d1339cfb6334cad9e57c421c5d7f210 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:57.028407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:57.029668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.030195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.030671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.031636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:57.033435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:57.050391 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:57.051432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:57.052275 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:57.056190 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 459/915] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:57.061737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:57.215183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b259d-055a-47be-9889-fd9b69d68bd4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:57.252549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:57.253225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.253511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.253785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.254483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:57.254934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:57.256322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:57.261755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 457/916] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:57.267533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:57.365263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:57.375049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7e4f8-9c50-40f1-8186-91e588e021d1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:57.410640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:57.411618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.412099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.412581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.413485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:57.413966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:57.415508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d994f-471e-4275-9815-d9784f7bf55f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:57.421353 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 460/917] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:57.427182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:57.456240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:57.534877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224ab6-5209-4eef-a109-7c9d9bbd4597 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:57.570736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:57.571714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.572173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.572673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.573585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:57.575136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05b556-f514-47bc-9d05-1dc9d9ff7807 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:57.597672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 458/918] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:57.861344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b465-07f6-4d9e-bdfe-f7b695f2b6db None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.861872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b465-07f6-4d9e-bdfe-f7b695f2b6db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.861872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b465-07f6-4d9e-bdfe-f7b695f2b6db None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.863525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 461/919] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:57.869119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:57.869417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:57.869709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:57.887872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:57.889123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:57.965011 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 459/920] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:57.989451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b465-07f6-4d9e-bdfe-f7b695f2b6db None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.099881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b465-07f6-4d9e-bdfe-f7b695f2b6db None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.134990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.135812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.136099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.136382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.137146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.138523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-770cebd9-62e3-4cdd-be5b-0e7f5d140843 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:58.151235 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:58.152236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.153369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 462/921] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:58.160629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.174078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.251021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcec2-11f1-4ee9-9576-2cbdf59b1e5c None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.251374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcec2-11f1-4ee9-9576-2cbdf59b1e5c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.251651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edcec2-11f1-4ee9-9576-2cbdf59b1e5c None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.253841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 463/922] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:58.258080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.258366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.258637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.275864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398434f8-e427-431b-90c0-b2b5d7c2dfaf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.278010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:58.279481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:58.299490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.316542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.317334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.317624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.318210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.319202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:58.319509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.321201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.327679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:58.333244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.369383 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 464/924] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:58.397624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.434750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.470234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5430da-aef2-4ee8-9eb9-973d4e18a5c0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.500588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6576-1f6e-4052-9993-c7b1b2ffa38e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.508061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.508865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.509240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.509602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.510398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:58.510814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.512542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.518225 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 461/925] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:58.525070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.548225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.549853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.550331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.551029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.552219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.554812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:58.571041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:58.571986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:58.572864 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:58.579210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 465/926] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:58.580254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.605737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.642630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ac5e-309d-4adb-9850-9b354ad0e5b9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.680384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.681143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.681429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.681707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.682494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] RBAC: Adding query filter params (interface=public, service_id=ec8af9c6a15f4a5a97f2b6f1ff3afdcb, region_id=RegionOne) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:58.682806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.684239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.686672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.697221 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 462/927] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/endpoints?service_id=ec8af9c6a15f4a5a97f2b6f1ff3afdcb&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:58.698145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.709190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff2c3-3d15-4a64-90b9-606861370c4f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.744164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.745245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.745742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.746206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.747100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:58.747594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.749189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.759581 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 466/928] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:58.760780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:58.821711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443067e-2bd5-4c02-91d6-af5528154d8d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.859886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:58.863082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.864030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.864556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.865029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.865919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.867577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.875685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 463/929] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:58.883926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fecc60-bc81-405d-a37c-5cf0fe407225 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:58.925321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:58.925924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:58.926211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:58.926490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:58.927221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:58.927588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:58.929061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1b5ec-72fc-4c00-8960-1c9e148fe02c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:58.935489 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 467/930] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:58.941326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:59.017438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:59.059729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807bbe-74c2-4571-9646-b6901c38aac1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:59.098574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:59.099267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.099551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.099828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.100645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:59.102088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b51fb-cd58-4b9f-9ea8-adece52128b9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:59.127142 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 464/931] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:59.339268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fec32-ee4b-48a0-880b-d66ca9679aa5 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.339595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fec32-ee4b-48a0-880b-d66ca9679aa5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.339831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fec32-ee4b-48a0-880b-d66ca9679aa5 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.341405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 468/932] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:59.347426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.347909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.348008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.365172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:59.366381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:59.442488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 465/933] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:59.467048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fec32-ee4b-48a0-880b-d66ca9679aa5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:59.574182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fec32-ee4b-48a0-880b-d66ca9679aa5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:59.608846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:59.609592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.609877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.610163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.621483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:59.629724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:59.630662 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:59.631764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 469/934] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:36:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:59.638952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:59.687800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:59.743678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d31c-364a-4bd1-85d9-16746da53bc3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:59.779209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:59.779893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.780180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.780482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.781235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:59.781545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:59.783784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:59.793513 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 466/935] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:36:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:59.799560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:59.804791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:59.904768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00500a0a-876a-479c-92af-802bf8bcabe5 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:59.939200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:59.940008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:59.940290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:59.940601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:59.950955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:59.952408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-8f291871-ece5-422f-b05c-a331efb82372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:59.974226 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:59.975236 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:59.976128 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:59.976128 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:59.976128 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:59.976128 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:36:59.980220 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 470/936] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:59.981625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.062308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427720a-0c21-4fde-aed2-9a95417b6646 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.062657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427720a-0c21-4fde-aed2-9a95417b6646 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.062854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427720a-0c21-4fde-aed2-9a95417b6646 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.064493 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 471/937] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:37:00.069599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.070106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.070598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.096450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:00.096637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330163-1797-4995-9a02-48977d5e6385 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.096719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:00.104754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.132065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.132793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.133075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.133348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.134080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:00.134387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.135835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.147479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.153417 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 467/938] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:00.159316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.172885 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 472/939] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:00.196832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.286211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fac8f-a80e-491a-90d8-54aa58e79ce6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.308789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181005-8be9-4f97-bce4-c5d7972fd0c5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.334603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.336051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.336997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.337596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.348739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.349066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.349643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.350022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.350394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.351221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.351669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.352949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.355027 ncdv-master-1 devstack@keystone.service[97720]: WARNING keystone.server.flask.common [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:00.370720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:00.371826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:37:00.372863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:00.378911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 468/940] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:00.379047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.sql.core [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:37:00.379047 ncdv-master-1 devstack@keystone.service[97720]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 20:37:00.379047 ncdv-master-1 devstack@keystone.service[97720]: [parameters: {'id': '817a9aad326a4abb9c0327e3e61e8970', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 20:37:00.379047 ncdv-master-1 devstack@keystone.service[97720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 20:37:00.380804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 817a9aad326a4abb9c0327e3e61e8970.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 817a9aad326a4abb9c0327e3e61e8970. Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:37:00.384112 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 25 20:37:00.384935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application yield resource Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise self.value Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application session.commit() Jun 25 20:37:00.385880 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.flush() Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application compat.raise_( Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:37:00.386751 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 20:37:00.387633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:37:00.388458 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [parameters: {'id': '817a9aad326a4abb9c0327e3e61e8970', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.392008 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:00.394433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 817a9aad326a4abb9c0327e3e61e8970. Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.396301 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 473/941] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Jun 25 20:37:00 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:00.399353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.427705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.450580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.503920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791238fc-b688-4bf0-98a3-059828e21240 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.516710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729734a-66f6-4a68-9ede-f447d96481fd None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.538497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.539460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.539460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.539745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.540721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:00.541039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.542498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.554816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.555876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.556370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.556949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.564820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 469/942] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:00.568204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.569401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.571480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:00.587482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:00.588377 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:00.589309 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:00.591829 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 474/943] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:00.598774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.664929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.686180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf5f3-abbe-4aff-891f-b79bfe021914 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.727400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.729346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.730311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.730600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.730881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.732147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d2b6-9b70-4293-9999-c8f5c00ad0f3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.744065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.746049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:00.769593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:00.770559 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:00.771453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:00.771453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:00.771453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:00.771453 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:00.772510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 470/944] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:00.777256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:00.783347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aac42-153c-4fad-81ba-78795735720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.784037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aac42-153c-4fad-81ba-78795735720a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.784325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aac42-153c-4fad-81ba-78795735720a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.784664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aac42-153c-4fad-81ba-78795735720a None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.785424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aac42-153c-4fad-81ba-78795735720a None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:00.785736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aac42-153c-4fad-81ba-78795735720a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.787183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aac42-153c-4fad-81ba-78795735720a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.813779 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 475/945] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:00.905380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12513f-beec-44bc-b57f-7a52d6cad119 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:00.944766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:00.945402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:00.945686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:00.945964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:00.946702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:00.947014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:00.948454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:00.956028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:00.962120 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 471/946] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:00.969706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aac42-153c-4fad-81ba-78795735720a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.074583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aac42-153c-4fad-81ba-78795735720a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.110142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.111255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.111685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.112105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.120347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.122171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:01.137614 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:01.138762 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:01.139886 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:01.147320 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 476/947] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:01.149053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.254226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05df84b-5c6c-4b42-a273-8847097434c3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.292609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.293579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.294014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.294440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.295383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:01.295857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.297524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08810aea-a65d-4bc1-af82-e569c9011503 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.316553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 472/948] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:01.318296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.342107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:01.399065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b0a-8fff-409f-b351-f3c3e5cef4af None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.399621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b0a-8fff-409f-b351-f3c3e5cef4af None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.399621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b0a-8fff-409f-b351-f3c3e5cef4af None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.401430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 473/949] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:01.408749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.409227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.409644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.435835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:01.437257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:01.437785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3753ab-f358-4605-8b45-08babe9d5e96 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.476626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.477831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.478258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.478680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8942fa716189487aa6c949730a9de90f/roles/3d1339cfb6334cad9e57c421c5d7f210` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.481398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=8942fa716189487aa6c949730a9de90f, role_id=3d1339cfb6334cad9e57c421c5d7f210)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.483009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247d531-7e05-4622-9819-b6049e210f4a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.499514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 477/950] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:01 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/8942fa716189487aa6c949730a9de90f/roles/3d1339cfb6334cad9e57c421c5d7f210 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:37:01.521386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:01.523004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923660d9-caf0-4472-9b70-5097f4ba8dcb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.523302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923660d9-caf0-4472-9b70-5097f4ba8dcb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.523591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923660d9-caf0-4472-9b70-5097f4ba8dcb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.529801 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 478/951] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:37:01.531271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.531598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.531879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.534448 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 474/952] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:01.550912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:01.552601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:01.564185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.628644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 479/953] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:01.653121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.667958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:01.693871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725a7de-1ff1-4cf1-8425-9fe353c39049 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.734940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.736615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.737031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.737381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.738154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.739635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:01.754110 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:01.755315 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:01.756218 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 475/954] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:01.761832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.774567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e5191-e0ab-420b-8cf9-977f45798cd5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.810286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.811561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.812012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.812465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.813431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.815504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.829276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:01.832379 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:01.833642 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:01.834605 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:01.837776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 480/955] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:01.843937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.886280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c7bf-26ad-4a1c-84ac-58446bbf4474 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.920680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:01.925887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.926574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.926864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.927143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.927953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:01.928364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.929809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:01.936057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 476/956] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:01.942398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:01.953411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5afe-bb53-4bdb-aba5-c7cdb3ca43f3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:01.989839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:01.991436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:01.991918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:01.992391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:01.993318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:01.993837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:01.995455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:02.001399 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 481/957] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:02.006781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:02.068916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292667a-80b1-4863-93cb-dc75548fdac3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:02.088519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:02.110815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:02.111660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:02.112114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:02.112438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:02.113533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:02.113533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:02.115119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:02.121256 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 477/958] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:02.126968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:02.137797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554df7-38a0-4d99-8f01-e6329442d282 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:02.172836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:02.173513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:02.173798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:02.174077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:02.174788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:02.175098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:02.176640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70142eee-52c6-425f-90d0-a9de40ade6bd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:02.181702 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 482/959] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:02.242135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703d6e-6c9e-488c-852a-7b6e82bd1218 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:02.280109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:02.281111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:02.281541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:02.281961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:02.282912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:02.284542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47e57b-20e6-4f9a-83bc-5ca5096890dc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:02.312540 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 478/960] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:37:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:03.289171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d745-aa6a-43a4-b1b6-0db6daed6b32 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.290073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d745-aa6a-43a4-b1b6-0db6daed6b32 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.290747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d745-aa6a-43a4-b1b6-0db6daed6b32 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.292396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 483/961] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:03.298122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.298558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.298735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.315846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:03.317090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:03.349264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:03.395298 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 479/962] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:03.421094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d745-aa6a-43a4-b1b6-0db6daed6b32 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:03.424167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:03.535859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d745-aa6a-43a4-b1b6-0db6daed6b32 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:03.571379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:03.571982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.572265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.572571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.573280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:03.574738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:03.589410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.sql.core [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:37:03.589410 ncdv-master-1 devstack@keystone.service[97720]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 25 20:37:03.589410 ncdv-master-1 devstack@keystone.service[97720]: [parameters: {'user_id': '4bbb198f3afe4e6c9d53726e059cd177', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 25 20:37:03.589410 ncdv-master-1 devstack@keystone.service[97720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:37:03.597538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:37:03.598490 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application yield resource Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise self.value Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application session.commit() Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 20:37:03.599432 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.session.flush() Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application compat.raise_( Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:37:03.600314 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:37:03.602785 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result.read() Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:37:03.604727 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [parameters: {'user_id': '4bbb198f3afe4e6c9d53726e059cd177', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:03.606606 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 25 20:37:03.612543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:03.613531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 484/963] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 25 20:37:03 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:03.613936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:03.714127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057df1d-f2f1-4f51-8554-60fec23e8959 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:03.749222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:03.750354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.750873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.751427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.759085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:03.760809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-c3c2e536-7287-4273-9ef6-ea46911b986a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:03.776106 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:03.777132 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:37:03.778086 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:03.784620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 480/964] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:03.786830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:03.864263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:03.906526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8c83-1d6b-48f9-83c4-92548112038c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:03.912976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a01ee-f93f-4601-a34f-6c6b422eff51 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.913252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a01ee-f93f-4601-a34f-6c6b422eff51 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.913529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a01ee-f93f-4601-a34f-6c6b422eff51 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.919089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 481/965] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:03.920206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.920512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.920793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.940521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:03.941749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:03.953423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:03.954948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:03.955439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:03.956221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:03.957629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:03.958162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:03.960192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:03.963489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.016477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 485/966] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 25 20:37:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:04.030396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 482/967] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:04.058001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.170660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4416-2b35-42bd-9a57-7705d6a0469c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.196453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.211169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.212008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.212292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.212602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.226055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:04.234419 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:04.235393 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:04.236238 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 486/968] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:04.241945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.358662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18d6ec-3bac-416a-9a80-4c1bccb4eb64 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.394302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.394983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.395270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.395545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.396301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:04.396653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:04.398587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328b18-2368-4df7-9407-b6f9b008a44a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:04.408550 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 483/969] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:04.414247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.506951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9f6a-0a00-444b-a14e-d4511873dba3 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.507295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9f6a-0a00-444b-a14e-d4511873dba3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.507511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9f6a-0a00-444b-a14e-d4511873dba3 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.509055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 484/970] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:04.513827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.514111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.514404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.524282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382ddc-0336-474d-b2fe-021fe4e42c5c None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.532947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:04.534485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:04.544948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.561011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.561799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.562085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.562361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.573679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:04.575147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:04.593417 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:04.594555 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:04.595627 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:04.595627 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:04.595627 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:04.595627 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:04.597508 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 487/971] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:04.602968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.616464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 485/972] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:04.637463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.642464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.707898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311cb5-7f3f-43b0-b2f3-e6c9cf50a826 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.735485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0c3c-586e-4f00-a6ac-4987f6337654 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.742105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.742765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.743048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.743331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.744052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:04.744346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:04.745778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b8d26-5c70-42c9-9153-e471435a26ff None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:04.757392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 488/973] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:04.761991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166b87-1835-4b8f-bca4-e2e76058672b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.762426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166b87-1835-4b8f-bca4-e2e76058672b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.762709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166b87-1835-4b8f-bca4-e2e76058672b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.764003 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 489/974] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:04.764716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17166b87-1835-4b8f-bca4-e2e76058672b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.770225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.770893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.771176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.771453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.772166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:04.773577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023f1f6-e955-4c11-aa28-2f577d19ac62 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:04.798739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 486/975] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:37:04 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:37:04.798739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.798739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.798739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.798739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.811743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:04.813946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:04.886548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:04.904107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17166b87-1835-4b8f-bca4-e2e76058672b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:04.908288 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 487/976] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:04.932730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:04.942030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:04.942868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:04.943153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:04.943433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:04.952186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:04.953698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:04.969691 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:04.970728 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:04.972470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 490/977] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:04.979179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.055010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca405cb-c194-4e42-b409-29b7fdbfb594 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.083511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.089856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.090671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.090953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.091227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.091883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.093292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.095334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d214d-15cd-4306-8fa9-ce0936dd70f4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:05.105597 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:05.106600 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:05.107463 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:05.111951 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 488/978] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:05.112634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.133413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.134190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.134512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.134788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.135621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:05.135933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.137660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.156127 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 491/979] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 25 20:37:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:05.161544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.172351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.215028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef47623-7d28-45e8-b055-4827c8467c3f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.252770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.253433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.253714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.253992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.254804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:05.255127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.256530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.262096 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 489/980] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:05.267658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.276571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6ffcb-d98b-4473-9b2e-3b8f909fe22b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.313327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.313913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.314195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.314934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.333352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.379970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32435f-a340-44f7-9f3e-143cc681d227 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.391514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.393009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.402702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.417001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.417879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.418307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.418754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.419597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:05.420047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.421596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.426629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 490/981] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:05.432379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.505712 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 492/982] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:05.510951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.544323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b050b-2bcf-4637-b5f5-431b51943bac None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.567577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.579820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.580550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.580784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.581053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.582081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] RBAC: Adding query filter params (interface=admin, service_id=ec8af9c6a15f4a5a97f2b6f1ff3afdcb, region_id=RegionOne) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:05.582191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.583515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.589418 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 491/983] 10.222.0.39 () {56 vars in 1249 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/endpoints?service_id=ec8af9c6a15f4a5a97f2b6f1ff3afdcb&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:05.595565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.619395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bbbc3-924e-4e30-a91b-101ea11b65d3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.629146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.653909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.654697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.654974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.655238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.665945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.667405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:05.686369 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:05.687260 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:05.688233 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:05.688233 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:05.688233 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:05.688233 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:05.688233 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 493/984] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:05.693147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.715880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d37f2-1a90-4197-a805-aefe6d4a74f0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.753275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.754089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.754369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.754642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.755314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.756725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.762960 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 492/985] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:37:05.810765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d75bc-52ae-4a5c-b7c0-864576e7acdd None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:05.851727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:05.852406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:05.852721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:05.852996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:05.853775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:05.854100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:05.855497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:05.873031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 494/986] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:05.874629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:05.932030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:05.987093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fd922-7d93-4170-973f-1847018719c5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:06.020922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:06.021721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:06.022001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:06.022269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:06.029488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:06.030998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:06.045462 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:06.046470 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:06.047365 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 493/987] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:06.053534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:06.076856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:06.157864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f598907-3d2b-4aac-a9c8-6c0664aa6fe8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:06.191252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:06.191913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:06.192190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:06.192474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:06.193258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:06.193567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:06.194987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81240453-5f50-41c8-b344-ba64795a320a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:06.207082 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 495/988] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:06.212874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:06.312327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38c5d-102f-4951-988e-7cc400757f1d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:06.322996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:06.352121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:06.352729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:06.353005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:06.353278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:06.354103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] RBAC: Adding query filter params (role.id=3d1339cfb6334cad9e57c421c5d7f210, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=8942fa716189487aa6c949730a9de90f) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:06.354411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:06.355845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a123a6-e9e2-45d8-880a-59a90ca01df7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:06.361904 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 494/989] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:06 2022] GET /identity/v3/role_assignments?user.id=8942fa716189487aa6c949730a9de90f&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=3d1339cfb6334cad9e57c421c5d7f210 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:07.117863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea347b-dec3-4c44-9908-9fbcd5a093f1 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.118372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea347b-dec3-4c44-9908-9fbcd5a093f1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.118372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea347b-dec3-4c44-9908-9fbcd5a093f1 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.119855 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 496/990] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:07.124997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.125423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.125592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.147051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:07.148252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:07.225046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 495/991] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:07.248546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea347b-dec3-4c44-9908-9fbcd5a093f1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:07.339664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:07.364971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea347b-dec3-4c44-9908-9fbcd5a093f1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:07.399691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:07.400433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.400810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.401093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.401748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:07.403128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:07.414944 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:07.415933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:07.422076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 497/992] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:07.424210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:07.537295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032a53-4af2-42ee-bb7a-8f963805f2bd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:07.540298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:07.574138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:07.574803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.575080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.575345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.576044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:07.576440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:07.577825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:07.587726 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 496/993] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:07.589062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:07.694097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6416-d3d8-470f-9a6e-a402da6900b6 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:07.727421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:07.728094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.728380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.728683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.729394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:07.729698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:07.731070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:07.736680 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 498/994] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:07.742340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:07.856988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738363-ba8a-4e0a-858e-9df2df3ebe19 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:07.891961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:07.892650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:07.892928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:07.893200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:07.893978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] RBAC: Adding query filter params (interface=public, service_id=8b5518fa131146c6b0ad3bbc2a552e95, region_id=RegionOne) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:07.894289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:07.895683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec677a-5566-4595-916e-09652b093a12 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:07.901075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 497/995] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:37:07 2022] GET /identity/v3/endpoints?service_id=8b5518fa131146c6b0ad3bbc2a552e95&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:07.906493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:07.918090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:08.007917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f065a-0f67-4348-a95f-29f077ceab28 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.041043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.041710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.041992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.042267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.042942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.044348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d1918-7084-45fb-8100-81fb5fce218e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:08.050925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 499/996] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:37:07 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:37:08.074792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393c32-b260-40fa-9c47-d6d4b637e2b5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.075098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393c32-b260-40fa-9c47-d6d4b637e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.075490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393c32-b260-40fa-9c47-d6d4b637e2b5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.077184 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 498/997] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:08.083468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.083811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.084006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.103838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:08.105423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:08.181300 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 500/998] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:08.205744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393c32-b260-40fa-9c47-d6d4b637e2b5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:08.241600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:08.321362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393c32-b260-40fa-9c47-d6d4b637e2b5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.361646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.362464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.362745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.363020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.363669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.365080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:08.377150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:08.378164 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:08.384362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 499/999] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 25 20:37:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:08.386854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:08.389201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:08.495070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddcbfe-a896-4670-8fd9-befd59e8533e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.530794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.531466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.531763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.532052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.532787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:08.533097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.534503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2be80-d729-40cf-ad8c-edcebfdd58f6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:08.539719 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 501/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:08.545427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:08.644113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:08.650745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755ee8b-e404-4a37-869d-edef71ba95cc None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.687897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5fce-ac1c-436c-bda5-b938ace1f8fb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.688670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5fce-ac1c-436c-bda5-b938ace1f8fb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.689262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5fce-ac1c-436c-bda5-b938ace1f8fb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.689569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.690241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.690520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.690796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.691504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:08.691811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.692146 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 502/1001] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:08.693346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:08.697334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.697824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.698303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.698470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 500/1002] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 25 20:37:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:08.703932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:08.718916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:08.721218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:08.787735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:08.796943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 503/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:08.813631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db59500-8596-4062-8424-d2c0016fa74c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.820727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:08.856456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.857283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.857408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.857674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.858416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.859842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:08.888460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 501/1004] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:37:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:37:08.941076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2ccd-60b4-435b-92ff-134191472e74 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:08.986043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:08.986850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:08.987136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:08.987412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] PATH_INFO: `/v3/services/image` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:08.988063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:08.989487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:09.001969 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:09.003095 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:09.003926 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:09.009837 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 504/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 25 20:37:08 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:09.010035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:09.036244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:09.119174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edb12-c526-4416-83db-5764578ee54c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:09.153023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:09.153694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:09.153976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:09.154253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:09.154948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:09.155274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:09.156696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef513-a7d5-44fd-8ba6-26456cfd31a0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:09.161886 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 502/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:09.167806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:09.238549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:09.287467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7696d-9ef1-4c34-b773-f44209a79c1e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:09.323067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:09.323741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:09.324023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:09.324298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:09.325034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] RBAC: Adding query filter params (type=image) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:09.325338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:09.326711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a30b5e-2022-4907-bde1-b35f245ecb7d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:09.331418 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 505/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:10.349814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9420-81cc-4b75-b7ea-ecf58178e354 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:10.350435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9420-81cc-4b75-b7ea-ecf58178e354 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:10.350435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c9420-81cc-4b75-b7ea-ecf58178e354 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:10.351678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 503/1008] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:10.357205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:10.357621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:10.357940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:10.377519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:10.378730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:10.476584 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 506/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:10.499921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c9420-81cc-4b75-b7ea-ecf58178e354 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:10.606642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:10.628558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c9420-81cc-4b75-b7ea-ecf58178e354 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:10.661980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:10.662780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:10.663059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:10.663330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:10.664000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:10.665439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:10.677155 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:10.678174 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:10.679006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 504/1010] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:10.684406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:10.740314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:10.791053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a915a12-ab1d-432b-967c-68c1e4140c9d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:10.831490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:10.832180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:10.832483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:10.832765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:10.833474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:10.833782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:10.835162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:10.846518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 507/1011] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:10.848572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:10.953761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab17ea-3714-418d-bcd7-59ee90468b47 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:10.992406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:10.993122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:10.993405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:10.993676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:10.994392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] RBAC: Adding query filter params (type=compute) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:10.994702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:10.996102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91377e0-5f67-40bb-b787-a3c6380eabad None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:11.005879 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 505/1012] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 25 20:37:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:11.007570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:11.111020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959606a6-3f63-4fe7-83c6-46843dfbc909 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:11.125320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:11.148316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:11.149018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.149297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.149574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.150307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:11.151669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab886-02ac-4a6e-9308-d8b581f31413 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:11.172670 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 508/1013] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:37:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:11.201917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33e06-4b24-476a-aa30-6060019bd391 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.202258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33e06-4b24-476a-aa30-6060019bd391 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.202499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33e06-4b24-476a-aa30-6060019bd391 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.204614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 506/1014] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:11.210127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.210417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.210749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.229693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:11.230928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:11.316463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 509/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:11.339449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33e06-4b24-476a-aa30-6060019bd391 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:11.359661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:11.464262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33e06-4b24-476a-aa30-6060019bd391 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:11.501981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:11.502789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.503078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.503355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.504601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:11.506072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59847b07-3182-4cea-a289-f112067c3ea3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:11.507696 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 507/1016] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:11.513723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:11.608917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:11.615951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ab0e-522e-4879-a9a9-da5852b5d692 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:11.632275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caecb61-9d4e-47cb-805b-affb48f0495d None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.632630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caecb61-9d4e-47cb-805b-affb48f0495d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.632921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caecb61-9d4e-47cb-805b-affb48f0495d None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.634308 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 508/1017] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:37:11.640215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109440-f44e-4acf-896c-2c0e2687fdcc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.640501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109440-f44e-4acf-896c-2c0e2687fdcc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.640824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109440-f44e-4acf-896c-2c0e2687fdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.654291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:11.654965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.655249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.655526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.656250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:11.657578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fc109440-f44e-4acf-896c-2c0e2687fdcc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:11.657829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:11.658760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fc109440-f44e-4acf-896c-2c0e2687fdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:11.688277 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 510/1018] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:37:11 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:11.737429 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 509/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:11.761648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:11.883123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb189e-6247-42c4-995c-91535d9c23aa None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:11.918203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:11.918905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:11.919192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:11.919468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:11.920210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:11.921646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549738f-26f5-4fee-9b74-4632f7169900 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:11.939029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 511/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:37:11 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:37:13.606692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ab5d-28e5-4059-8800-f2f78f1a8709 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:13.607238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ab5d-28e5-4059-8800-f2f78f1a8709 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:13.607238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ab5d-28e5-4059-8800-f2f78f1a8709 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:13.612335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 510/1021] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:13.614341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:13.614763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:13.614948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:13.632110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:13.633336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:13.635581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:13.716468 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 512/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:13.737668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ab5d-28e5-4059-8800-f2f78f1a8709 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:13.750310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:13.857548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ab5d-28e5-4059-8800-f2f78f1a8709 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:13.892616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:13.893491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:13.893773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:13.894045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:13.904649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-596fb7df-72bf-4f23-ae98-e516e1fe7f5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:13.912899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:13.913838 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:13.914692 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:13.916802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 511/1023] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:37:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:13.920122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.024551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fa35-74f9-4f55-a894-0a045de437ab None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.024934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fa35-74f9-4f55-a894-0a045de437ab None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.025283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fa35-74f9-4f55-a894-0a045de437ab None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.027011 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 512/1024] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:14.030454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f1e6-c06c-4289-bd94-2faef57e5f9d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.032893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.033189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.033462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.051632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:14.052882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:14.069036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.069803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.070191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.070359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.071096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:14.071404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.072892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.075128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.082624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 513/1025] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:37:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:14.088032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.124615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.137069 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 513/1026] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:14.154986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.189279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e1c46-5191-4f58-a5f6-f94b650f5d3e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.223920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.224748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.225048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.225284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.236108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.237594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-41f41017-98c0-4f85-9f4e-69880a846603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:14.256535 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:14.257498 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:14.258402 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:14.258402 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:14.258402 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:14.258402 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:14.258402 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 514/1027] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:14.259108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b362e8-598d-4526-a4b1-387d1ebc1304 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.259321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b362e8-598d-4526-a4b1-387d1ebc1304 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.259599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b362e8-598d-4526-a4b1-387d1ebc1304 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.260867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 515/1028] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:14.263072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b362e8-598d-4526-a4b1-387d1ebc1304 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.270310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec65ee-ceec-4948-8f0b-28fc80b38501 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.305633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.306430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.306709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.306981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.308158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.309659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bfd89-9036-4f02-bb7d-98c43d8ded05 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.311303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 514/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:14.312442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.312723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.312994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.313759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.329508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:14.330685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:14.371548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b362e8-598d-4526-a4b1-387d1ebc1304 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.392802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.398718 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 515/1030] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:14.399684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.409139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.409826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.410085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.410359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.411079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:14.411380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.412778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.425105 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 516/1031] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:14.426254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.506226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c3df7-8d61-4dd0-915b-8cb6fd66e130 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.527518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbfe4c-0c9e-4a95-8f3d-2390242e87fc None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.536298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.541827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.542525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.542801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.543071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.543770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.545226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.563204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.564006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.564289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.564604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] PATH_INFO: `/v3/services/image` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.565201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 516/1032] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:37:14 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:14.565319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.566001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.566694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:14.579543 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:14.580793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:14.581854 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 517/1033] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:14.589532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.647861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.694779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573424-04ca-4ef5-a08e-fb49c8472e68 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.704803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7269-2092-484a-b391-d4a28ab2d4cd None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.736003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.736916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.737214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.737451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.746530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.747577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.748044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.748274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.748580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.748854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.749561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:14.749865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.751547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.757931 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 518/1034] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:14.763369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:14.764113 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:14.765208 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:14.766147 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:14.770398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 517/1035] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:14.771044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.802700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.878430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b03d-f603-40aa-8c42-c47ea7ae04f1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.887011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee932-2e62-4bdd-9285-411a2a020663 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:14.900842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:14.915943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.916699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.917021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.917276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.917978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] RBAC: Adding query filter params (type=image) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:14.918286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.919661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.922593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:14.923267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:14.923550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:14.923826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:14.924688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:14.929706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:14.929828 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 519/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:14.929908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:14.930696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:14.951891 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 518/1037] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:14.953006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.031826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.035431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf89-3285-429d-bec1-b6903828fbb1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.060303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c987-a861-4118-bed7-84708e5e5224 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.072471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.073345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.073776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.074195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.075157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] RBAC: Adding query filter params (interface=public, service_id=f49a244609334b4d961ba7a7c3a95c09, region_id=RegionOne) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:15.075655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.077032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.086975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 520/1038] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/endpoints?service_id=f49a244609334b4d961ba7a7c3a95c09&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:15.087650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.099189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.099855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.100144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.100747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.143435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.170072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.171472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.197522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac49a-a66f-432c-a1c6-f3c6195cd72f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.234197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.235191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.235777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.236248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.237221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.238781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.245732 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 521/1039] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:37:15.284276 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 519/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:15.289959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.324499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.409674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09436-f7cc-4eba-b220-11f3c761c775 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.450078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.450815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.451121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.451380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.463398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.464920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:15.483840 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:15.485041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:15.486133 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:15.486133 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:15.486133 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:15.486133 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:15.486133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 522/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:15.492218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.562353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.593182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd54066-a972-4928-a348-ad1ba4cdc00a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.628970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.629640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.629928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.630207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.630926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:15.631218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.632653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.645207 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 520/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:15.650709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.737775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.759338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df04fa1-73db-4d4a-99f1-c9746ff5274b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.796200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.797177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.797464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.797738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.809048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.810550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:15.827035 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:15.827935 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:15.833121 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 523/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:15.835793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:15.939158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7edc77-6933-488a-ad33-d321d497ffc1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:15.968225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:15.975109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:15.975780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:15.976070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:15.976408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:15.977241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:15.977550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:15.979000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87461b6-7dca-432a-8c5c-5a5b9772bbdc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:15.991809 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 521/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:15.997668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:16.102139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4b38d-f368-42d8-9be3-f62dacaea75e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:16.137397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:16.138056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:16.138313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:16.138610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:16.139440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] RBAC: Adding query filter params (role.id=3d1339cfb6334cad9e57c421c5d7f210, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:16.139758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:16.141284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912842d-e943-4f12-b43b-ee5c4f5c2127 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:16.147376 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 524/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:15 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=3d1339cfb6334cad9e57c421c5d7f210 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:16.906173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876fd3-f32a-440c-9295-0132e006db60 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:16.906792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876fd3-f32a-440c-9295-0132e006db60 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:16.906792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876fd3-f32a-440c-9295-0132e006db60 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:16.908288 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 522/1046] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:16.913816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:16.914228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:16.914396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:16.920518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:16.931727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:16.932931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:17.003067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 525/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:17.028956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876fd3-f32a-440c-9295-0132e006db60 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.137494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876fd3-f32a-440c-9295-0132e006db60 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.173001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:17.173852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.174139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.174412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.184972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:17.192661 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:17.193582 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:17.199798 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 523/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:17.201834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.308103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8ff0-1155-4431-a71b-d0c515f39b44 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.344744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:17.345436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.345716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.345996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.347079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:17.347382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:17.348837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:17.350539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.359761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 526/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:17.365422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.419787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.474232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4febf-5446-4ec0-a8b4-191cf0424c2a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.509215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:17.510093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.510368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.510637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] PATH_INFO: `/v3/users/befeab24dc074e3cb8d43bf77763b1d4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.528451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] RBAC: Authorizing `identity:get_user(user_id=befeab24dc074e3cb8d43bf77763b1d4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:17.528451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4c4f9-545c-4bd0-bc5a-e91665dec674 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:17.528451 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 524/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/users/befeab24dc074e3cb8d43bf77763b1d4 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:17.534116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.573169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab65b-91a4-4cc9-9311-1f3df3dbd8e2 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.573465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab65b-91a4-4cc9-9311-1f3df3dbd8e2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.573724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab65b-91a4-4cc9-9311-1f3df3dbd8e2 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.575237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 525/1051] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:37:17.580304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.580847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.580979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.597867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:17.599068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:17.643490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d55c5-2917-4c46-828e-c4930691d3be None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.673443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 526/1052] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:17.684219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:17.684917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.685199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.685471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.697597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.742620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.748891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.756329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:17.757807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:17.806335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d821b-f198-44ad-bc51-d77daf84c552 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.840274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:17.841195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:17.841688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:17.841799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:17.842381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:17.843968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:17.857321 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:17.858530 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:17.860204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 527/1053] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:17.864451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.884012 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 527/1054] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:17.884930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:17.968969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882c70-edd4-4dd1-b3f1-6015f19f06e9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:17.972645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.985131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:17.991304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c82e40-9fda-496a-90bd-f2a6d3a736a9 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.006324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.006996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.007282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.007567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.008270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:18.008612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.010003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.015444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 528/1055] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:18.020951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:18.029843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.030809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.031097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.031438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.032665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.034107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.040803 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 528/1056] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:17 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:18.041682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:18.127942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2fac-42fa-4b4e-8aea-4fd9bd1d26c1 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.144226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455380cd-500e-47cb-8ee2-a5285744fdd2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.162728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.163394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.163677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.163945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.164735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] RBAC: Adding query filter params (type=image) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:18.165040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.166411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.171390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 529/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:18.177096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:18.182105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.182996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.183484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.183954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.185025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f, user.id=befeab24dc074e3cb8d43bf77763b1d4) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:18.185544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.187304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729494-f49e-4f85-a6e0-2a76f639d805 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.194586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 529/1058] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:18 2022] GET /identity/v3/role_assignments?user.id=befeab24dc074e3cb8d43bf77763b1d4&scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:18.215674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:18.296740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0ac7-c196-4c39-8f3b-aab7bf6e6d54 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.339630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.340681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.341182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.341647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.342587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.344288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de547d64-4444-4fa6-908b-60860931e0b5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.367217 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 530/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:37:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:37:18.443893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c4e0-b57c-42c5-88e2-d4a314b3d16b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.444252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c4e0-b57c-42c5-88e2-d4a314b3d16b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.444507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c4e0-b57c-42c5-88e2-d4a314b3d16b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.445987 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 530/1060] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:18.452276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.452679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.452912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.475006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:18.476226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:18.558046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 531/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:18.582572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c4e0-b57c-42c5-88e2-d4a314b3d16b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:18.611969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:18.687978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c4e0-b57c-42c5-88e2-d4a314b3d16b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.723011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.723831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.724112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.724385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.735416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:18.745853 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:18.746831 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:18.748086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 531/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:18.753778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:18.770788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:18.868291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b35b4-178c-497f-b1d4-21f2b5b5b72e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:18.902854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:18.903529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:18.903808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:18.904082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:18.904863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:18.905171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:18.906595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:18.914885 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 532/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:18.920521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.009139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:19.022834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed558-2607-4658-86b1-15e8a47477c3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.056086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.056922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.057205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.057479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.068260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.070026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:19.087086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:19.087974 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:19.088917 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:19.088917 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:19.088917 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:19.088917 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:19.094394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 532/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:19.094529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.174437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:19.198701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924c3c-d8e0-4db6-81b4-4a3a75d12cb7 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.232439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.233129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.233407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.233682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.234438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:19.234744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.236119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.247874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 533/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:19.253586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.355253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f148-4c3b-411f-861f-10bcf26c6907 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.389362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.390158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.390443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.390787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.398676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.400132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.402810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:19.416305 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:19.417684 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:19.418855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:19.419759 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 533/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:19.424766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.539134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a85bff-6570-4a43-bb1f-5f4445634e4c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.576035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.576881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.577195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.577499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.578452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:19.578823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.580443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.584502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:19.600995 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 534/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:19.606680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.708319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec76f-a227-421e-beca-d43d2289b8d2 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.742160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.742957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.743240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.743516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.754269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.755743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:19.772923 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:19.773801 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:19.774682 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:19.774682 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:19.774682 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:19.774682 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:19.776756 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 534/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:19.779950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:19.890494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59f1aa-6623-4101-95e3-d578031bb8d4 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:19.924943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:19.925775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:19.926156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:19.926530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:19.927341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:19.927747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:19.929380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:19.941234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 535/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:19.946775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.003617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:20.053499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a001-1af2-47d0-83dd-264d42e5d559 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.088284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.089128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.089411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.089685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.096928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:20.098382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:20.112990 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:20.113934 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:20.119814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 535/1070] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:20.121812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.183142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:20.231906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c338-766a-4def-97fe-6fc56b08e300 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.269441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.270111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.270390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.270665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.271453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:20.271759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:20.273256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1652d13-d530-4835-93fa-5790c11d00b7 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:20.286192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 536/1071] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:20.292215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.399378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5c0-0915-44fb-9678-c5b282bb5d03 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.413548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:20.438251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.439080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.439367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.439646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/3d1339cfb6334cad9e57c421c5d7f210` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.442107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=bce2e604e9444a99b194c1a5a9f96683, role_id=3d1339cfb6334cad9e57c421c5d7f210)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:20.443605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da7f7-a51e-464b-b8d4-bef002034564 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:20.459745 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 536/1072] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:20 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/bce2e604e9444a99b194c1a5a9f96683/roles/3d1339cfb6334cad9e57c421c5d7f210 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:37:20.495624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a184-a8d9-4134-a394-33a5a09dcb64 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.495872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a184-a8d9-4134-a394-33a5a09dcb64 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.496162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a184-a8d9-4134-a394-33a5a09dcb64 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.497776 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 537/1073] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:20.503595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a412b-7bde-4a1c-9a6c-15fe16e89da7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.503921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a412b-7bde-4a1c-9a6c-15fe16e89da7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.504110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a412b-7bde-4a1c-9a6c-15fe16e89da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.522569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3e9a412b-7bde-4a1c-9a6c-15fe16e89da7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:20.523753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e9a412b-7bde-4a1c-9a6c-15fe16e89da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:20.598734 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 537/1074] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:20.623388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a184-a8d9-4134-a394-33a5a09dcb64 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.665891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04705-ea14-4177-9a77-c1db422daf1f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.666183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04705-ea14-4177-9a77-c1db422daf1f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.666460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04705-ea14-4177-9a77-c1db422daf1f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.667852 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 538/1075] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:20.673529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.673817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.674106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.692494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:20.693679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:20.749303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a184-a8d9-4134-a394-33a5a09dcb64 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.776447 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 539/1076] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:20.777053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:20.791119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.791999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.792384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.792768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.793266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.804996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:20.813036 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:20.814175 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:20.820378 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 538/1077] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:20.823488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:20.838728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:20.918312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883018b0-6686-435f-8842-c4afa213ce5b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.929930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20922179-9f6f-45ee-80f5-80487b8aa084 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:20.956533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.957465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.957897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.958359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.964905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:20.965586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:20.965875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:20.966156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:20.966906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:20.967216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:20.968656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:20.977984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 539/1078] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:20.983931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:21.028353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:21.045479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.047303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.079250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:21.096249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11e74-c4f1-4b42-b8d0-0e2937446780 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:21.132400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:21.133376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:21.133659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:21.133939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] PATH_INFO: `/v3/users/befeab24dc074e3cb8d43bf77763b1d4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:21.135175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] RBAC: Authorizing `identity:get_user(user_id=befeab24dc074e3cb8d43bf77763b1d4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.136676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.143381 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 540/1079] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:20 2022] GET /identity/v3/users/befeab24dc074e3cb8d43bf77763b1d4 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:21.144307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:21.157928 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 540/1080] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:37:21.163767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:21.251701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230248-8707-410b-9b2a-9e5e7d9eda52 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:21.254071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:21.267993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251c4f-83a2-4517-a22f-70bbc22feedb None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:21.287002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:21.287875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:21.288163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:21.288455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:21.289684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.291149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.297928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 541/1081] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:21 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:21.299099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:21.300131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:21.306543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:21.307417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:21.307766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:21.308554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:21.319594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.321149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:21.340176 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:21.341306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:21.342436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:21.342436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:21.342436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:21.342436 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:21.343338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 541/1082] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:21.349396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:21.410088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c0232-6950-4a64-9098-a098c0252d8a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:21.445455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:21.446448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:21.446804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:21.447151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f/users/befeab24dc074e3cb8d43bf77763b1d4/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:21.449238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f, user_id=befeab24dc074e3cb8d43bf77763b1d4, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.450752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297aab9-f546-4fc2-8fd3-e4c1425fc0c5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.462047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c10fe4-f8ad-4287-8b0c-fa5adc20e9b9 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:21.467464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 542/1083] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:21 2022] PUT /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f/users/befeab24dc074e3cb8d43bf77763b1d4/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:37:21.501923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:21.502695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:21.503076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:21.503445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:21.504293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:21.504770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:21.506284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029d61f-eade-40cb-bece-26a0b6e03e6e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:21.519776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 542/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:22.749032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522427-3c4c-4d5f-ab00-6b12f79f78b0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:22.749594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522427-3c4c-4d5f-ab00-6b12f79f78b0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:22.749594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522427-3c4c-4d5f-ab00-6b12f79f78b0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:22.751326 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 543/1085] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:22.756412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:22.757025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:22.757025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:22.774537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:22.775707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:22.820867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:22.853435 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 543/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:22.878692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522427-3c4c-4d5f-ab00-6b12f79f78b0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:22.914148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:22.985838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522427-3c4c-4d5f-ab00-6b12f79f78b0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.020249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.021034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.021315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.021589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.033786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:23.042008 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:23.042927 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:23.043757 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 544/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 25 20:37:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:23.049464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.151104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b6d52-71a9-4f49-bd31-63e86d25d108 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.186830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.187602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.187883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.188158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.188940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:23.189249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:23.190645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:23.198718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 544/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:23.204585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.297395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:23.307977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b879e24-791c-438b-a15c-960decc468b0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.348591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134931-7930-4079-a414-d2424825e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.349395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134931-7930-4079-a414-d2424825e710 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.349674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134931-7930-4079-a414-d2424825e710 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.349947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134931-7930-4079-a414-d2424825e710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.360823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24134931-7930-4079-a414-d2424825e710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:23.362280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24134931-7930-4079-a414-d2424825e710 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-24134931-7930-4079-a414-d2424825e710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:23.379802 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:23.380989 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:23.381899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:23.381899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:23.381899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:23.381899 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:23.381899 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 545/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:23.386760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.422552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:23.493745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fd25-e355-4010-b52c-dbb32aa6ba5e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.528557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.529229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.529505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.529773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.530496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:23.530802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:23.532205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:23.546252 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 545/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:23.552447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134931-7930-4079-a414-d2424825e710 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.654361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134931-7930-4079-a414-d2424825e710 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.688538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.689329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.689613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.689884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.697573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:23.699023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-91543d14-a21a-4e68-bedd-358a2169c528 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:23.713074 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:23.714006 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:23.714956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 546/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:23.720221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.784612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f948-c59d-4b79-bef0-414ce2bac743 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.785130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f948-c59d-4b79-bef0-414ce2bac743 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.785220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f948-c59d-4b79-bef0-414ce2bac743 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.786532 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 547/1092] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:23.791944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.792230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.792531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.798976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:23.810894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:23.812030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:23.822817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:23.829177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee96e6-06dd-4ea4-8083-0cb20473e2cc None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:23.862680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:23.863355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:23.863641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:23.863943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:23.864798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:23.865111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:23.866550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:23.880447 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 548/1093] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:23.883538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 546/1094] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:23.889133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.905337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:23.986509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d462-cb41-4acb-a6b8-1635354afdb5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.002274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd3886-e2e5-4e1c-a08a-7e4be9a9f2c7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.020011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.020689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.020971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.021247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.023881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.035732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.036556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.036845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.037119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.047238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:24.054850 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:24.055896 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:24.056937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 547/1095] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:24.061922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.077665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.092740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.094249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.159011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961654a9-817a-4aff-877c-2bdbc8a9fb76 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.191358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.192012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.192292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.192607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.192802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 549/1096] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:37:24.193334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:24.193665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.194990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.198314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.208230 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 548/1097] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:24.209219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.231336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.285506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.299143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7afd2-bd20-4e87-814b-1d42fd728bc6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.308649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d456-6cdc-4708-93f8-6b819af215f4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.333566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.334287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.334570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.334822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.345195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.346089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.347010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.347283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.347660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.347932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] PATH_INFO: `/v3/users/befeab24dc074e3cb8d43bf77763b1d4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.349196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] RBAC: Authorizing `identity:get_user(user_id=befeab24dc074e3cb8d43bf77763b1d4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.350611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.352240 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 549/1098] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/users/befeab24dc074e3cb8d43bf77763b1d4 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:24.358055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:24.366109 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:24.367062 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:24.368064 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:24.368064 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:24.368064 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:24.368064 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:24.368064 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 550/1099] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:24.373188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.463606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.466182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b529ab0-fece-4b1d-a961-a68c9d7699b8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.478938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377adf8-970e-41b8-bcae-40dba5ebbf25 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.500435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.501097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.501379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.501652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.512760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.513430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.513715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.513988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.514700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:24.515005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.515847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.516391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.528648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 551/1100] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:24.534278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.570958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.572487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.631951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea181f9-82bb-48bd-877d-eedca3553641 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.664933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.665739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.666011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.666306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.673087 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 550/1101] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:37:24.673331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.674695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.678856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:24.689212 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:24.690334 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:24.691352 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 552/1102] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:24.697242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.706960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.727227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.786290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c5ce-6f07-4179-83cf-9b70826360b8 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.804338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa983-22f0-4407-a0bf-be5c3b3eeb39 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.820408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.821807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.821807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.821960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.823014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.824521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.826619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 551/1103] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:24.832621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.843541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.844200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.844507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.844790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.845568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:24.845871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.847636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.859837 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 553/1104] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:24.865721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:24.929810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.933946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8274771-2b53-4b53-911f-78eaf7bd5466 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.947085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:24.965737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8e0b-a8df-431e-83b5-772727692b50 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:24.968795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:24.969447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:24.969731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:24.970000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:24.970815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f, user.id=befeab24dc074e3cb8d43bf77763b1d4) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:24.971123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:24.972918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9182-c671-481b-80a0-4f17a2ae9a46 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:24.978701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 552/1105] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/role_assignments?user.id=befeab24dc074e3cb8d43bf77763b1d4&scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:25.002548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:25.003232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:25.003521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:25.003804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:25.004676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] RBAC: Adding query filter params (role.id=3d1339cfb6334cad9e57c421c5d7f210, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=bce2e604e9444a99b194c1a5a9f96683) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:25.004992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:25.006502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42454f-273c-450b-9025-7d9b4d1ed911 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:25.028469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 554/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:24 2022] GET /identity/v3/role_assignments?user.id=bce2e604e9444a99b194c1a5a9f96683&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=3d1339cfb6334cad9e57c421c5d7f210 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:27.287197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cfde5-b040-49ab-b7fc-6c4ce0514623 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:27.287765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cfde5-b040-49ab-b7fc-6c4ce0514623 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:27.287765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cfde5-b040-49ab-b7fc-6c4ce0514623 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:27.289143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 553/1107] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:27.295410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:27.296128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:27.296272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:27.315777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:27.317003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:27.398871 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 555/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:27.425666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cfde5-b040-49ab-b7fc-6c4ce0514623 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:27.532715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cfde5-b040-49ab-b7fc-6c4ce0514623 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:27.568024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:27.568772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:27.569051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:27.569333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:27.570554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:27.572011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68d850-629e-4980-9c44-75bf0b30eab1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:27.573656 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 554/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:27.582964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:27.648588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:27.694747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908279-8656-4dc1-8534-94e3f3bee392 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:27.730031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:27.730693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:27.730976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:27.731253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:27.731954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:27.733430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37c556-59a2-4d79-8c53-c108984a43b4 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:27.755425 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 556/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:37:27 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:30.053473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192c42-fcfe-4e8b-a73d-ee735dd9b4e6 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.054297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192c42-fcfe-4e8b-a73d-ee735dd9b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.054297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26192c42-fcfe-4e8b-a73d-ee735dd9b4e6 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.056528 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 555/1111] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:30.063023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.063709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.063903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.086830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:30.087940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:30.160977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 557/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:30.186067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26192c42-fcfe-4e8b-a73d-ee735dd9b4e6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:30.237278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:30.293174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26192c42-fcfe-4e8b-a73d-ee735dd9b4e6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:30.328447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:30.329309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.329596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.329868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] PATH_INFO: `/v3/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.331455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] RBAC: Authorizing `identity:get_role(role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:30.332908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:30.334293 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 556/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:30 2022] GET /identity/v3/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:30.341036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:30.387359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:30.446506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673abac7-4da4-4bf8-a552-c98c8720daeb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:30.483385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:30.484256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.484569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.484843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] PATH_INFO: `/v3/users/26f8c744502c4456a462fb33a99c5cd8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.499282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] RBAC: Authorizing `identity:get_user(user_id=26f8c744502c4456a462fb33a99c5cd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:30.500821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:30.502456 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 558/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:30 2022] GET /identity/v3/users/26f8c744502c4456a462fb33a99c5cd8 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:30.511064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:30.615793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260895-1e54-41c5-a585-cbfd80032016 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:30.628945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:30.650693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:30.651321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.651600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.651881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.720836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:30.722593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:30.831499 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 557/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:30.837565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:30.940056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dddb69-f111-44cd-be9c-2bfbce24efde None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:30.942341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:30.975301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:30.976128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:30.976440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:30.976728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:30.978012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:30.979460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5137-5108-4f41-ac48-eefe6d95fbf2 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:30.981158 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 559/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:30 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:30.988368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:31.002839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:31.105632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d583-0719-42e3-a7e1-2a65f4fac790 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:31.140388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:31.141062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:31.141344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:31.141618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:31.142448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f, user.id=26f8c744502c4456a462fb33a99c5cd8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:31.142760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:31.144177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4fd6-685e-42a1-b3e9-deed84cbe7a3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:31.149744 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 558/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:30 2022] GET /identity/v3/role_assignments?user.id=26f8c744502c4456a462fb33a99c5cd8&scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:33.404371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c3bc-8776-4156-ba71-8ee4124e6d5d None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:33.405268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c3bc-8776-4156-ba71-8ee4124e6d5d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:33.405268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c3bc-8776-4156-ba71-8ee4124e6d5d None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:33.406964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 560/1118] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:33.412507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:33.412920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:33.413035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:33.432099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:33.433616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:33.503435 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 559/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:33.528016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c3bc-8776-4156-ba71-8ee4124e6d5d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:33.639544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c3bc-8776-4156-ba71-8ee4124e6d5d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:33.675181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:33.675964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:33.676216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:33.676552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] PATH_INFO: `/v3/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:33.678161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] RBAC: Authorizing `identity:get_role(role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:33.679580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:33.680958 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 561/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:33 2022] GET /identity/v3/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:33.689456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:33.697860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:33.791954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0cfa-481c-4eb2-afb3-2b559fd09490 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:33.836675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:33.837595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:33.837909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:33.838209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] PATH_INFO: `/v3/users/26f8c744502c4456a462fb33a99c5cd8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:33.839550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] RBAC: Authorizing `identity:get_user(user_id=26f8c744502c4456a462fb33a99c5cd8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:33.841085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:33.842752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 560/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:33 2022] GET /identity/v3/users/26f8c744502c4456a462fb33a99c5cd8 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:33.849284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:33.894854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:33.955022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d5d25-359e-41b6-bf7b-81ac638dba2c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:33.989913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:33.990780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:33.991068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:33.991333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:33.992564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:33.994028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a748-1191-48a0-a4a8-a2184dd14f7f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:33.995730 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 562/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:33 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:34.004680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:34.081658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:34.108163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d5fec-45a5-43ad-b3c1-b8675ed0e454 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:34.152106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:34.153529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:34.153945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:34.154376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f/users/26f8c744502c4456a462fb33a99c5cd8/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:34.157401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] RBAC: Authorizing `identity:create_grant(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f, user_id=26f8c744502c4456a462fb33a99c5cd8, role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:34.158838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc2555-924d-4b6b-8dd8-a79edf4d496d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:34.172978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 561/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:34 2022] PUT /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f/users/26f8c744502c4456a462fb33a99c5cd8/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:37:36.430308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee3c36-78b2-41cf-a130-7fa34090e722 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:36.430895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee3c36-78b2-41cf-a130-7fa34090e722 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:36.430895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee3c36-78b2-41cf-a130-7fa34090e722 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:36.433040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 563/1124] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:36.440227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:36.440639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:36.440846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:36.462484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:36.463824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:36.540521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 562/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:36.574603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee3c36-78b2-41cf-a130-7fa34090e722 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:36.689608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee3c36-78b2-41cf-a130-7fa34090e722 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:36.698992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:36.728575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:36.729433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:36.729712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:36.729979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] PATH_INFO: `/v3/roles/d5b16024d5d9498693db3f2fb759bd14` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:36.731534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] RBAC: Authorizing `identity:get_role(role_id=d5b16024d5d9498693db3f2fb759bd14)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:36.732935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:36.734330 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 564/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:36 2022] GET /identity/v3/roles/d5b16024d5d9498693db3f2fb759bd14 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:36.743059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:36.814044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:36.860199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d71b-7e2b-459b-9afb-768619587aff None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:36.898117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:36.898989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:36.899266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:36.899533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] PATH_INFO: `/v3/users/26f8c744502c4456a462fb33a99c5cd8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:36.900869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] RBAC: Authorizing `identity:get_user(user_id=26f8c744502c4456a462fb33a99c5cd8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:36.902309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:36.903939 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 563/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:36 2022] GET /identity/v3/users/26f8c744502c4456a462fb33a99c5cd8 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:36.910570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:37.030710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25611-2d91-4f8c-9e79-b1b39361deb9 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:37.073066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:37.073707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:37.073988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:37.074264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:37.120346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:37.146588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:37.148079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:37.250681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 565/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:37.256969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:37.362057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33e0c-ecc0-4d98-b167-d95895643f6f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:37.392259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:37.398585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:37.399433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:37.399707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:37.399976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] PATH_INFO: `/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:37.401152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] RBAC: Authorizing `identity:get_project(project_id=c7acc8a8ec1e48658d9c71fd88c9a06f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:37.402580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6917ae-951b-4f76-be5b-c58f97a5b68f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:37.404274 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 564/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:37 2022] GET /identity/v3/projects/c7acc8a8ec1e48658d9c71fd88c9a06f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:37.414383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:37.517162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:37.544509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f8f8-b301-48bd-a86f-03e7e85cf45b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:37.582314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:37.582960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:37.583234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:37.583506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:37.584323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] RBAC: Adding query filter params (role.id=d5b16024d5d9498693db3f2fb759bd14, scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f, user.id=26f8c744502c4456a462fb33a99c5cd8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:37.584662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:37.586106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88cf1f-97cf-4560-9ad8-7e0a9f7fe8ba None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:37.592011 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 566/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:37 2022] GET /identity/v3/role_assignments?user.id=26f8c744502c4456a462fb33a99c5cd8&scope.project.id=c7acc8a8ec1e48658d9c71fd88c9a06f&role.id=d5b16024d5d9498693db3f2fb759bd14 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:39.892894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496586-88dd-47bd-8add-03b1c71143c1 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:39.893724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496586-88dd-47bd-8add-03b1c71143c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:39.893724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62496586-88dd-47bd-8add-03b1c71143c1 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:39.895972 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 565/1131] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:39.904813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:39.905341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:39.905497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:39.924391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:39.925636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:39.997237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 567/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:40.022072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62496586-88dd-47bd-8add-03b1c71143c1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:40.135488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62496586-88dd-47bd-8add-03b1c71143c1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:40.172068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:40.173388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:40.173888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:40.174364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:40.176445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:40.177951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c1b6d-1bcc-4afb-ba36-1a8510d2e508 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:40.179599 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 566/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:40.188894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:40.266599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:40.298408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181b69-7cb3-4aa3-be0a-f2bc16eb1f57 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:40.336464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:40.337153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:40.337436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:40.337715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:40.338434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:40.339878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34f8b-6285-47ee-a4d2-b64d1f31b250 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:40.373923 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 568/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:37:40 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:37:42.651396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd9133-b88a-4931-bd59-40f569361255 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.651930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd9133-b88a-4931-bd59-40f569361255 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.651930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd9133-b88a-4931-bd59-40f569361255 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.654144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 567/1135] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:42.659658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.660069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.660176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.678601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:42.679772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:42.750906 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 569/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:42.777440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd9133-b88a-4931-bd59-40f569361255 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:42.854612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:42.896465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd9133-b88a-4931-bd59-40f569361255 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:42.940888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:42.941606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.941884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.942151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.943539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:42.945044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6306a40-ab3d-4c0d-9a5f-bd05e50e7502 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:42.947738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 568/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:42.957281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:43.023035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:43.072885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae030bc-7f7a-4889-b094-d57497aa6418 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:43.109613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:43.110284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:43.110570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:43.110847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:43.111552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:43.113041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ed297-614e-4ecf-ae17-52805c7cbfb3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:43.134956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 570/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:37:42 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:45.443239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd99f-ea72-4e7f-b4a4-a6b46090807a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.444106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd99f-ea72-4e7f-b4a4-a6b46090807a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.444106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd99f-ea72-4e7f-b4a4-a6b46090807a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.446262 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 569/1139] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:45.454096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.454528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.454637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.480756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:45.482643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:45.551478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 571/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:45.586071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd99f-ea72-4e7f-b4a4-a6b46090807a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.698442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd99f-ea72-4e7f-b4a4-a6b46090807a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.732967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.733830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.734110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.734379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.737291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.745915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:45.753433 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:45.754559 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:45.758977 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 570/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:45.762982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.805278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.870265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce8f49-9479-4aa9-97cf-27708521f033 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.912199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.912920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.913205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.913480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.914229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:45.914534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:45.915927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:45.924881 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 572/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:45.931292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.034142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546d83-acd1-4670-af3a-012c72df5aad None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.066668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.067473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.067749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.068020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] PATH_INFO: `/v3/users/49ee68b603624308af6ee98531c80582` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.080877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] RBAC: Authorizing `identity:get_user(user_id=49ee68b603624308af6ee98531c80582)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.082307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.083958 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 571/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/users/49ee68b603624308af6ee98531c80582 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:46.093129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.195902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.200970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5965ff1-207e-4a2a-9916-72a013c27f93 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.239581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.240801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.241210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.241607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.342648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.344043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.450144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.454160 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 573/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:46.461103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.528557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.592880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a275cf-51e7-4565-98f9-2b488737b275 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.630264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.631120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.631403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.631677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] PATH_INFO: `/v3/projects/ac03921255a640f18dba2bfe598cb33b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.633006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] RBAC: Authorizing `identity:get_project(project_id=ac03921255a640f18dba2bfe598cb33b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.634467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e170e-c3a3-422f-bdb2-6f0ddb11439a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.636188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 572/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/projects/ac03921255a640f18dba2bfe598cb33b => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:46.646190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.762274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cd45-3f76-4d6d-97d2-6889b200742d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.797018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.797659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.797939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.798212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.799020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=ac03921255a640f18dba2bfe598cb33b, user.id=49ee68b603624308af6ee98531c80582) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:46.799329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.800797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc63a-c2da-410e-83f5-127f703745d9 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.806315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 574/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/role_assignments?user.id=49ee68b603624308af6ee98531c80582&scope.project.id=ac03921255a640f18dba2bfe598cb33b&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:49.057535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f3b-7a38-4165-8113-88c80b0506af None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.058448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f3b-7a38-4165-8113-88c80b0506af None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.058448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f3b-7a38-4165-8113-88c80b0506af None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.060619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 573/1147] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:49.067023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.067476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.067572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.094189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:49.095299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:49.155674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:49.165353 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 575/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:49.190843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21f3b-7a38-4165-8113-88c80b0506af None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:49.301265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21f3b-7a38-4165-8113-88c80b0506af None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:49.326815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:49.339730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:49.340565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.340845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.341126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.352271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:49.359792 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:49.361082 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:49.362327 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 574/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:49.367699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:49.483649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95ebda-7aa2-4ca4-bd40-1e36585bca27 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:49.527095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:49.527759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.528039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.528317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.529098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:49.529405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:49.530903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:49.539216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 576/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:49.548727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:49.665019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dc551-e25b-41a5-9d6b-2a3c29673047 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:49.701447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:49.702313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.702589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.702858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] PATH_INFO: `/v3/users/49ee68b603624308af6ee98531c80582` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.704171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] RBAC: Authorizing `identity:get_user(user_id=49ee68b603624308af6ee98531c80582)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:49.705636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:49.707316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 575/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:49 2022] GET /identity/v3/users/49ee68b603624308af6ee98531c80582 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:49.716892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:49.780777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:49.834840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91a34e-fbff-49ee-b78d-01de141cf92d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:49.868414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:49.869303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.869590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.869860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] PATH_INFO: `/v3/projects/ac03921255a640f18dba2bfe598cb33b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.871083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] RBAC: Authorizing `identity:get_project(project_id=ac03921255a640f18dba2bfe598cb33b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:49.872555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369503ce-af07-40a7-bb90-955c730bf0cc None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:49.874349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 577/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:49 2022] GET /identity/v3/projects/ac03921255a640f18dba2bfe598cb33b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:49.884207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:49.951374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:50.007482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b40d07-2e30-4801-a6ba-4cacdf69506e None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.042337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.043193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.043451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.043753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] PATH_INFO: `/v3/projects/ac03921255a640f18dba2bfe598cb33b/users/49ee68b603624308af6ee98531c80582/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.045929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] RBAC: Authorizing `identity:create_grant(project_id=ac03921255a640f18dba2bfe598cb33b, user_id=49ee68b603624308af6ee98531c80582, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.047347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2ad4-c738-4fb2-a915-e7afb58a617a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:50.062208 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 576/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:49 2022] PUT /identity/v3/projects/ac03921255a640f18dba2bfe598cb33b/users/49ee68b603624308af6ee98531c80582/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:37:52.315117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac99-38b3-4541-8a79-9cca9a668a17 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:52.315665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac99-38b3-4541-8a79-9cca9a668a17 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:52.315665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ac99-38b3-4541-8a79-9cca9a668a17 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:52.317074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 578/1154] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:52.322956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:52.323386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:52.323486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:52.342427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:52.343605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:52.413749 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 577/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:52.439634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ac99-38b3-4541-8a79-9cca9a668a17 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:52.568161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ac99-38b3-4541-8a79-9cca9a668a17 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:52.595076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:52.608116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:52.608953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:52.609238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:52.609513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:52.621497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:52.629145 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:52.630167 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:37:52.631169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 579/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:52.636585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:52.681634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:52.744991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff845-a295-4f10-bdbc-d9944cffcb6d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:52.781392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:52.782057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:52.782335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:52.782615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:52.783343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:52.783646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:52.785052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:52.794046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 578/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:52.800357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:52.905517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3d325-49d8-4644-be55-a40ebd9528d6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:52.940563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:52.941989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:52.942445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:52.942925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] PATH_INFO: `/v3/users/49ee68b603624308af6ee98531c80582` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:52.944271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] RBAC: Authorizing `identity:get_user(user_id=49ee68b603624308af6ee98531c80582)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:52.946276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:52.947908 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 580/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:37:52 2022] GET /identity/v3/users/49ee68b603624308af6ee98531c80582 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:52.954989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:53.072844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fae889-d602-4ffd-b03a-bf24586f144b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:53.074342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:53.110584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:53.111220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:53.111499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:53.111771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:53.187353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:53.188838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:53.290364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 579/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:53.296770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:53.352006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:53.399195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50328-c0e3-4175-a02b-d26106a5ff69 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:53.433865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:53.434711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:53.434990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:53.435257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] PATH_INFO: `/v3/projects/ac03921255a640f18dba2bfe598cb33b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:53.436562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac03921255a640f18dba2bfe598cb33b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:53.438001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06cedb-fc64-47d6-8c45-eeda7f24c7b1 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:53.440110 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 581/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:37:53 2022] GET /identity/v3/projects/ac03921255a640f18dba2bfe598cb33b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:53.449911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:53.452187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:53.562098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff1924-208e-48f5-9265-bbf49a1cf449 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:53.601760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:53.602474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:53.602695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:53.602970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:53.603789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=ac03921255a640f18dba2bfe598cb33b, user.id=49ee68b603624308af6ee98531c80582) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:53.604098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:53.605568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6565e2-38ec-44b9-9f18-d4032cedf155 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:53.611496 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 580/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:53 2022] GET /identity/v3/role_assignments?user.id=49ee68b603624308af6ee98531c80582&scope.project.id=ac03921255a640f18dba2bfe598cb33b&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:55.937171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6babf5-9624-49ee-aa1b-0413e64167af None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.937752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6babf5-9624-49ee-aa1b-0413e64167af None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.937752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6babf5-9624-49ee-aa1b-0413e64167af None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.939112 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 582/1162] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:55.944689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.945115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.945213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.963834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:55.965049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:56.028069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.041794 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 581/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:56.066250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6babf5-9624-49ee-aa1b-0413e64167af None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.175334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6babf5-9624-49ee-aa1b-0413e64167af None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.198347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.228699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.229737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.230534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.231003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.308143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.309673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.409428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 583/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:56.416413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.528947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e9164-a3bd-4dd9-9d3c-44e7e86a1f19 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.564948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.565739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.566018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.566289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.573333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.574777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-50dc860e-bc7c-4690-a317-18c08538f6bf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:56.589050 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:56.590105 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:37:56.591086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 582/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:56.597069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.618140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.708547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0358-317c-4cca-a475-c292847b9616 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.744625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.745277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.745559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.745837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.746559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:56.746865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.748275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591a03e-1d26-4504-87bf-2dc5ed55070f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.755446 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 584/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:59.030740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0838fc-c81e-4fe5-9d3d-433a5f862ecd None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.031570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0838fc-c81e-4fe5-9d3d-433a5f862ecd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.031570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0838fc-c81e-4fe5-9d3d-433a5f862ecd None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.033770 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 583/1167] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:37:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:59.041682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53339-b3fe-4558-be9f-7f0729ead072 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.042137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53339-b3fe-4558-be9f-7f0729ead072 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.042232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd53339-b3fe-4558-be9f-7f0729ead072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.061379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cbd53339-b3fe-4558-be9f-7f0729ead072 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:59.063186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cbd53339-b3fe-4558-be9f-7f0729ead072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:59.140792 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 585/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:37:59.176588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0838fc-c81e-4fe5-9d3d-433a5f862ecd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:59.237792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:59.296866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0838fc-c81e-4fe5-9d3d-433a5f862ecd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:59.334303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:59.334958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.335247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.335527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.336264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:59.337703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6f23-8fad-4d64-86d4-9d20f7d6888a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:59.354813 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 584/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Sat Jun 25 20:37:59 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:38:01.682622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f876-a201-4486-ac43-e13b912f0f5a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.683175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f876-a201-4486-ac43-e13b912f0f5a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.683175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7f876-a201-4486-ac43-e13b912f0f5a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.684810 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 586/1170] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:01.691641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.692363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.692556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.720004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:01.721626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:01.791793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 585/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:01.820414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7f876-a201-4486-ac43-e13b912f0f5a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.837197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:01.946829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7f876-a201-4486-ac43-e13b912f0f5a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.981779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.982770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.983047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.983320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] PATH_INFO: `/v3/domains/8dfcf7692d704d47bb22cd6bb57b2cca` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.994333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8dfcf7692d704d47bb22cd6bb57b2cca)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.995795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89aedc-ba07-497d-aa32-fbc8c4b0c6b6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.997458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 587/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Jun 25 20:38:01 2022] GET /identity/v3/domains/8dfcf7692d704d47bb22cd6bb57b2cca => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:02.006728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:02.056656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:02.114565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b044-bcd0-43b7-b4de-b5590c81148b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:02.148820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:02.149475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:02.149762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:02.150040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:02.150745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:02.152183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55b9d-20ba-426c-922b-e0b1e43edc2a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:02.186800 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 586/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:38:02 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:38:04.500636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8391-82ac-4eb8-940e-a7846e995f6f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.501480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8391-82ac-4eb8-940e-a7846e995f6f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.501480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8391-82ac-4eb8-940e-a7846e995f6f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.503646 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 588/1174] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:04.511594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.512044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.512155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.531597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:04.532860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:04.606168 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 587/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:38:04.632350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8391-82ac-4eb8-940e-a7846e995f6f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.715365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.753086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8391-82ac-4eb8-940e-a7846e995f6f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.788154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.789041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.789315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.789586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] PATH_INFO: `/v3/domains/8dfcf7692d704d47bb22cd6bb57b2cca` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.790815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8dfcf7692d704d47bb22cd6bb57b2cca)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:04.792276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eae9a-ff55-409c-8a37-3ca0ebc5dc70 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:04.793968 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 589/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/domains/8dfcf7692d704d47bb22cd6bb57b2cca => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:04.802947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.833906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.909159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeb315-bef7-4ceb-943b-c4c6a457846d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.946235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944838-294d-4830-a4ca-6da923af087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.946902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944838-294d-4830-a4ca-6da923af087e None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.947185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944838-294d-4830-a4ca-6da923af087e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.947462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944838-294d-4830-a4ca-6da923af087e None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.948177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944838-294d-4830-a4ca-6da923af087e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:04.949684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944838-294d-4830-a4ca-6da923af087e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:04.974760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 588/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:38:04 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:38:07.282979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d10d-f8ea-49e9-b652-5fb7d07d12a0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:07.283865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d10d-f8ea-49e9-b652-5fb7d07d12a0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:07.283865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d10d-f8ea-49e9-b652-5fb7d07d12a0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:07.286154 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 590/1178] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:07.293122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:07.293835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:07.294000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:07.313785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:07.314993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:07.388369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 589/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:07.425823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406d10d-f8ea-49e9-b652-5fb7d07d12a0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:07.539330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406d10d-f8ea-49e9-b652-5fb7d07d12a0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:07.574550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:07.575344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:07.575619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:07.575920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:07.593291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:38:07.601184 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:07.602308 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:38:07.603292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 591/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:38:07.609110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:07.633038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:07.728506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6627ea-9eab-4695-98ea-a72eaba69fb0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:07.765394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:07.766049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:07.766340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:07.766610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:07.767328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:07.767631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:07.769112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:07.777146 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 590/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:07.783907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:07.787172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:07.885201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d87-c421-4634-b63a-7d28be336249 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:07.920350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:07.921246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:07.921527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:07.921798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] PATH_INFO: `/v3/users/b9c8a1155f5740e7a09dd31594e76d39` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:07.935310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] RBAC: Authorizing `identity:get_user(user_id=b9c8a1155f5740e7a09dd31594e76d39)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:07.936811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:07.938459 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 592/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:38:07 2022] GET /identity/v3/users/b9c8a1155f5740e7a09dd31594e76d39 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:07.944459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:08.025588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:08.056629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569be1-83d0-4238-bb8e-a16eaf7ace4f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:08.091722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:08.092296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.092606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.092866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.164900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:08.166361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:08.243392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:08.270085 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 591/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:38:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:38:08.276223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:08.340338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:08.384105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1af21-b328-4b9a-97be-a78103d8de69 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:08.422401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:08.423745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.424206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.424711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] PATH_INFO: `/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.426780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=fbe415014f3a4e5aa65d335ea0a4e1fb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:08.429214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115eabc-b048-4bae-8b20-79c89fe81dd5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:08.431965 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 593/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:38:08 2022] GET /identity/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:08.439473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:08.539562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd34e0-62e9-4545-aa35-94684385dfdd None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:08.578105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:08.579063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.579462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.579828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.581143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=fbe415014f3a4e5aa65d335ea0a4e1fb, user.id=b9c8a1155f5740e7a09dd31594e76d39) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:08.581584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:08.583794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881db7-74f8-4d45-bb09-1b7a30ca4d98 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:08.592493 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 592/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:38:08 2022] GET /identity/v3/role_assignments?user.id=b9c8a1155f5740e7a09dd31594e76d39&scope.project.id=fbe415014f3a4e5aa65d335ea0a4e1fb&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:10.867770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71cd0-47f8-4905-9329-0fb332fea0a5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.868345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71cd0-47f8-4905-9329-0fb332fea0a5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.868345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71cd0-47f8-4905-9329-0fb332fea0a5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.869716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 594/1186] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:10.876412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.877187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.877350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.904466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:10.905667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:10.948151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:10.984185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 593/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:11.025471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a71cd0-47f8-4905-9329-0fb332fea0a5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:11.155867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a71cd0-47f8-4905-9329-0fb332fea0a5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:11.185629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:11.194888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:11.195705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:11.195991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:11.196272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:11.207032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:38:11.214720 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:11.215887 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:38:11.216969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 595/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:11.223313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:11.332986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a717e-98bf-4d4d-8cd2-48a0304fa893 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:11.370081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:11.370753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:11.371036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:11.371312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:11.372058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:11.372365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:11.373862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:11.382571 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 594/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:11.391412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:11.498151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e569-27fc-4118-af4c-1f7a72e0865d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:11.532032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:11.532949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:11.533231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:11.533507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] PATH_INFO: `/v3/users/b9c8a1155f5740e7a09dd31594e76d39` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:11.534694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=b9c8a1155f5740e7a09dd31594e76d39)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:11.536147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:11.537770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 596/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:38:11 2022] GET /identity/v3/users/b9c8a1155f5740e7a09dd31594e76d39 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:11.544345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:11.580872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:11.656437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cc81-29bd-4cd2-812b-b0275eee8d92 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:11.691335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:11.692196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:11.692480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:11.692785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] PATH_INFO: `/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:11.694021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] RBAC: Authorizing `identity:get_project(project_id=fbe415014f3a4e5aa65d335ea0a4e1fb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:11.695468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845af071-357e-4c36-85a0-a22e32a9b5cc None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:11.697223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 595/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:38:11 2022] GET /identity/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:11.703722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:11.772196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:11.818768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db47c-8312-45d8-8f8a-c93635dc1cc6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:11.857667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:11.858547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:11.858825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:11.859092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] PATH_INFO: `/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb/users/b9c8a1155f5740e7a09dd31594e76d39/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:11.861086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] RBAC: Authorizing `identity:create_grant(project_id=fbe415014f3a4e5aa65d335ea0a4e1fb, user_id=b9c8a1155f5740e7a09dd31594e76d39, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:11.862522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fbc2d-a433-4da0-95f7-b4d17997f5ba None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:11.879716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 597/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:38:11 2022] PUT /identity/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb/users/b9c8a1155f5740e7a09dd31594e76d39/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:38:14.150051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff3ed-0761-42ed-a09b-80b71f2bf0cd None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.150879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff3ed-0761-42ed-a09b-80b71f2bf0cd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.150879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff3ed-0761-42ed-a09b-80b71f2bf0cd None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:14.153144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 596/1193] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:14.158686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.159117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.159213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:14.177455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:14.178649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:14.252227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 598/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:14.276937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fff3ed-0761-42ed-a09b-80b71f2bf0cd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:14.387592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:14.394495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fff3ed-0761-42ed-a09b-80b71f2bf0cd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:14.433470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:14.434190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.434465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.434796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:14.445984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:38:14.453460 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:14.454519 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:38:14.455937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 597/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:14.464270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:14.512085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:14.570426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8fa51-b338-42d2-a415-0454338612a6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:14.606401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:14.607096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.607380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.607660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:14.608456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:14.608769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:14.610170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:14.618237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 599/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:14.625053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:14.746462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d585b-490d-4bc2-939c-01049b5353df None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:14.784922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:14.786210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.786582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.786973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] PATH_INFO: `/v3/users/b9c8a1155f5740e7a09dd31594e76d39` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:14.788864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] RBAC: Authorizing `identity:get_user(user_id=b9c8a1155f5740e7a09dd31594e76d39)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:14.791079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:14.793621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 598/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 25 20:38:14 2022] GET /identity/v3/users/b9c8a1155f5740e7a09dd31594e76d39 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:14.802698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:14.912038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f0a4-fed6-4869-9858-61f12b51e8f3 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:14.921195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:14.951057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:14.951704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:14.951984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:14.952257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:15.023575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:15.025001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:15.132315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 600/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:38:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:38:15.139365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:15.169913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:15.242516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcd6d1-4bab-4049-846d-6bea7fd65414 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:15.277368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:15.278157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:15.278514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:15.278793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] PATH_INFO: `/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:15.279983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] RBAC: Authorizing `identity:get_project(project_id=fbe415014f3a4e5aa65d335ea0a4e1fb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:15.281453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c9d9-3776-4341-8e2f-2471091d4361 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:15.283138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 599/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 25 20:38:15 2022] GET /identity/v3/projects/fbe415014f3a4e5aa65d335ea0a4e1fb => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:15.289669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:15.301020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:15.401465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07893a97-611e-4147-9b5d-838cc3d18ceb None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:15.438720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:15.439371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:15.439652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:15.439923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:15.440776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=fbe415014f3a4e5aa65d335ea0a4e1fb, user.id=b9c8a1155f5740e7a09dd31594e76d39) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:15.441087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:15.442534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd028c22-f548-406e-b4a9-66c29f214550 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:15.448461 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 601/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:38:15 2022] GET /identity/v3/role_assignments?user.id=b9c8a1155f5740e7a09dd31594e76d39&scope.project.id=fbe415014f3a4e5aa65d335ea0a4e1fb&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:25.272660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=52 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:25.445756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=64 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:17.453053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56ec5-44ea-4c43-bcbb-31e4b12cef4b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:17.453642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56ec5-44ea-4c43-bcbb-31e4b12cef4b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:17.453642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56ec5-44ea-4c43-bcbb-31e4b12cef4b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:17.454980 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 600/1201] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:39:17.460308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:17.460808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:17.460910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:17.492629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:17.494413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:17.588949 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 602/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:39:17.617800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c56ec5-44ea-4c43-bcbb-31e4b12cef4b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:17.752619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c56ec5-44ea-4c43-bcbb-31e4b12cef4b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:17.807727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:17.809206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:17.809604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:17.809786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:17.824768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:17.826416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:17.849302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:17.850488 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:17.851933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:17.851933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:17.851933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:17.851933 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:17.851933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 601/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:17.857638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:17.999710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947cb9-f8fc-4e32-be5a-34ccef2be434 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:18.038871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:18.045828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:18.046551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:18.046905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:18.047121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:18.048221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:18.048706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:18.050941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570afb7-cedf-41cf-98ff-75cc23aef333 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:18.072576 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 603/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:18.074464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:18.146372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:18.215533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24b07-b185-4252-95d1-678d29351708 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:18.258548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:18.259462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:18.259750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:18.260026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:18.260913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:18.262652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48e0a0-326c-468f-bfe1-3e6f495834d6 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:18.288052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 602/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 25 20:39:18 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:39:20.805442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb433-765d-43bf-aa7d-bab8b0503b7a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:20.805442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb433-765d-43bf-aa7d-bab8b0503b7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:20.805442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfb433-765d-43bf-aa7d-bab8b0503b7a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:20.806603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 604/1206] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:20.811279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:20.812327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:20.813062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:20.835642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:20.839887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:20.918430 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 603/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:20.946141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfb433-765d-43bf-aa7d-bab8b0503b7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.058332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfb433-765d-43bf-aa7d-bab8b0503b7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:21.095858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:21.096719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.097003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.097277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.109439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:21.117817 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:21.118879 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:21.119730 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 605/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:21.126104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.169328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:21.241106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da4ff-bb2b-4374-a7d6-03d8b7ea2adb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:21.280252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:21.280993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.281407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.281686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.282476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:21.282908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:21.284350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:21.293033 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 604/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:21.299161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.360174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:21.417917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13ddbe-5ede-403b-83f1-44674d6cbf1b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:21.453417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:21.454229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.454522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.454780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.465246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:21.466727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:21.486751 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:21.487732 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:21.488690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:21.488690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:21.488690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:21.488690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:21.488690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 606/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:21.494405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.614447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:21.617311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdda05c-9132-4525-870b-735d73c73b07 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:21.652735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:21.653403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.653688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.653962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.654685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:21.654991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:21.656372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:21.673675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 605/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:21.675019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.794561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412007-603a-4740-a8ba-c817716a4ead None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:21.797133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:21.837859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:21.838791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.839084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.839719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] PATH_INFO: `/v3/users/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.848929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:21.850870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:21.872682 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:21.873709 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:21.874663 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 607/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:21.879752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:21.995164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8262a-279b-4b36-a86d-abb12db7c466 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.036657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.037338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.037621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.037962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.038778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:22.039052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.040625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:22.061007 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 606/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:22.064713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:22.180121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82515c57-a8dd-4219-836c-58a8c62dcdde None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.218214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.218869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.219152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.219422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.255805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:22.295756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.297802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:22.423137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 608/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:39:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:39:22.429634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:22.452111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:22.551968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350ff4-c84f-4e4f-967f-2c2a1c97a193 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.588689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.589909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.590354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.590931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.603310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.606358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:22.629501 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:22.630778 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:22.631843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:22.631843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:22.631843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:22.631843 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:22.633492 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 607/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:22.641345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:22.718795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:22.772459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f64a20-0a27-44ea-91d8-0d31cbf7498b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.820492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.821297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.821721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.822098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.822917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:22.823325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.824917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:22.837019 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 609/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:22.842877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:22.916985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:22.949213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff47d8-a9df-4a71-8af5-2ffc5ebb6855 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.986412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.987300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.987683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.988057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.994889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.996547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:23.010925 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:23.012072 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:23.013209 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:23.014875 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 608/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:23.020726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:23.132308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213876a-6a73-4ee9-9140-3f999a6ff89a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:23.161970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:23.174292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:23.174994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:23.175286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:23.175542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:23.176320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:23.176657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:23.178099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b1aeb-1c14-446e-91b1-1e82764c99ea None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:23.196592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 610/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:23.197841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:23.326263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79318fac-6d6e-475c-ae8f-36facdc83a8d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:23.366337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:23.372643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:23.373307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:23.373586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:23.373856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:23.374678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=237820e4132b4e65898c330ae2240d20) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:23.374987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:23.376503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b5e05-a2c6-48dd-8690-c072d620379a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:23.382193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 609/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:39:23 2022] GET /identity/v3/role_assignments?user.id=237820e4132b4e65898c330ae2240d20&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:25.706832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a4-a67c-4b01-94d7-b77827429e27 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:25.707455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a4-a67c-4b01-94d7-b77827429e27 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:25.707455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a4-a67c-4b01-94d7-b77827429e27 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:25.709040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 611/1220] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:25.714939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:25.715394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:25.715569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:25.733271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:25.734479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:25.818471 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 610/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:25.843327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a80a4-a67c-4b01-94d7-b77827429e27 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:25.960901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a80a4-a67c-4b01-94d7-b77827429e27 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:25.996682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:25.997562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:25.997849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:25.998129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.011022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:26.019007 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:26.019959 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:26.020876 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 612/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:26.028231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:26.145390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ec23-13ec-486d-bfd5-d3262d611cbe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:26.171277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:26.184451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:26.185162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:26.185422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:26.185747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.186570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:26.186915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:26.188453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:26.202831 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 611/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:26.204029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:26.251779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:26.318833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4956523-cfb4-4742-804b-fb792f1cc791 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:26.364649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:26.365737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:26.366171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:26.366581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.377626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:26.379357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:26.396863 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:26.397813 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:26.399407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:26.399407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:26.399407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:26.399407 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:26.399407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 613/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:39:26.404175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:26.560219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007f60a-4de7-42f5-afb4-215245ee5a82 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:26.597460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:26.598139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:26.598524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:26.598724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.599420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:26.599734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:26.601131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:26.613914 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 612/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:26.619439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:26.738952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:26.747865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45533e7f-3cb7-425c-8a08-f4616ce29c0b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:26.787237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:26.788578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:26.788892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:26.789124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] PATH_INFO: `/v3/users/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.797752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:26.799269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:26.815516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:26.816593 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:26.817578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 614/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:26.823361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:26.893691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:26.952479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a378-51b5-470e-8923-8038f94ce539 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:26.989906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:26.990647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:26.990956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:26.991265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:26.992148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:26.992543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:26.994119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.014329 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 613/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:27.020342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.144348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fff9-fec5-4f5e-b36d-0eb68578556a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.183296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.184105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.184385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.184702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.197664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.199325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:27.219150 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:27.220569 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:27.221653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:27.221653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:27.221653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:27.221653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:27.221653 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 615/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:27.227516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.344646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772485ff-d0c2-49d2-bb4e-c1a728235fab None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.347719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:27.380913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.381582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.381862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.382136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.382860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:27.383156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.384550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.397259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 614/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:27.404233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.415741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:27.520368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa721-d47f-466a-b1fd-5475367cade6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.561090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.561899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.562174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.562438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.569271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.570910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:27.584896 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:27.586653 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:27.587536 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 616/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:27.591988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.698946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e0364-61af-455e-8780-da63b97dc19a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.739296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.740389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.740882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.741303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.742204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:27.742591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.744038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a24fb2-4ff6-4095-ab7b-b9a16870d7e0 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.759694 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 615/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:27.770125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.844207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:27.882667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183ebb-fa6f-460a-b4d5-112c9c2303e0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.919163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.920067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.920561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.920841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/237820e4132b4e65898c330ae2240d20/roles/1c5e16c4c2704ba3955b8e2bddae1292` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.935448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=237820e4132b4e65898c330ae2240d20, role_id=1c5e16c4c2704ba3955b8e2bddae1292)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.936963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02133fdb-ccf1-4a2f-be88-c3edf1771a44 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.951752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 617/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:39:27 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/237820e4132b4e65898c330ae2240d20/roles/1c5e16c4c2704ba3955b8e2bddae1292 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:39:30.219763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a947127-0a7a-4590-bf5e-d035045ab517 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.220715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a947127-0a7a-4590-bf5e-d035045ab517 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.220715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a947127-0a7a-4590-bf5e-d035045ab517 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.222033 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 616/1233] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:30.227411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.227862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.227953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.245713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:30.247221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:30.327255 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 618/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:30.353030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a947127-0a7a-4590-bf5e-d035045ab517 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:30.379187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:30.464032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a947127-0a7a-4590-bf5e-d035045ab517 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:30.506890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:30.507817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.508101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.508381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.522010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:30.530632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:30.531692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:30.532825 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 617/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 25 20:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:30.538104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:30.584391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:30.642988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa822b-8087-4704-9672-3e96b85ba9a3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:30.681958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:30.682673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.682937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.683215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.683976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] RBAC: Adding query filter params (name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:30.684286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:30.685748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:30.699638 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 619/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 25 20:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:30.700930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:30.793713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:30.811886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1e005-0073-4814-822c-00cd268d1c76 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:30.852357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:30.853199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.853509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.853755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.865058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:30.867291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:30.885306 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:30.886470 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:30.887473 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:30.887473 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:30.887473 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:30.887473 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:30.887473 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 618/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:30.892897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:30.994794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418c7c-110a-40d4-895a-8bc88f52f33a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:31.004780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:31.030216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:31.030894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:31.031213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:31.031484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:31.032221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:31.032619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:31.034030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:31.045640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 620/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:31.051747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:31.154678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32156c6a-834d-49b0-86c1-842614d2bf35 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:31.188707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:31.189522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:31.189800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:31.190071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:31.192937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:31.198803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:31.200306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:31.216395 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:31.217576 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:31.218743 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 619/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:31.224189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:31.332273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66733f81-b90b-4c9a-8e0d-fea6c040922c None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:31.368859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:31.369542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:31.369824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:31.370104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:31.370926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:31.371231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:31.372733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:31.392576 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 621/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:31.397940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:31.511434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378006-afd0-4d3b-8715-bf0163e2f431 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:31.552722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:31.554955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:31.555261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:31.555577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:31.626836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:31.634013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:31.635569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:31.747493 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 620/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:39:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:39:31.754318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:31.786140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:31.865266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fa5e5-7b09-4f19-9a28-15e84a7dfe2a None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:31.901737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:31.902759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:31.903146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:31.903415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:31.913787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:31.915249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:31.933049 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:31.934286 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:31.935197 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:31.935197 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:31.935197 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:31.935197 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:31.935197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 622/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:31.940295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:32.046647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:32.053693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450d6d-22cd-4788-bc66-a2fdb0638842 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:32.089174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:32.089848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:32.090131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:32.090409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:32.091124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:32.091433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:32.092849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:32.104618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 621/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:32.111040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:32.199911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:32.222479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f81c1-aa2d-4efa-bf02-a762a1295c0e None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:32.260977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:32.261841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:32.262118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:32.262393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:32.269281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:32.270754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:32.286009 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:32.287070 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:32.293345 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 623/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:32.293934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:32.410584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182036e-b6da-49b3-b103-180626b26378 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:32.450717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:32.451302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:32.451583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:32.451858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:32.452677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:32.452990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:32.454512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d64cf-28bd-4b52-a3ee-5371672dc888 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:32.467518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 622/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:32.475893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:32.600229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999c99-d739-4722-9a47-45c21b2193e6 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:32.643811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:32.644526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:32.644793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:32.645063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:32.645897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] RBAC: Adding query filter params (role.id=1c5e16c4c2704ba3955b8e2bddae1292, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=237820e4132b4e65898c330ae2240d20) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:32.646211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:32.648223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203683dd-33c3-42eb-8581-a4b695468c6a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:32.656732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 624/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:39:32 2022] GET /identity/v3/role_assignments?user.id=237820e4132b4e65898c330ae2240d20&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=1c5e16c4c2704ba3955b8e2bddae1292 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:35.225987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdbde1-1ac8-4f9e-8f12-c325b43ca8e7 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:35.226581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdbde1-1ac8-4f9e-8f12-c325b43ca8e7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:35.226581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdbde1-1ac8-4f9e-8f12-c325b43ca8e7 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:35.228177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 623/1247] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:35.236587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:35.237126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:35.237126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:35.243063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:35.258041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:35.259345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:35.348117 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 625/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:35.377794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdbde1-1ac8-4f9e-8f12-c325b43ca8e7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:35.400120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:35.503160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdbde1-1ac8-4f9e-8f12-c325b43ca8e7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:35.552402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:35.553238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:35.553561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:35.554044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:35.568615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:35.579442 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:35.580799 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:35.581854 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:35.587450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 624/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:35.588579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:35.707424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae9f4-cbdc-41ca-bc6d-bedc8629750e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:35.741963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:35.747457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:35.748141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:35.748435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:35.748722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:35.749474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:35.749782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:35.751360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:35.760881 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 626/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:35.767323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:35.859622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:35.884007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dda853-1fce-4a54-ac9e-2562ee4315c7 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:35.923897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:35.924863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:35.925201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:35.925507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:35.937327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:35.938823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:35.959147 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:35.960601 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:35.961766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:35.961766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:35.961766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:35.961766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:35.961766 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 625/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:35.966563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.070797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de998e7-0efc-4812-b812-e8d45bee54c8 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.106841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.107575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.107874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.108084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.109037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:36.109351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.110915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:36.125090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 627/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:36.130926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.245081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791300a-1f02-4d01-a9ff-8898edf67713 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.275206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:36.284932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.285853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.286184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.286492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.296142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.297892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:36.313468 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:36.314631 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:36.315867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 626/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:36.321028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.382872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:36.433082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae98df-0436-40d2-b203-1a0106546d80 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.469521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.470660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.470987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.471454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.472354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:36.472732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.474600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:36.496788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 628/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:36.502693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.607418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fc8e8-6abb-439f-80f2-2cbe8954ba71 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.643020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.643608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.643886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.644159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.709784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:36.723152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.724772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:36.832390 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 627/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:39:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:39:36.839097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.943677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd95f3-9b38-4ebd-a838-4052bf4b9888 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.958274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:36.981765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.982575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.982857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.983133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.993892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.995396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:37.015354 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:37.016531 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:37.017937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:37.017937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:37.017937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:37.017937 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:37.017937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 629/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:37.022596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:37.117534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:37.129906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71ee4-a986-4f0d-8d5b-947151aaa055 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:37.169087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:37.169754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:37.170032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:37.170335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:37.171023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:37.171327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:37.172749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:37.184442 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 628/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:37.190505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:37.297155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac475c-389f-4df7-85f0-2aef8e264eaf None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:37.332994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:37.333863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:37.334078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:37.334350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:37.343818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:37.345691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:37.362532 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:37.363686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:37.364652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 630/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:37.370006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:37.481530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad502-b2e8-475c-863c-23442fd79ead None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:37.526396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:37.527375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:37.527765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:37.528070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:37.529162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:37.529600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:37.531273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ebc34-9344-4262-9a03-93e9136d3882 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:37.552070 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 629/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:37.558446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:37.586202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:37.668954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec588d-0203-4006-a699-0b7b6b9616ae None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:37.706781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:37.707455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:37.707739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:37.708015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:37.708904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=237820e4132b4e65898c330ae2240d20) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:37.709219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:37.710684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dca15-77b6-4c71-aafb-6d8d2c39f0db None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:37.716983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 631/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:39:37 2022] GET /identity/v3/role_assignments?user.id=237820e4132b4e65898c330ae2240d20&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:39.968883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b004ed-3da4-4a6a-b1c3-a7cf8e1f0b8a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:39.969715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b004ed-3da4-4a6a-b1c3-a7cf8e1f0b8a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:39.969813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b004ed-3da4-4a6a-b1c3-a7cf8e1f0b8a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:39.972205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 630/1261] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:39.977775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:39.978210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:39.978301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:39.999185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:40.000379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:40.067339 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 632/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:40.091758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b004ed-3da4-4a6a-b1c3-a7cf8e1f0b8a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:40.109452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:40.211996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b004ed-3da4-4a6a-b1c3-a7cf8e1f0b8a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:40.249628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:40.250405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:40.250684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:40.250957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:40.263040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:40.271044 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:40.272088 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:40.273313 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 631/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:40.278480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:40.298722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:40.387974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8aa93-7827-4d27-9643-cecc47384080 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:40.435108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:40.435785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:40.436068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:40.436338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:40.437121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:40.437426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:40.438822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:40.448210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 633/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:40.454497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:40.524403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:40.561182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6694b-6f8e-4c2d-b392-a7fad7807271 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:40.596697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:40.597493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:40.597773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:40.598054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:40.610240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:40.611701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:40.630900 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:40.631930 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:40.633729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:40.633729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:40.633729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:40.633729 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:40.633729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 632/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:40.638698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:40.733410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:40.757537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbc26-8326-405f-8281-c49c304cfb6d None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:40.796603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:40.797273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:40.797553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:40.797826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:40.798552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:40.798861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:40.800245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:40.813555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 634/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:40.819312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:40.929284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e832df-d2d8-4af5-b37e-96c5857b7e5d None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:40.951889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:40.967920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:40.968753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:40.969043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:40.969619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:40.977911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:40.979372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:40.993779 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:40.994817 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:40.995776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 633/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:41.001034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.106379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e361f0-11d1-4e44-a1fe-964f8d0c3956 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:41.144988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:41.145644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.145933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.146211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.147039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:41.147347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:41.148819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:41.157529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:41.167297 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 635/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:41.173359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.290186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512a55-e417-4dd2-b04b-092121728d3a None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:41.332110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:41.332927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.333208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.333480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.344451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:41.346224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:41.363435 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:41.364414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:41.365360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:41.365360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:41.365360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:41.365360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:41.365360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 634/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:41.372449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.614981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eb026-9926-41c2-8b3e-aa48da287e9b None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:41.651253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:41.651920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.652180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.652517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.653220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:41.653519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:41.654890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:41.666307 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 636/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:41.672237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.707382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:41.778536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3dd0e-98ef-4b8a-bcd6-fabd8db0cb7b None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:41.820921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:41.822038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.822038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.822243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.830178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:41.831624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:41.846223 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:41.847276 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:41.848461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 635/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:41.853267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.914316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:41.960960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a183e-3fb9-4c3d-9449-f2c073d966d5 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:42.000357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:42.001052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:42.001626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:42.001626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:42.002372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:42.002683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:42.004136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3e20-a912-4d88-94a4-6a608530fc53 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:42.016339 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 637/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:42.025204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:42.133407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:42.143071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6321-2a3c-48c0-afd3-45cb034f26ff None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:42.179298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:42.180116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:42.180396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:42.180708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] PATH_INFO: `/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/237820e4132b4e65898c330ae2240d20/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:42.182750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e42207f22245d5b512d5a5e7be5fa7, user_id=237820e4132b4e65898c330ae2240d20, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:42.184280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf257-3e12-4a9c-8678-51ce0182627a None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:42.200799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 636/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 25 20:39:42 2022] PUT /identity/v3/projects/a6e42207f22245d5b512d5a5e7be5fa7/users/237820e4132b4e65898c330ae2240d20/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:39:44.457968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00142e-b950-476a-8167-1c6236546486 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.458875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00142e-b950-476a-8167-1c6236546486 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.458875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00142e-b950-476a-8167-1c6236546486 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.461042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 638/1274] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:44.466570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.466987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.467127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.489024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:44.490813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:44.569205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 637/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:44.596274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00142e-b950-476a-8167-1c6236546486 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:44.703465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00142e-b950-476a-8167-1c6236546486 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:44.721459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:44.742972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:44.743767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.744049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.744327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.754736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:39:44.762528 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:44.763609 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:44.764883 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 639/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 25 20:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:44.773467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:44.870884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:44.892043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f7dfb-750a-44ae-a276-219846aa9f1a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:44.926653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:44.927316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.927598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.927875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.928649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:44.928955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:44.930340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:44.938515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 638/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 25 20:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:44.944452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:45.050717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ecd0a-f310-4b0a-9a05-a7abdc8acba0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:45.085893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:45.086682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:45.086966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:45.087242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:45.099211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:45.100694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:45.118497 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:45.119577 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:45.120520 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:45.120520 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:45.120520 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:45.120520 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:45.120520 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 640/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:45.128515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:45.240843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b60b-f2d9-4383-882d-d24d47c13bc1 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:45.275336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:45.275985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:45.276268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:45.276575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:45.277336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:45.277639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:45.279004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:45.290902 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 639/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:45.296917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:45.342525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:45.415585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f89f0-dacf-4977-ab3a-d04a59544350 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:45.450848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:45.451641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:45.451922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:45.452195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:45.459917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:45.461403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:39:45.477356 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:45.478574 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:45.479553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 641/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:45.486703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:45.490834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:45.602446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022573d2-9ea4-4a45-81da-4f1cc70aaeb4 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:45.638491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:45.639155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:45.639442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:45.639718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:45.640581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:45.640891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:45.642326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:45.659542 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 640/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 25 20:39:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:45.665464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:45.760180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:45.770419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c977-abcd-4cf9-aacf-7c60c891b985 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:45.805403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:45.806055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:45.806333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:45.806575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:45.889263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:45.890660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:45.981132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:45.991680 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 642/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 25 20:39:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:39:45.997853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:46.064158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:46.105944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1b8b-9796-436a-b47d-9f00ba03420f None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:46.140532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:46.141258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:46.141539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:46.141810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:46.152325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:46.153784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:39:46.173600 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:46.174680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:46.175713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:39:46.175713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:39:46.175713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:39:46.175713 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:46.175713 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 641/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:46.180366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:46.281380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa789-39b5-4959-8a65-3381a74c8140 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:46.315111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:46.315749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:46.316029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:46.316291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:46.317024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:46.317322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:46.318674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:46.329721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 643/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 25 20:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:46.335960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:46.455297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa673578-fc09-42c1-b048-7e3c3ff0ee20 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:46.470078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:46.497838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:46.498639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:46.498918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:46.499195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:46.506440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:46.507920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:39:46.522345 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:46.523389 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:39:46.524451 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 20:39:46.528414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 642/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 25 20:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:46.529561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:46.580307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:46.634419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d0ea4-b1b6-4e07-8856-05d138537eac None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:46.668741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:46.669397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:46.669678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:46.669950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:46.670728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:46.671041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:46.672464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663032-758d-498f-9914-fcd3f88be4cf None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:46.684595 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 644/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 25 20:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:46.691095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:46.798263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378255d-86d8-414e-9d46-bc1959d02281 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:46.833213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:46.833864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:46.834141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:46.834411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:46.835237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] RBAC: Adding query filter params (role.id=54803232909643ca80ca0cfb291c7f49, scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7, user.id=237820e4132b4e65898c330ae2240d20) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:46.835547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:46.837011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a34913-f0a2-493b-8599-b260778a6e32 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:46.843046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 643/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 25 20:39:46 2022] GET /identity/v3/role_assignments?user.id=237820e4132b4e65898c330ae2240d20&scope.project.id=a6e42207f22245d5b512d5a5e7be5fa7&role.id=54803232909643ca80ca0cfb291c7f49 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:49.130178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904478-d5d0-4a36-b3ba-66d969483d8b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:49.130707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904478-d5d0-4a36-b3ba-66d969483d8b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:49.130707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904478-d5d0-4a36-b3ba-66d969483d8b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:49.132666 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 645/1288] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:49.141145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:49.141558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:49.141735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:49.163567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:49.164814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:49.196232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:49.239529 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 644/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:49.263218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de904478-d5d0-4a36-b3ba-66d969483d8b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:49.372324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de904478-d5d0-4a36-b3ba-66d969483d8b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:49.382803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:49.407382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:49.408169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:49.408398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:49.408734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:49.409374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:49.410749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:49.422861 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:49.424018 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:49.425037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 646/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:39:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:49.429980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:49.541437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e559d9-508a-4568-ac98-8b9b31b6548b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:49.577076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:49.577739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:49.578024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:49.578304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:49.579009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:49.579318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:49.580731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4e00-6edf-4a64-a370-84af235a8d1c None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:49.585738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 645/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 25 20:39:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:39:49.591973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:49.695997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496539df-7069-439f-b584-949e1dfc32e2 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:49.731320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:49.731964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:49.732243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:49.732559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:49.733252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] RBAC: Adding query filter params (type=placement) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:49.733558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:49.734932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2155b56-a6a4-4019-94b2-d1b11780d4bb None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:49.739527 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 647/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 25 20:39:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:52.002927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc97d90-3209-423f-b85b-b1cb2a8901c9 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:52.003760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc97d90-3209-423f-b85b-b1cb2a8901c9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:52.003760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc97d90-3209-423f-b85b-b1cb2a8901c9 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:52.005701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 646/1293] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:52.011101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8383-8e13-4807-b129-7fa1e91070d4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:52.011534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8383-8e13-4807-b129-7fa1e91070d4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:52.011717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8383-8e13-4807-b129-7fa1e91070d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:52.030409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d1ff8383-8e13-4807-b129-7fa1e91070d4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:52.031579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d1ff8383-8e13-4807-b129-7fa1e91070d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:52.061646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:52.101850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 648/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:52.126428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc97d90-3209-423f-b85b-b1cb2a8901c9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:52.168360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:52.240138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc97d90-3209-423f-b85b-b1cb2a8901c9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:52.275401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:52.276039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:52.276294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:52.276624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:52.277361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:52.278718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67cefd-8e15-4ec9-823d-a34040a53ef1 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:52.295446 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 647/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 25 20:39:52 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:39:54.590938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb06e-7202-4443-8f70-e03efb83ed98 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.591828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb06e-7202-4443-8f70-e03efb83ed98 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.591828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb06e-7202-4443-8f70-e03efb83ed98 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.594001 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 649/1296] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:54.600634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.601394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.601522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.620951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:54.622138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:54.714008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 648/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:54.739218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbb06e-7202-4443-8f70-e03efb83ed98 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:54.852321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbb06e-7202-4443-8f70-e03efb83ed98 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:54.886428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:54.887230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.887514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.887788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] PATH_INFO: `/v3/services/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.888473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:54.889849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:54.902168 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:54.903265 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:54.904973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 650/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:39:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:54.911993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:54.939700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:55.022358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846accd-16ef-49b7-8109-93043a6d33ba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:55.058034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:55.058738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:55.059022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:55.059285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:55.059980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:55.060289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:55.061718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:55.067463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 649/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 25 20:39:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:55.074284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:55.113653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:55.188520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416593b2-4551-4c7e-9448-83c674b2d77f None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:55.223940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:55.224613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:55.224898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:55.225180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:55.225964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] RBAC: Adding query filter params (interface=public, service_id=dc5d97a77b1d426fb39e30e59cb27264, region_id=RegionOne) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:55.226274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:55.227659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866006f-582e-441d-a0c5-d609404aeb6a None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:55.232988 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 651/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 25 20:39:55 2022] GET /identity/v3/endpoints?service_id=dc5d97a77b1d426fb39e30e59cb27264&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:55.241728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:55.339735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:55.360373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962fb29-32a2-4098-895f-77c323e29ed3 None admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:55.395708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:55.396286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:55.396599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:55.396865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:55.397537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:55.398901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a10a0-3411-433b-b152-da2737a7056e None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:55.405913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 650/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 25 20:39:55 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:39:57.670119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711b2aa-40d8-4f5b-8980-77d6184c5f0a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:57.671011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711b2aa-40d8-4f5b-8980-77d6184c5f0a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:57.671011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711b2aa-40d8-4f5b-8980-77d6184c5f0a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:57.673297 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 652/1302] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:57.679553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:57.679986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:57.680120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:57.705721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:57.706881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:57.782263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 651/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:39:57.801067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711b2aa-40d8-4f5b-8980-77d6184c5f0a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:57.912264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:57.919703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711b2aa-40d8-4f5b-8980-77d6184c5f0a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:57.953551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:57.954297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:57.954567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:57.954863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:57.955516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:57.956958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:39:57.968868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:39:57.969847 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 20:39:57.970993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 653/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 25 20:39:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:39:57.976538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:58.055843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:58.080793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71faf19-e658-4338-977e-54de115d5eb9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:58.120084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:58.120826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:58.121109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:58.121405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:58.122110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:39:58.122417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:58.123807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3f06-cad4-400c-b4d3-b0ecea7865bd None admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:58.129037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 652/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 25 20:39:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:39:58.137786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:58.239092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e72b-5664-4107-aa90-34cb85c7feb0 None admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:58.278644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:58.279300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:58.279585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:58.279860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:58.280630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:58.282032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab61ad-1f9d-4106-9d30-21b6bbb7003b None admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:58.306387 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 654/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 25 20:39:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:40:08.126064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=30 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:08.301052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:09.653586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f0940-c91f-4c53-90d9-2dc767fe85eb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:09.654908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f0940-c91f-4c53-90d9-2dc767fe85eb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:09.655720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f0940-c91f-4c53-90d9-2dc767fe85eb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:09.664366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 653/1307] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:09.666562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf62a6-b787-4ae9-9b35-4b47cb7984d0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:09.667091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf62a6-b787-4ae9-9b35-4b47cb7984d0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:09.667249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf62a6-b787-4ae9-9b35-4b47cb7984d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:09.766301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7dbf62a6-b787-4ae9-9b35-4b47cb7984d0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:09.767937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7dbf62a6-b787-4ae9-9b35-4b47cb7984d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:09.896620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 655/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:41:09.937678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:09.937960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:09.938518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:09.940452 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 654/1309] 10.222.0.39 () {54 vars in 964 bytes} [Sat Jun 25 20:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:09.946808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaebfac-50b9-4859-9d05-14feb78405dc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:09.947103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaebfac-50b9-4859-9d05-14feb78405dc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:09.947389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaebfac-50b9-4859-9d05-14feb78405dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:10.032460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8aaebfac-50b9-4859-9d05-14feb78405dc None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:10.033708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8aaebfac-50b9-4859-9d05-14feb78405dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:10.055547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:10.114305 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 656/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 25 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:10.123467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:10.125316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:10.245049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b580edd-7113-466d-916c-e18d4b2141ed None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:10.324800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:10.325522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:10.325798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:10.326068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:10.327709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:10.384191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:10.576261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:10.577676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46881da8-1808-4dc5-8156-5261a6f8c488 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:10.597622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 655/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:41:13.143226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.143709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.144181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.145143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 657/1312] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:13.150542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a67aa-d128-4f37-9794-7e6f12bd2348 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.151006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a67aa-d128-4f37-9794-7e6f12bd2348 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.151087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a67aa-d128-4f37-9794-7e6f12bd2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.232887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-823a67aa-d128-4f37-9794-7e6f12bd2348 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:13.234343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-823a67aa-d128-4f37-9794-7e6f12bd2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:13.339126 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 656/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:13.378387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:13.379916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:13.491880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd667b9-af71-44a8-bd9f-55f1def3555d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:13.568953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:13.572569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:13.573232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.573524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.573803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.576064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:13.707094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:13.708611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9d92-ddf6-4e17-8ead-173234ae3a36 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:13.728918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 658/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:16.355454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.356126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.356126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.357466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 657/1315] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:16.363653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315ede-74c0-4eb4-96da-3537296fb695 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.364115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315ede-74c0-4eb4-96da-3537296fb695 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.364217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315ede-74c0-4eb4-96da-3537296fb695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.443775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b5315ede-74c0-4eb4-96da-3537296fb695 None None] MFA Rules not processed for user `87b176ccc8ce4412994fec22c00ea699`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:16.445031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b5315ede-74c0-4eb4-96da-3537296fb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:16.499199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:16.554658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 659/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:16.599179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:16.601673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:16.617297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:16.716345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da3fe-c02d-4149-9d70-6e428b08b98e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:16.795701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:16.796348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.796662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.796935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.798552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:16.865842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:16.915201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:16.916611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754a3a-e472-49df-9009-2f70374b9bbb service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:16.936393 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 658/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:19.746441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:19.747108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:19.747108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:19.748410 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 660/1318] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:19.754733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838177b-ec6b-45ac-b336-b397f04d75e4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:19.755457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838177b-ec6b-45ac-b336-b397f04d75e4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:19.755631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838177b-ec6b-45ac-b336-b397f04d75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:19.833161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e838177b-ec6b-45ac-b336-b397f04d75e4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:19.834378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e838177b-ec6b-45ac-b336-b397f04d75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:19.938351 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 659/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:19.984999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:19.987295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:20.109007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c362b3-c28f-4393-b4bc-4f8e8912446c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:20.186003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:20.186635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:20.186915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:20.187186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:20.188835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:20.195634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:20.300715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:20.302157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538999a-e561-4887-a957-4dfb263d3906 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:20.321198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 661/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:23.243669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.244257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.244257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.245612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 660/1321] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:23.253462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cef5b-e8e5-4938-a4ce-96d86101c513 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.253922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cef5b-e8e5-4938-a4ce-96d86101c513 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.254118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cef5b-e8e5-4938-a4ce-96d86101c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.323023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fc3cef5b-e8e5-4938-a4ce-96d86101c513 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:23.324211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fc3cef5b-e8e5-4938-a4ce-96d86101c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:23.384369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:23.423377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 662/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:23.459876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:23.461467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:23.482431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:23.573238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a65c4-854b-438c-ad80-eddcb8684dba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:23.651179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:23.651842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.652123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.652394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.654193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:23.729589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:23.770938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:23.772387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649859-0bb7-40e9-a90c-b2797383136a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:23.791727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 661/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:26.137608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de009bb-9e79-4a72-849e-0734834d2ddf None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.138136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de009bb-9e79-4a72-849e-0734834d2ddf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.138136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de009bb-9e79-4a72-849e-0734834d2ddf None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.139512 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 663/1324] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:26.144878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f97c-d97a-40f6-af4b-d987e28fc818 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.145280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f97c-d97a-40f6-af4b-d987e28fc818 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.145435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f97c-d97a-40f6-af4b-d987e28fc818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.212394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e282f97c-d97a-40f6-af4b-d987e28fc818 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:26.213625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e282f97c-d97a-40f6-af4b-d987e28fc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:26.310935 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 662/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:26.359849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.360142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.360471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.361868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 664/1326] 10.222.0.39 () {54 vars in 964 bytes} [Sat Jun 25 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:26.367790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56463e3-bb80-4559-946a-94838017b1a5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.368082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56463e3-bb80-4559-946a-94838017b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.368359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56463e3-bb80-4559-946a-94838017b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.400857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:26.447060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c56463e3-bb80-4559-946a-94838017b1a5 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:26.448242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c56463e3-bb80-4559-946a-94838017b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:26.532275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 663/1327] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 25 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:26.541356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:26.542837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:26.655084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dbb7a-225c-4e21-ad83-b3d452cb2a34 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:26.739862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:26.740534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.740797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.741090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.742723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:26.760102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:26.856906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:26.858354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d1f78-d3d6-4613-bed5-a2f248378792 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:26.877052 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 665/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:29.502460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:29.503029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:29.503029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:29.504386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 664/1329] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:29.509990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fbea-ec33-4ed8-99de-25b15f231e04 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:29.510526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fbea-ec33-4ed8-99de-25b15f231e04 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:29.510526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fbea-ec33-4ed8-99de-25b15f231e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:29.578861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d332fbea-ec33-4ed8-99de-25b15f231e04 None None] MFA Rules not processed for user `87b176ccc8ce4412994fec22c00ea699`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:29.580083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d332fbea-ec33-4ed8-99de-25b15f231e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:29.653863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:29.688920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 666/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:29.730091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:29.731932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:29.843352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a2fc-89d0-48e9-b561-3e2e401458fc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:29.863886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:29.922289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:29.922948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:29.923229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:29.923499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:29.925173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:30.035721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:30.037224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3b924-9f25-4e28-8127-2b44c845cdf9 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:30.056054 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 665/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:32.608626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:32.609193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:32.609193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:32.610576 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 667/1332] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:32.616922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd7a-9288-42aa-9a0f-0c9e83dc99c7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:32.617377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd7a-9288-42aa-9a0f-0c9e83dc99c7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:32.617473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd7a-9288-42aa-9a0f-0c9e83dc99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:32.691066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:32.694052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ab30fd7a-9288-42aa-9a0f-0c9e83dc99c7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:32.696109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ab30fd7a-9288-42aa-9a0f-0c9e83dc99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:32.804665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 666/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:32.842861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:32.844412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:32.954188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d438-8d4b-433c-9150-45e5ec096eee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:33.034115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:33.034781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:33.035065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:33.035340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:33.037064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:33.067497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:33.157239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:33.158714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1b172-7f07-4b7b-8b0b-9db777244006 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:33.178197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 668/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:35.527825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:35.528460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:35.528460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:35.529868 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 667/1335] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:35.535990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0099-ebb0-436c-8044-2cb3d49845fe None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:35.536464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0099-ebb0-436c-8044-2cb3d49845fe None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:35.536563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e0099-ebb0-436c-8044-2cb3d49845fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:35.615183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cb4e0099-ebb0-436c-8044-2cb3d49845fe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:35.616392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb4e0099-ebb0-436c-8044-2cb3d49845fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:35.697030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:35.720791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 669/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:35.761783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:35.763376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:35.875681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997d21-94d5-4936-9bda-37ce1094f209 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:35.906054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:35.954157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:35.954827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:35.955106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:35.955376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:35.957089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:36.067236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:36.068718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f2721-c94f-48f5-8c60-1e585a8db471 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:36.087008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 668/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:38.676773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:38.677335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:38.677426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:38.678839 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 670/1338] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:38.685750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7fc9-d89e-4aa2-acd8-e4da9f286a84 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:38.686505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7fc9-d89e-4aa2-acd8-e4da9f286a84 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:38.686661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7fc9-d89e-4aa2-acd8-e4da9f286a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:38.758616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e20c7fc9-d89e-4aa2-acd8-e4da9f286a84 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:38.759844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e20c7fc9-d89e-4aa2-acd8-e4da9f286a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:38.768239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:38.862386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 669/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:38.899028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:38.900616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:39.004100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45eb9-f2b2-45a5-a3e1-ae193d8ec374 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:39.085065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:39.085720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:39.086001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:39.086243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:39.087995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:39.127800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:39.200006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:39.201486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa177-9fc7-4aff-83ef-4743d0cb4320 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:39.220544 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 671/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:43.811456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:43.811977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:43.811977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:43.813314 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 670/1341] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:43.818509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b489-70ce-41f2-b229-88c27769e69c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:43.818997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b489-70ce-41f2-b229-88c27769e69c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:43.819086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b489-70ce-41f2-b229-88c27769e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:43.890645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c757b489-70ce-41f2-b229-88c27769e69c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:43.891837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c757b489-70ce-41f2-b229-88c27769e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:43.986678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:44.000153 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 672/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:44.039524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:44.041919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:44.142653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccd4b-f075-4d32-a9ff-acb86c52db03 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:44.146470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:44.147109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:44.147391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:44.147661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:44.157152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:44.158578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c480f-839d-4ce0-91fd-bb9742e70084 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:44.168272 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 671/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:47.096874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a5bbe-959c-4fd1-acec-7c44ebbac0b4 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:47.097761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a5bbe-959c-4fd1-acec-7c44ebbac0b4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:47.097761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a5bbe-959c-4fd1-acec-7c44ebbac0b4 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:47.098996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 673/1344] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:47.104415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899bc1-40d8-4ac3-ac2b-c92de63867d5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:47.104858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899bc1-40d8-4ac3-ac2b-c92de63867d5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:47.105034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27899bc1-40d8-4ac3-ac2b-c92de63867d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:47.134050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-27899bc1-40d8-4ac3-ac2b-c92de63867d5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:47.135239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-27899bc1-40d8-4ac3-ac2b-c92de63867d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:47.163926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:47.221665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 672/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:47.264505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a5bbe-959c-4fd1-acec-7c44ebbac0b4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:47.276756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a5bbe-959c-4fd1-acec-7c44ebbac0b4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:47.281078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:47.281817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:47.282164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:47.282503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:47.291667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:47.293138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263e1e2-5fc4-43f0-8c0c-7b235be91a80 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:47.302717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 674/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:51.474498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f5a2-ed22-45e8-8cfa-ed7370cf1178 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:51.475028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f5a2-ed22-45e8-8cfa-ed7370cf1178 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:51.475028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f5a2-ed22-45e8-8cfa-ed7370cf1178 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:51.476388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 673/1347] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:51.482124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656389-91cd-4b2c-98da-f98b441deb56 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:51.482528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656389-91cd-4b2c-98da-f98b441deb56 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:51.482665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656389-91cd-4b2c-98da-f98b441deb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:51.502979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-94656389-91cd-4b2c-98da-f98b441deb56 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:51.504197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94656389-91cd-4b2c-98da-f98b441deb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:51.512347 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 675/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:41:51.551596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f5a2-ed22-45e8-8cfa-ed7370cf1178 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:51.567669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f5a2-ed22-45e8-8cfa-ed7370cf1178 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:51.570704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:51.571362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:51.571685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:51.571959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:51.582941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:51.584478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ab3c-e824-4762-a833-d2a064362b50 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:51.594756 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 674/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:57.116166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca722-95d2-49d5-aace-1edbe6961abb None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:57.124839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca722-95d2-49d5-aace-1edbe6961abb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:57.125362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca722-95d2-49d5-aace-1edbe6961abb None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:57.133076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 676/1350] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:41:57 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:57.142439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37d0a-9b7b-4833-a75d-025401e2e4bb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:57.143469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37d0a-9b7b-4833-a75d-025401e2e4bb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:57.143943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37d0a-9b7b-4833-a75d-025401e2e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:57.232409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-efb37d0a-9b7b-4833-a75d-025401e2e4bb None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:57.233657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-efb37d0a-9b7b-4833-a75d-025401e2e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:57.323509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 675/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:01.496542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=13 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:01.972750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bc49-8f32-4139-94dc-cbc44ac405f9 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:01.973027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bc49-8f32-4139-94dc-cbc44ac405f9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:01.973481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bc49-8f32-4139-94dc-cbc44ac405f9 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:01.975179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 677/1352] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:01.981295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109803-2a9e-43e7-a569-15eb61e2c2d9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:01.981846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109803-2a9e-43e7-a569-15eb61e2c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:01.981846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109803-2a9e-43e7-a569-15eb61e2c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:02.001444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b1109803-2a9e-43e7-a569-15eb61e2c2d9 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:02.003083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b1109803-2a9e-43e7-a569-15eb61e2c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:02.015558 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 676/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:03.507875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a89fa-b2a0-492a-9841-dd313186d461 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:03.508408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a89fa-b2a0-492a-9841-dd313186d461 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:03.508408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a89fa-b2a0-492a-9841-dd313186d461 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:03.509880 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 678/1354] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:03.515322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86ed4-8081-403b-b7b2-f8ca63ab61db None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:03.515775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86ed4-8081-403b-b7b2-f8ca63ab61db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:03.515872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86ed4-8081-403b-b7b2-f8ca63ab61db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:03.535496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7fe86ed4-8081-403b-b7b2-f8ca63ab61db None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:03.536761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7fe86ed4-8081-403b-b7b2-f8ca63ab61db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:03.547388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 677/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:07.406733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290ff2-2e3e-40ff-8556-82123b7de2b9 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:07.407622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290ff2-2e3e-40ff-8556-82123b7de2b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:07.407857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290ff2-2e3e-40ff-8556-82123b7de2b9 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:07.409258 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 679/1356] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:07.414600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c208b9-83ba-43eb-b9ad-e5c9e03fafa7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:07.415049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c208b9-83ba-43eb-b9ad-e5c9e03fafa7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:07.415131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c208b9-83ba-43eb-b9ad-e5c9e03fafa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:07.433690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-43c208b9-83ba-43eb-b9ad-e5c9e03fafa7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:07.434891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-43c208b9-83ba-43eb-b9ad-e5c9e03fafa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:07.443136 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 678/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:07.498481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c89af-786f-4d70-b994-d2d7ce9fc896 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:07.499195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c89af-786f-4d70-b994-d2d7ce9fc896 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:07.499858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c89af-786f-4d70-b994-d2d7ce9fc896 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:07.501467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 680/1358] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 25 20:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:07.512663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8d82-ed2a-4ce6-83a2-77e667e7f22d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:07.513187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8d82-ed2a-4ce6-83a2-77e667e7f22d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:07.513856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8d82-ed2a-4ce6-83a2-77e667e7f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:07.577914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:07.587541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3f6a8d82-ed2a-4ce6-83a2-77e667e7f22d None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:07.588917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3f6a8d82-ed2a-4ce6-83a2-77e667e7f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:07.671615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 679/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:07.679542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c89af-786f-4d70-b994-d2d7ce9fc896 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:07.694316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c89af-786f-4d70-b994-d2d7ce9fc896 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:07.700008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:07.700815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:07.701201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:07.701575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:07.711730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:07.713477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48376-5fa5-4780-9197-bb8d2b2e596e service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:07.723648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 681/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:10.231905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ec07-9229-4050-a9db-45e5e9f0aabc None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.232499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ec07-9229-4050-a9db-45e5e9f0aabc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.232725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ec07-9229-4050-a9db-45e5e9f0aabc None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.234205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 680/1361] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:10.239569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e870cd-fd33-4755-aed9-67d74eb53498 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.240006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e870cd-fd33-4755-aed9-67d74eb53498 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.240112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e870cd-fd33-4755-aed9-67d74eb53498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.258473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-60e870cd-fd33-4755-aed9-67d74eb53498 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:10.259692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60e870cd-fd33-4755-aed9-67d74eb53498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:10.268402 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 682/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:10.314276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ec07-9229-4050-a9db-45e5e9f0aabc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:10.328844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ec07-9229-4050-a9db-45e5e9f0aabc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:10.334272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:10.334921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.335190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.335461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.344141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:10.345744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afffd60-7506-4705-bc0c-a0b3082dd764 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:10.356083 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 681/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:12.996025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095c32-a8b3-4345-9ca4-48b751160be6 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:12.999462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095c32-a8b3-4345-9ca4-48b751160be6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:12.999786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095c32-a8b3-4345-9ca4-48b751160be6 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.001351 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 683/1364] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:13.007068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb442-7fc0-4eb9-be92-326b33e4a93d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:13.007833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb442-7fc0-4eb9-be92-326b33e4a93d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:13.007951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb442-7fc0-4eb9-be92-326b33e4a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.029220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-250cb442-7fc0-4eb9-be92-326b33e4a93d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:13.030707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-250cb442-7fc0-4eb9-be92-326b33e4a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:13.047494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 682/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:13.089780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b8a-31bb-4102-bcd3-f41dc29c887e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:13.090065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b8a-31bb-4102-bcd3-f41dc29c887e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:13.090514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b8a-31bb-4102-bcd3-f41dc29c887e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.091868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 684/1366] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 25 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:13.097987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088e0c-6fed-489f-98bb-4b593152a608 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:13.098273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088e0c-6fed-489f-98bb-4b593152a608 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:13.098548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088e0c-6fed-489f-98bb-4b593152a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.116791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-69088e0c-6fed-489f-98bb-4b593152a608 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:13.117957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-69088e0c-6fed-489f-98bb-4b593152a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:13.129616 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 683/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:13.138495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8b8a-31bb-4102-bcd3-f41dc29c887e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:13.152728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8b8a-31bb-4102-bcd3-f41dc29c887e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:13.158066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:13.158721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:13.159153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:13.159579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.167838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:13.169471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7c53-5d91-4c5d-af27-861a89d04c0b service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:13.179364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 685/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:15.555453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba7ec-c0d3-42e1-8233-a4931d6560fd None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.556060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba7ec-c0d3-42e1-8233-a4931d6560fd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.556918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba7ec-c0d3-42e1-8233-a4931d6560fd None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.560296 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 684/1369] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:15.569384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac14c4-11e3-4774-ae98-bb7bf0d33124 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.569384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac14c4-11e3-4774-ae98-bb7bf0d33124 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.569384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac14c4-11e3-4774-ae98-bb7bf0d33124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.591101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e7ac14c4-11e3-4774-ae98-bb7bf0d33124 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:15.592307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e7ac14c4-11e3-4774-ae98-bb7bf0d33124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:15.607875 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 686/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:15.651645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ba7ec-c0d3-42e1-8233-a4931d6560fd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:15.671419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ba7ec-c0d3-42e1-8233-a4931d6560fd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:15.678733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:15.679682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.680178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.680705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.693629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:15.696385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01281-05b6-42ec-b2bb-9857a083ac3b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:15.721249 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 685/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:18.344983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4c-ec33-4f88-b086-77899f8b729b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.358219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4c-ec33-4f88-b086-77899f8b729b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.358219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4e4c-ec33-4f88-b086-77899f8b729b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.358454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f91f-1a58-42c1-bf77-dcb0cfc799b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.358454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f91f-1a58-42c1-bf77-dcb0cfc799b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.358454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1f91f-1a58-42c1-bf77-dcb0cfc799b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.359089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 687/1372] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:18.376020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7ed1f91f-1a58-42c1-bf77-dcb0cfc799b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:18.377627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7ed1f91f-1a58-42c1-bf77-dcb0cfc799b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:18.394810 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 686/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:18.434759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4e4c-ec33-4f88-b086-77899f8b729b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:18.450206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4e4c-ec33-4f88-b086-77899f8b729b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:18.455990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:18.456931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.457462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.457964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.467334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:18.469278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15443e6f-d084-40f4-b498-2f55ad15c6c7 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:18.491688 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 688/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:19.915687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff1ac-1a54-4c1d-ba73-75a4aee9a3b0 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:19.916873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff1ac-1a54-4c1d-ba73-75a4aee9a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:19.916873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff1ac-1a54-4c1d-ba73-75a4aee9a3b0 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:19.917694 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 687/1375] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:19.923059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e04c-ecd6-402f-a1a2-a11f32a95abc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:19.923519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e04c-ecd6-402f-a1a2-a11f32a95abc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:19.923608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e04c-ecd6-402f-a1a2-a11f32a95abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:19.941836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f8a1e04c-ecd6-402f-a1a2-a11f32a95abc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:19.943028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f8a1e04c-ecd6-402f-a1a2-a11f32a95abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:19.957967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 689/1376] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:20.268547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43fa6-2651-4cb2-a174-d7c6644b1ecb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.270511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43fa6-2651-4cb2-a174-d7c6644b1ecb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.270511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43fa6-2651-4cb2-a174-d7c6644b1ecb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.270511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 688/1377] 10.222.0.39 () {54 vars in 963 bytes} [Sat Jun 25 20:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:20.276131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3284a-5a4e-4eec-9d34-2a426f7b30bf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.276753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3284a-5a4e-4eec-9d34-2a426f7b30bf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.277216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3284a-5a4e-4eec-9d34-2a426f7b30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.342872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3ca3284a-5a4e-4eec-9d34-2a426f7b30bf None None] MFA Rules not processed for user `083565d7e7e3423486d9bfd51efaf318`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:20.344077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3ca3284a-5a4e-4eec-9d34-2a426f7b30bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:20.408006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 690/1378] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 25 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:20.415801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a43fa6-2651-4cb2-a174-d7c6644b1ecb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:20.427186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a43fa6-2651-4cb2-a174-d7c6644b1ecb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:20.431063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:20.431769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.432118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.432485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.442145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:20.443643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c62790-8134-4d3a-884c-f90741f7868b service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:20.453791 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 689/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:21.056090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33460-c878-425a-badc-71f84e176d8b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:21.056736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33460-c878-425a-badc-71f84e176d8b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:21.057243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33460-c878-425a-badc-71f84e176d8b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:21.059075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 691/1380] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:21.065032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321410f5-42b5-40df-8ace-e13f28bef745 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:21.065629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321410f5-42b5-40df-8ace-e13f28bef745 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:21.065716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321410f5-42b5-40df-8ace-e13f28bef745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:21.090312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-321410f5-42b5-40df-8ace-e13f28bef745 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:21.091565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-321410f5-42b5-40df-8ace-e13f28bef745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:21.105716 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 690/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:21.152620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33460-c878-425a-badc-71f84e176d8b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:21.167792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33460-c878-425a-badc-71f84e176d8b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:21.173742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:21.174423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:21.174706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:21.174982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:21.186884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:21.188555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d5ee2-3338-4540-9a7b-f17fb8603703 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:21.199396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 692/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:23.672021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2574a0-0066-4c9b-8c0d-9fb2da47aac5 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.672622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2574a0-0066-4c9b-8c0d-9fb2da47aac5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.672949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2574a0-0066-4c9b-8c0d-9fb2da47aac5 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.674933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 691/1383] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:23.683543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe697-3d16-4c58-aff5-b32aabf67e8a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.684035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe697-3d16-4c58-aff5-b32aabf67e8a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.684155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fe697-3d16-4c58-aff5-b32aabf67e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.717855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-423fe697-3d16-4c58-aff5-b32aabf67e8a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:23.719059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-423fe697-3d16-4c58-aff5-b32aabf67e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:23.728279 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 693/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:23.771308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2574a0-0066-4c9b-8c0d-9fb2da47aac5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:23.790654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2574a0-0066-4c9b-8c0d-9fb2da47aac5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:23.796820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:23.797480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.797763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.798040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.808106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:23.809753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c8f3-0fa0-4cef-9137-28495f2e5eda service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:23.819913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 692/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:26.280560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df772094-2c55-4d6a-9105-dc4dab53253c None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:26.281217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df772094-2c55-4d6a-9105-dc4dab53253c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:26.281217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df772094-2c55-4d6a-9105-dc4dab53253c None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:26.282420 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 694/1386] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:26.287824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc259b-1313-4463-8220-9708ff977af8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:26.288335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc259b-1313-4463-8220-9708ff977af8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:26.288335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc259b-1313-4463-8220-9708ff977af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:26.310911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-45dc259b-1313-4463-8220-9708ff977af8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:26.312195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45dc259b-1313-4463-8220-9708ff977af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:26.321078 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 693/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:26.366668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df772094-2c55-4d6a-9105-dc4dab53253c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:26.383297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df772094-2c55-4d6a-9105-dc4dab53253c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:26.389971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:26.391115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:26.391560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:26.392105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:26.402495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:26.404348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033bd55-0c69-495f-8b14-c42e2d66873e service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:26.415822 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 695/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:28.849009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563777bd-1dbb-4fa2-8441-218232c8643e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:28.849644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563777bd-1dbb-4fa2-8441-218232c8643e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:28.849644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563777bd-1dbb-4fa2-8441-218232c8643e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:28.856305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0ca9-586a-4386-ab96-a2ac735ee9c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:28.856945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0ca9-586a-4386-ab96-a2ac735ee9c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:28.856945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a0ca9-586a-4386-ab96-a2ac735ee9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:28.859175 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 694/1389] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:28.874528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-111a0ca9-586a-4386-ab96-a2ac735ee9c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:28.875730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-111a0ca9-586a-4386-ab96-a2ac735ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:28.901227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 696/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:28.931520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563777bd-1dbb-4fa2-8441-218232c8643e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:28.956771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563777bd-1dbb-4fa2-8441-218232c8643e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:28.963190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:28.964690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:28.964971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:28.965246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:28.976064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:28.977683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00247d-e9bd-4fe8-b235-e71bc06cd13d service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:28.988995 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 695/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:31.341741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da219-02ba-4780-9901-66ffd681bdb4 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:31.342394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da219-02ba-4780-9901-66ffd681bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:31.342394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da219-02ba-4780-9901-66ffd681bdb4 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:31.343640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 697/1392] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:31.349730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cee2e-519c-4fab-b50b-5c468c4e4943 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:31.350273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cee2e-519c-4fab-b50b-5c468c4e4943 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:31.350273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cee2e-519c-4fab-b50b-5c468c4e4943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:31.369692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d07cee2e-519c-4fab-b50b-5c468c4e4943 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:31.370925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d07cee2e-519c-4fab-b50b-5c468c4e4943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:31.379749 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 696/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:31.428000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da219-02ba-4780-9901-66ffd681bdb4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:31.447121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da219-02ba-4780-9901-66ffd681bdb4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:31.454730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:31.455703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:31.456051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:31.456588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:31.467578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:31.469687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff883db-d541-41d8-a933-6a91729128ca service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:31.482338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 698/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:34.419429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540314a-1ad1-49d0-9051-912cc530ae51 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:34.420126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540314a-1ad1-49d0-9051-912cc530ae51 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:34.420126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540314a-1ad1-49d0-9051-912cc530ae51 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:34.422088 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 697/1395] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:34.428815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e636-bb27-4927-bdb9-310fc195b316 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:34.429324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e636-bb27-4927-bdb9-310fc195b316 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:34.429505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e636-bb27-4927-bdb9-310fc195b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:34.437379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:34.453776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d991e636-bb27-4927-bdb9-310fc195b316 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:34.455362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d991e636-bb27-4927-bdb9-310fc195b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:34.465239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 699/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:34.511410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540314a-1ad1-49d0-9051-912cc530ae51 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:34.529719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540314a-1ad1-49d0-9051-912cc530ae51 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:34.536616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:34.537400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:34.538042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:34.538600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:34.549570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:34.551791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d759-3553-42a9-8646-ef03a0fcfe8d service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:34.564726 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 698/1397] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:36.906192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8ecda-a0e4-4cc9-8513-4b97c77b1eca None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:36.906790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8ecda-a0e4-4cc9-8513-4b97c77b1eca None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:36.906790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8ecda-a0e4-4cc9-8513-4b97c77b1eca None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:36.908392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 700/1398] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:36.910098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3605-809c-4555-83f9-52c66aeebf4f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:36.910584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3605-809c-4555-83f9-52c66aeebf4f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:36.910687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3605-809c-4555-83f9-52c66aeebf4f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:36.912057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 699/1399] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:42:36.913664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868e7df-18af-47f5-931b-4867be9fb9c0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:36.913955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868e7df-18af-47f5-931b-4867be9fb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:36.914246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868e7df-18af-47f5-931b-4867be9fb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:36.917271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:36.917542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:36.918005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:36.936218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7868e7df-18af-47f5-931b-4867be9fb9c0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:36.936684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:36.937889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:36.938082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7868e7df-18af-47f5-931b-4867be9fb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:36.946026 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 700/1400] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:42:36.952467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 701/1401] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:36.999532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:37.012691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd64c3f-6dd8-4be4-947c-2f5c6080bd22 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:37.013615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f31b-d02a-4df5-b2de-5989b8078dcd None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.013906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f31b-d02a-4df5-b2de-5989b8078dcd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.014223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8f31b-d02a-4df5-b2de-5989b8078dcd None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.016725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 702/1402] 10.222.0.39 () {54 vars in 962 bytes} [Sat Jun 25 20:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:37.018513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:37.019166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.019451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.019733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.022791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61203-0dbe-4610-b2a8-519b4fcb2db9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.023141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61203-0dbe-4610-b2a8-519b4fcb2db9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.023423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61203-0dbe-4610-b2a8-519b4fcb2db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.029250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:37.031136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:37.041706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 701/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:37.082497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c8d61203-0dbe-4610-b2a8-519b4fcb2db9 None None] MFA Rules not processed for user `8cddedee376f4cf4a01caffdea20716d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:37.083639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c8d61203-0dbe-4610-b2a8-519b4fcb2db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:37.154432 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 703/1404] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Jun 25 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:37.162546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:37.167036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:37.173404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5057ee-34dd-4ff1-80fe-3a23bfe1ffd3 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:37.177462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:37.178308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.178729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.179272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.190652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:37.192485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c034-3092-4633-b419-f425c097ba56 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:37.203844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 702/1405] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:37.772591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557ca9-a51f-4135-9714-31f27e65fa37 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.772907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557ca9-a51f-4135-9714-31f27e65fa37 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.773184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557ca9-a51f-4135-9714-31f27e65fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.822800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5f557ca9-a51f-4135-9714-31f27e65fa37 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:37.824048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5f557ca9-a51f-4135-9714-31f27e65fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:37.892102 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 704/1406] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:37.936707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53dc3-42ee-48de-a3c0-f6433551c813 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.937210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53dc3-42ee-48de-a3c0-f6433551c813 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.937210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53dc3-42ee-48de-a3c0-f6433551c813 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.938617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 703/1407] 10.222.0.39 () {54 vars in 942 bytes} [Sat Jun 25 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:37.944935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9553b-ac42-4fb1-994a-92bd1320d984 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:37.945361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9553b-ac42-4fb1-994a-92bd1320d984 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:37.945611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9553b-ac42-4fb1-994a-92bd1320d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:37.998989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-32d9553b-ac42-4fb1-994a-92bd1320d984 None None] MFA Rules not processed for user `c226aaf467e44e59b368c6b5c9db1cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:38.004600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-32d9553b-ac42-4fb1-994a-92bd1320d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:38.018219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:38.094453 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 705/1408] 10.222.0.39 () {58 vars in 1039 bytes} [Sat Jun 25 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:38.104196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53dc3-42ee-48de-a3c0-f6433551c813 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:38.118735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53dc3-42ee-48de-a3c0-f6433551c813 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:38.124819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:38.125463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:38.125737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:38.126013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:38.134386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:38.136078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d637a-6b94-4a2d-8b59-08c5e14c6c79 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:38.144507 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 704/1409] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:42:48.091400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=27 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:48.141014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=11 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:01.591618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7983d-8a11-4ba6-a8b5-16f7385c9407 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:01.592220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7983d-8a11-4ba6-a8b5-16f7385c9407 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:01.592220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7983d-8a11-4ba6-a8b5-16f7385c9407 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:01.593597 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 706/1410] 10.222.0.39 () {54 vars in 918 bytes} [Sat Jun 25 20:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:01.600209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e5f3-25ad-43bf-b497-2b3d503770b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:01.600771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e5f3-25ad-43bf-b497-2b3d503770b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:01.600876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e5f3-25ad-43bf-b497-2b3d503770b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:01.626254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-86c9e5f3-25ad-43bf-b497-2b3d503770b9 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:01.627472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-86c9e5f3-25ad-43bf-b497-2b3d503770b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:01.637525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 705/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jun 25 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:01.651864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb9f6-0848-4318-9a14-3012a6826326 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:01.652139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb9f6-0848-4318-9a14-3012a6826326 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:01.652455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb9f6-0848-4318-9a14-3012a6826326 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:01.653849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 707/1412] 10.222.0.39 () {54 vars in 918 bytes} [Sat Jun 25 20:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:01.658821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b587-6fad-4841-8246-979c9738080d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:01.659114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b587-6fad-4841-8246-979c9738080d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:01.659395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b587-6fad-4841-8246-979c9738080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:01.678715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-84f0b587-6fad-4841-8246-979c9738080d None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:01.679913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84f0b587-6fad-4841-8246-979c9738080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:01.690894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 706/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jun 25 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:04.476023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e60a-6b23-4ee2-a0e7-fd04ecb1cd4f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:04.476681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e60a-6b23-4ee2-a0e7-fd04ecb1cd4f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:04.476681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e60a-6b23-4ee2-a0e7-fd04ecb1cd4f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:04.477996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:04.483438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141127e-2413-4d2f-9dbd-4bd5eb7af43b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:04.483892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141127e-2413-4d2f-9dbd-4bd5eb7af43b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:04.483999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141127e-2413-4d2f-9dbd-4bd5eb7af43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:04.503150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0141127e-2413-4d2f-9dbd-4bd5eb7af43b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:04.504453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0141127e-2413-4d2f-9dbd-4bd5eb7af43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:04.512482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:04.557687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564e60a-6b23-4ee2-a0e7-fd04ecb1cd4f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:04.579166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564e60a-6b23-4ee2-a0e7-fd04ecb1cd4f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:04.590171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:04.594718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:04.595001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:04.595271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:04.608032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:04.609669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd6ac-ca76-4ac0-8c85-f4acced3b7f4 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:04.619702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 709/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:05.615048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6099-b83c-4097-8f8b-275cccb8336f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:05.615731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6099-b83c-4097-8f8b-275cccb8336f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:05.615731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6099-b83c-4097-8f8b-275cccb8336f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:05.617013 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:05.623297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daece4-2298-4c8f-9053-3ac27c40b262 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:05.624002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daece4-2298-4c8f-9053-3ac27c40b262 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:05.628266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daece4-2298-4c8f-9053-3ac27c40b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:05.666113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-06daece4-2298-4c8f-9053-3ac27c40b262 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:05.667530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-06daece4-2298-4c8f-9053-3ac27c40b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:05.677436 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:05.945959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6099-b83c-4097-8f8b-275cccb8336f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:05.960677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6099-b83c-4097-8f8b-275cccb8336f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:05.966665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:05.967298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:05.967583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:05.967851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:05.976570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:05.978159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2f4d-3f31-4a2c-85cc-b61ddec6b26c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:05.988037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 709/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:06.907494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36c4c-3bf4-4799-9ddc-39cc1073a1ab None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:06.908374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36c4c-3bf4-4799-9ddc-39cc1073a1ab None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:06.908374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36c4c-3bf4-4799-9ddc-39cc1073a1ab None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:06.910693 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:06.918939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49cb2-2953-4502-a032-3265f21dfa7c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:06.919378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49cb2-2953-4502-a032-3265f21dfa7c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:06.919509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49cb2-2953-4502-a032-3265f21dfa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:06.943140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7ba49cb2-2953-4502-a032-3265f21dfa7c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:06.944553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7ba49cb2-2953-4502-a032-3265f21dfa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:06.953075 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:07.120375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36c4c-3bf4-4799-9ddc-39cc1073a1ab None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:07.139587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36c4c-3bf4-4799-9ddc-39cc1073a1ab None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:07.145459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:07.146086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:07.146389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:07.146618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:07.154748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:07.156337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653953b6-952a-45ca-9dc7-5ae53c8d42cf service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:07.165801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 712/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:08.038992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839fa0-05f9-4d8c-b7bb-ef847311a356 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:08.039548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839fa0-05f9-4d8c-b7bb-ef847311a356 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:08.039548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839fa0-05f9-4d8c-b7bb-ef847311a356 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:08.041691 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:08.046866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00f84d-a95a-41cf-9167-056b3e3b23c6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:08.047302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00f84d-a95a-41cf-9167-056b3e3b23c6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:08.047404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00f84d-a95a-41cf-9167-056b3e3b23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:08.066744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0a00f84d-a95a-41cf-9167-056b3e3b23c6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:08.067937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0a00f84d-a95a-41cf-9167-056b3e3b23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:08.076871 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:08.239465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17839fa0-05f9-4d8c-b7bb-ef847311a356 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:08.263044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17839fa0-05f9-4d8c-b7bb-ef847311a356 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:08.272207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:08.273110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:08.273484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:08.273840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:08.283527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:08.285140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154b0d-cb60-41e0-a6d4-220edf78aab0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:08.295192 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 712/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:09.187975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a279bb-9ab5-443e-a4e9-9b48589ae0e0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:09.188531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a279bb-9ab5-443e-a4e9-9b48589ae0e0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:09.188531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a279bb-9ab5-443e-a4e9-9b48589ae0e0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:09.189849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:43:09.195094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8fe9b-b7c0-437c-bced-af3e61da1ffc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:09.195535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8fe9b-b7c0-437c-bced-af3e61da1ffc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:09.195646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8fe9b-b7c0-437c-bced-af3e61da1ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:09.216558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-98d8fe9b-b7c0-437c-bced-af3e61da1ffc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:09.218689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98d8fe9b-b7c0-437c-bced-af3e61da1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:09.228302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:09.393934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a279bb-9ab5-443e-a4e9-9b48589ae0e0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:09.413569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a279bb-9ab5-443e-a4e9-9b48589ae0e0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:09.420495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:09.421368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:09.421647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:09.421922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:09.430979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:09.432632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb55321-51e9-4dcf-aea2-cc3054c51126 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:09.442566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 715/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:10.260714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb46a-c5de-434b-a440-70cd96e533c5 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:10.261285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb46a-c5de-434b-a440-70cd96e533c5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:10.261285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb46a-c5de-434b-a440-70cd96e533c5 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:10.262707 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:10.268883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410019b-a428-4474-8fec-726d0935752b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:10.269655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410019b-a428-4474-8fec-726d0935752b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:10.269782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410019b-a428-4474-8fec-726d0935752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:10.298431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1410019b-a428-4474-8fec-726d0935752b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:10.299646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1410019b-a428-4474-8fec-726d0935752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:10.309465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:10.470916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb46a-c5de-434b-a440-70cd96e533c5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:10.489905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb46a-c5de-434b-a440-70cd96e533c5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:10.495882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:10.496519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:10.496833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:10.497107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:10.506762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:10.508383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ffb8-47f8-4711-b4b5-e55ec9eb3a27 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:10.518528 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 715/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:11.337639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36b01-b124-4c95-81d8-ebc5cbf15b95 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:11.338293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36b01-b124-4c95-81d8-ebc5cbf15b95 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:11.338293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36b01-b124-4c95-81d8-ebc5cbf15b95 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:11.339714 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:11.345974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9eee3-a871-4862-872f-11b84be22829 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:11.346655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9eee3-a871-4862-872f-11b84be22829 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:11.346834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9eee3-a871-4862-872f-11b84be22829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:11.374327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e8c9eee3-a871-4862-872f-11b84be22829 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:11.375552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e8c9eee3-a871-4862-872f-11b84be22829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:11.384250 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:11.542797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36b01-b124-4c95-81d8-ebc5cbf15b95 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:11.557675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36b01-b124-4c95-81d8-ebc5cbf15b95 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:11.563213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:11.563837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:11.564136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:11.564384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:11.572483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:11.574094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec9b3-72d1-401c-9cb3-6efc67a001d9 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:11.583449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 718/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:12.405240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bb88-b1a6-4deb-bf01-a71e3d240ea6 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:12.405795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bb88-b1a6-4deb-bf01-a71e3d240ea6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:12.405795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bb88-b1a6-4deb-bf01-a71e3d240ea6 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:12.408011 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:12.416607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984f1c-b9d1-4d59-b043-54835ede2638 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:12.417009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984f1c-b9d1-4d59-b043-54835ede2638 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:12.417154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984f1c-b9d1-4d59-b043-54835ede2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:12.436152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b7984f1c-b9d1-4d59-b043-54835ede2638 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:12.437395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7984f1c-b9d1-4d59-b043-54835ede2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:12.446796 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:12.607682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0bb88-b1a6-4deb-bf01-a71e3d240ea6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:12.631684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0bb88-b1a6-4deb-bf01-a71e3d240ea6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:12.639918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:12.640614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:12.640904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:12.641204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:12.649957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:12.651548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca0ac4-932f-43cc-b414-67f9dde553f0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:12.661334 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 718/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:13.481366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b7fe-107d-48e8-b58d-513a67120227 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:13.482238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b7fe-107d-48e8-b58d-513a67120227 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:13.482238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b7fe-107d-48e8-b58d-513a67120227 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:13.484386 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:13.491790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3858c-df38-4044-9b1c-c16364604477 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:13.492209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3858c-df38-4044-9b1c-c16364604477 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:13.492301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3858c-df38-4044-9b1c-c16364604477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:13.511451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-57a3858c-df38-4044-9b1c-c16364604477 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:13.512700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-57a3858c-df38-4044-9b1c-c16364604477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:13.521426 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:43:13.678387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b7fe-107d-48e8-b58d-513a67120227 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:13.700759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b7fe-107d-48e8-b58d-513a67120227 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:13.706664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:13.707336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:13.707601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:13.707877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:13.717372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:13.718986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abd3ea-7f4e-46b0-83ee-4b5d49ea7e72 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:13.729190 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 721/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:15.881954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95da4-48ad-43f5-94cf-8d535ba36c5f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:15.882513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95da4-48ad-43f5-94cf-8d535ba36c5f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:15.882513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb95da4-48ad-43f5-94cf-8d535ba36c5f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:15.884906 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:15.891182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58cd9-da4d-4f73-8bdd-4ac1a4f9959c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:15.891968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58cd9-da4d-4f73-8bdd-4ac1a4f9959c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:15.892120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58cd9-da4d-4f73-8bdd-4ac1a4f9959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:15.914452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bdf58cd9-da4d-4f73-8bdd-4ac1a4f9959c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:15.915651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bdf58cd9-da4d-4f73-8bdd-4ac1a4f9959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:15.924870 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:15.966317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95da4-48ad-43f5-94cf-8d535ba36c5f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:15.978612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb95da4-48ad-43f5-94cf-8d535ba36c5f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:15.982945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:15.983592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:15.983876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:15.984181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:15.994583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:15.996028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703245e-e1c6-4e91-b111-6e139614e0b1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:16.005986 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 721/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:18.421518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:18.422080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:18.422080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:18.423450 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:18.430020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9de2-66d3-4a9b-8b34-eb8458cd8336 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:18.430743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9de2-66d3-4a9b-8b34-eb8458cd8336 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:18.431046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e9de2-66d3-4a9b-8b34-eb8458cd8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:18.455821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1b3e9de2-66d3-4a9b-8b34-eb8458cd8336 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:18.457059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1b3e9de2-66d3-4a9b-8b34-eb8458cd8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:18.465502 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:18.508944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:18.510823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:18.526361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3e500-2274-44b6-a1a4-bdc99146d7bb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:18.530840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:18.531484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:18.531762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:18.532038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:18.541838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:18.543254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccee5a8-4e6a-49f1-9394-2d9862651d72 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:18.552581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 724/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:21.225672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed535-74c4-400c-b8d5-00bcb8cba237 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:21.226288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed535-74c4-400c-b8d5-00bcb8cba237 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:21.226288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed535-74c4-400c-b8d5-00bcb8cba237 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:21.227634 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:21.234259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8c63-2004-4f50-ace1-ff1bd90d485a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:21.235040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8c63-2004-4f50-ace1-ff1bd90d485a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:21.235143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8c63-2004-4f50-ace1-ff1bd90d485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:21.263721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9b0d8c63-2004-4f50-ace1-ff1bd90d485a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:21.265246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9b0d8c63-2004-4f50-ace1-ff1bd90d485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:21.278089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:21.323741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed535-74c4-400c-b8d5-00bcb8cba237 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:21.336634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed535-74c4-400c-b8d5-00bcb8cba237 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:21.340975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:21.341626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:21.341904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:21.342172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:21.351729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:21.353184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928aed6-d5a8-4fdd-87cb-46beee6f267d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:21.362664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 724/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:23.789473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdd56-4aaf-4873-944c-8d0ad990fda8 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:23.790365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdd56-4aaf-4873-944c-8d0ad990fda8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:23.790365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbdd56-4aaf-4873-944c-8d0ad990fda8 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:23.792715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:23.798263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4ee2-37ac-4af3-a153-68dd63542460 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:23.798688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4ee2-37ac-4af3-a153-68dd63542460 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:23.798780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4ee2-37ac-4af3-a153-68dd63542460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:23.820903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1fcf4ee2-37ac-4af3-a153-68dd63542460 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:23.822460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1fcf4ee2-37ac-4af3-a153-68dd63542460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:23.830365 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:23.873218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbdd56-4aaf-4873-944c-8d0ad990fda8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:23.893576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbdd56-4aaf-4873-944c-8d0ad990fda8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:23.899134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:23.899906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:23.900194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:23.900471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:23.911639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:23.913136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71894b-a9e2-42e8-ba3e-cdf98b37ec29 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:23.923462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 727/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:43:26.272793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49ee4e-0eea-464e-af77-6496b2dd7d15 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:26.273646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49ee4e-0eea-464e-af77-6496b2dd7d15 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:26.273646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49ee4e-0eea-464e-af77-6496b2dd7d15 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:26.275826 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:26.282476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b652f0-cc79-43f7-8c06-a42dcc991a05 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:26.282908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b652f0-cc79-43f7-8c06-a42dcc991a05 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:26.283020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b652f0-cc79-43f7-8c06-a42dcc991a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:26.304545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f6b652f0-cc79-43f7-8c06-a42dcc991a05 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:26.305752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6b652f0-cc79-43f7-8c06-a42dcc991a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:26.314384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:26.358422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49ee4e-0eea-464e-af77-6496b2dd7d15 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:26.374838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49ee4e-0eea-464e-af77-6496b2dd7d15 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:26.378968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:26.379646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:26.379921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:26.380193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:26.389842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:26.391278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832254c0-2a8c-4b41-8975-f7135cd4bad5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:26.400930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 727/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:28.769206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c00cf-c372-49c1-b270-17779abaa0e9 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:28.769775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c00cf-c372-49c1-b270-17779abaa0e9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:28.769775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c00cf-c372-49c1-b270-17779abaa0e9 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:28.771120 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:28.776863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b667c-93e8-4189-b978-553f6d9c1572 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:28.777328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b667c-93e8-4189-b978-553f6d9c1572 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:28.777431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b667c-93e8-4189-b978-553f6d9c1572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:28.784165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=70 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:28.799431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b89b667c-93e8-4189-b978-553f6d9c1572 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:28.800670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b89b667c-93e8-4189-b978-553f6d9c1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:28.809174 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:28.848614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c00cf-c372-49c1-b270-17779abaa0e9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:28.855040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=64 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:28.861618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c00cf-c372-49c1-b270-17779abaa0e9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:28.865456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:28.866121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:28.866399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:28.866710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:28.875721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:28.877256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a35f4-9278-4000-8747-320f3c923a73 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:28.886721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 730/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:31.845104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083b9b-09cf-4b89-9e1b-96fa0d4e603a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:31.845616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083b9b-09cf-4b89-9e1b-96fa0d4e603a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:31.845924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083b9b-09cf-4b89-9e1b-96fa0d4e603a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:31.848270 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:31.855627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b7b5-0d7e-4b12-a520-bd430c47939e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:31.856061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b7b5-0d7e-4b12-a520-bd430c47939e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:31.856152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6b7b5-0d7e-4b12-a520-bd430c47939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:31.875175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bfb6b7b5-0d7e-4b12-a520-bd430c47939e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:31.876463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bfb6b7b5-0d7e-4b12-a520-bd430c47939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:31.885918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:31.927978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083b9b-09cf-4b89-9e1b-96fa0d4e603a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:31.939660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083b9b-09cf-4b89-9e1b-96fa0d4e603a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:31.943612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:31.944251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:31.944574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:31.944843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:31.954228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:31.955650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a612-151b-462e-94c4-e77f84f5233b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:31.965678 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 730/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:34.381623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c6b1-4cdf-4cee-a7eb-567ec5eb7e01 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:34.382217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c6b1-4cdf-4cee-a7eb-567ec5eb7e01 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:34.382217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c6b1-4cdf-4cee-a7eb-567ec5eb7e01 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:34.383526 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:34.389051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22b57-9223-41a6-ba15-e1d1981f2b17 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:34.389496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22b57-9223-41a6-ba15-e1d1981f2b17 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:34.389612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22b57-9223-41a6-ba15-e1d1981f2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:34.410061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fea22b57-9223-41a6-ba15-e1d1981f2b17 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:34.411281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fea22b57-9223-41a6-ba15-e1d1981f2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:34.421008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:34.459934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c6b1-4cdf-4cee-a7eb-567ec5eb7e01 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:34.472796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c6b1-4cdf-4cee-a7eb-567ec5eb7e01 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:34.477457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:34.478098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:34.478415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:34.478690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:34.489292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:34.490755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acc50e-8802-4811-a3f4-f7bb1a7ee782 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:34.500877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 733/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:36.887261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343843e2-134b-4d1d-a2c9-85037e30e701 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:36.888165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343843e2-134b-4d1d-a2c9-85037e30e701 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:36.888165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343843e2-134b-4d1d-a2c9-85037e30e701 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:36.890406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:36.896822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42094-ae51-4735-b812-368880096f99 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:36.897543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42094-ae51-4735-b812-368880096f99 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:36.897700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42094-ae51-4735-b812-368880096f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:36.917677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-48e42094-ae51-4735-b812-368880096f99 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:36.918858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48e42094-ae51-4735-b812-368880096f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:36.928090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:36.965774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343843e2-134b-4d1d-a2c9-85037e30e701 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:36.978736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343843e2-134b-4d1d-a2c9-85037e30e701 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:36.983021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:36.983665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:36.983947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:36.984222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:36.993792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:36.995225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f666c7e-43fc-49af-a8d8-b0dd5d04e79d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:37.005129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 733/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:39.381856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bd6f5-1a44-4d77-a9b1-2ac8095eb5eb None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:39.382452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bd6f5-1a44-4d77-a9b1-2ac8095eb5eb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:39.382452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bd6f5-1a44-4d77-a9b1-2ac8095eb5eb None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:39.383803 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:43:39.390313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00df1-821a-437d-9d46-c3d545cb6403 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:39.390783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00df1-821a-437d-9d46-c3d545cb6403 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:39.391098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f00df1-821a-437d-9d46-c3d545cb6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:39.418412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b8f00df1-821a-437d-9d46-c3d545cb6403 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:43:39.419623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8f00df1-821a-437d-9d46-c3d545cb6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:43:39.428710 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:43:39.466647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bd6f5-1a44-4d77-a9b1-2ac8095eb5eb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:43:39.482671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bd6f5-1a44-4d77-a9b1-2ac8095eb5eb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:43:39.486713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:43:39.487404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:43:39.487693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:43:39.487968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:43:39.499731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:43:39.501883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55f583-2f4f-4df5-8db7-c7d9f2e96748 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:43:39.513449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 736/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:49.411342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=20 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:49.508583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=23 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:16.271371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1e13-d309-492b-b896-3dc6bcaa7dae None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:16.272323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1e13-d309-492b-b896-3dc6bcaa7dae None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:16.272323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1e13-d309-492b-b896-3dc6bcaa7dae None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:16.274686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 735/1471] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:16.283588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a89fd-2fbc-447e-881d-7d700c81228e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:16.284037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a89fd-2fbc-447e-881d-7d700c81228e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:16.284175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a89fd-2fbc-447e-881d-7d700c81228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:16.305772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4e9a89fd-2fbc-447e-881d-7d700c81228e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:16.307002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e9a89fd-2fbc-447e-881d-7d700c81228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:16.316577 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 737/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:16.368772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca118a-28d5-4c5b-a0b7-2170a74b35b4 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:16.369081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca118a-28d5-4c5b-a0b7-2170a74b35b4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:16.369401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca118a-28d5-4c5b-a0b7-2170a74b35b4 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:16.371498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 736/1473] 10.222.0.39 () {54 vars in 962 bytes} [Sat Jun 25 20:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:16.376578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2442-1826-48a8-af62-b8823283d51e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:16.376871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2442-1826-48a8-af62-b8823283d51e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:16.377152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2442-1826-48a8-af62-b8823283d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:16.397201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1d7a2442-1826-48a8-af62-b8823283d51e None None] MFA Rules not processed for user `8cddedee376f4cf4a01caffdea20716d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:16.398412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d7a2442-1826-48a8-af62-b8823283d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:16.406312 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 738/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Jun 25 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:16.413652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca118a-28d5-4c5b-a0b7-2170a74b35b4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:16.426028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca118a-28d5-4c5b-a0b7-2170a74b35b4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:16.430348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:16.430981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:16.431282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:16.431527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:16.441092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:16.442533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1caa9-ca72-47f4-b8db-6fd72e05adb5 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:16.452083 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 737/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:18.848069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a6bc-5064-4486-b62e-2b4ae098c383 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:18.848638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a6bc-5064-4486-b62e-2b4ae098c383 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:18.848638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a6bc-5064-4486-b62e-2b4ae098c383 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:18.850028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 739/1476] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:18.855268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9f8b-5c34-4172-9c03-fba8262bb922 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:18.855722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9f8b-5c34-4172-9c03-fba8262bb922 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:18.855826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f9f8b-5c34-4172-9c03-fba8262bb922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:18.874727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ff0f9f8b-5c34-4172-9c03-fba8262bb922 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:18.875973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff0f9f8b-5c34-4172-9c03-fba8262bb922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:18.884905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 738/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:18.912927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a6bc-5064-4486-b62e-2b4ae098c383 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:18.933104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a6bc-5064-4486-b62e-2b4ae098c383 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:18.938867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:18.939527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:18.939812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:18.940079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:18.940862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:18.942611 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:18.942611 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:44:18.942611 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:44:18.943764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdefcb7-407b-4133-9c85-7daf0d54f17f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:18.968546 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 740/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 25 20:44:18 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:44:21.301414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5966-e0ad-44e5-8d13-bfc4a9c32cab None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:21.302012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5966-e0ad-44e5-8d13-bfc4a9c32cab None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:21.302012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad5966-e0ad-44e5-8d13-bfc4a9c32cab None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:21.304052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 739/1479] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:21.310749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2fda2-fc26-4f69-bdfe-8ac240156f3a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:21.311164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2fda2-fc26-4f69-bdfe-8ac240156f3a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:21.311366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2fda2-fc26-4f69-bdfe-8ac240156f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:21.334516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fcd2fda2-fc26-4f69-bdfe-8ac240156f3a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:21.335733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcd2fda2-fc26-4f69-bdfe-8ac240156f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:21.345443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 741/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:21.391294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad5966-e0ad-44e5-8d13-bfc4a9c32cab None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:21.406953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad5966-e0ad-44e5-8d13-bfc4a9c32cab None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:21.413300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:21.413938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:21.414215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:21.414563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:21.422853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:21.424442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196fb72-fcd8-4bc5-9842-392760aa122c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:21.434010 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 740/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:24.009924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f754c-e4a0-4f55-9eed-22c2c1b5c01b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:24.010514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f754c-e4a0-4f55-9eed-22c2c1b5c01b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:24.010514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f754c-e4a0-4f55-9eed-22c2c1b5c01b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:24.011877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 742/1482] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:24.017375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275966d9-3ab2-4f0a-8768-fe0d3fe279a6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:24.017805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275966d9-3ab2-4f0a-8768-fe0d3fe279a6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:24.017971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275966d9-3ab2-4f0a-8768-fe0d3fe279a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:24.036661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-275966d9-3ab2-4f0a-8768-fe0d3fe279a6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:24.037866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-275966d9-3ab2-4f0a-8768-fe0d3fe279a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:24.048518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 741/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:24.087053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f754c-e4a0-4f55-9eed-22c2c1b5c01b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:24.099612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f754c-e4a0-4f55-9eed-22c2c1b5c01b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:24.103506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:24.104146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:24.104438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:24.104729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:24.114243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:24.115693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318499a1-d2da-4e99-a1ef-3d472a2b8ed0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:24.125270 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 743/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:26.477270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2be7-f4a2-40a4-8c80-d4e46a88d0a0 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:26.477815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2be7-f4a2-40a4-8c80-d4e46a88d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:26.477815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2be7-f4a2-40a4-8c80-d4e46a88d0a0 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:26.479669 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 742/1485] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:26.485659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fdafe-d336-469f-ab65-87bff470e5ae None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:26.486148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fdafe-d336-469f-ab65-87bff470e5ae None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:26.486250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fdafe-d336-469f-ab65-87bff470e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:26.506143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-804fdafe-d336-469f-ab65-87bff470e5ae None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:26.507403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-804fdafe-d336-469f-ab65-87bff470e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:26.517222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 744/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:44:26.556167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef2be7-f4a2-40a4-8c80-d4e46a88d0a0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:26.568530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef2be7-f4a2-40a4-8c80-d4e46a88d0a0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:26.572410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:26.573079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:26.573362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:26.573639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:26.584307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:26.586490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb321-2b77-4bc1-b08b-6cd2487fae6c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:26.596285 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 743/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:29.046154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8fd74-b8d7-49f5-8747-e0bd872988b5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:29.046711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8fd74-b8d7-49f5-8747-e0bd872988b5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:29.046711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8fd74-b8d7-49f5-8747-e0bd872988b5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:29.048046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 745/1488] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:29.054074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d952-bbd2-4b49-8234-0cfb05390b42 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:29.054564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d952-bbd2-4b49-8234-0cfb05390b42 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:29.054721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d952-bbd2-4b49-8234-0cfb05390b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:29.078922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9665d952-bbd2-4b49-8234-0cfb05390b42 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:29.080071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9665d952-bbd2-4b49-8234-0cfb05390b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:29.088841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 744/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:29.130983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8fd74-b8d7-49f5-8747-e0bd872988b5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:29.143231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8fd74-b8d7-49f5-8747-e0bd872988b5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:29.147291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:29.147929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:29.148209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:29.148523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:29.158053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:29.159505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcbb2d-ed53-4e65-bfd3-d0690f7e063a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:29.169287 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 746/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:31.685762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368817-88a0-479d-9ae6-3d33688ab45c None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:31.686644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368817-88a0-479d-9ae6-3d33688ab45c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:31.686644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368817-88a0-479d-9ae6-3d33688ab45c None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:31.688843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 745/1491] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 25 20:44:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:31.697137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac1d7-48fa-4dbc-81f1-3a733466bdfc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:31.697595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac1d7-48fa-4dbc-81f1-3a733466bdfc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:31.697693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac1d7-48fa-4dbc-81f1-3a733466bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:31.717801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ca1ac1d7-48fa-4dbc-81f1-3a733466bdfc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:31.718988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca1ac1d7-48fa-4dbc-81f1-3a733466bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:31.727717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 747/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 25 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:31.767850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368817-88a0-479d-9ae6-3d33688ab45c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:31.780704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368817-88a0-479d-9ae6-3d33688ab45c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:31.785544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:31.786535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:31.786888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:31.787295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:31.802864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:31.804315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79f2e-3989-4b2e-b7ee-4c0f99f7e962 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:31.814552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 746/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:41.711557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=33 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:41.810002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=33 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:59.912200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:59.912834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:59.912834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:59.931021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:59.932282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:59.940379 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 748/1494] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:59.948699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:59.949188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:59.949299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:59.968808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:59.970034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:59.980290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 747/1495] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:59.985037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:59.995770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981a09a-0859-4f96-9ccd-951e920e8472 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.002531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.003218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.003871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.003871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.004504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:46:00.004813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.006990 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.006990 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:46:00.006990 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:46:00.006990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.022917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 749/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:46:00.032573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.042578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8d16-9bc1-41f6-b172-fd7ffc890f12 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.049055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.049718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.050008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.050277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.050976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.052835 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.052835 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:46:00.052835 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:46:00.054063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.092350 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 748/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:46:00 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:46:00.097142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.107234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e995c-ee07-4b98-a6ac-d1852f71f2d5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.162751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.163423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.163708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.163983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.164708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.165753 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.165753 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:46:00.165753 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:46:00.167056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.188840 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 750/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:46:00 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:46:00.193189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.203749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5b50a-835c-48b0-815f-d234f2e05cbb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.208449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.209112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.209393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.209662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.210376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.211402 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.211402 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:46:00.211402 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:46:00.212270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.225773 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 749/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:46:00.229923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.239786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34bcb0-ddad-4c2a-91b6-b7fe5374aec1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.247082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.248015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.248459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.248800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.249836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.251411 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.251411 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:46:00.251411 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:46:00.252751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e92e88-55d1-40eb-8391-7bdb35fd4621 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.269090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 751/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:46:00.273643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.284214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea756e-b914-48ed-aa45-0a1d9d3805f5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.289563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.290543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.290829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.291143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] PATH_INFO: `/v3/projects/bfded92d50a344e69230bfb87d609377/users/bd629d634aee48b8a975013e5fe1cde3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.307369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfded92d50a344e69230bfb87d609377, user_id=bd629d634aee48b8a975013e5fe1cde3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.308456 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.308456 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:46:00.308456 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:46:00.310366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39852a-ef99-46ce-b8a4-5e6eb9e04139 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.325847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 750/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:46:00 2022] PUT /identity/v3/projects/bfded92d50a344e69230bfb87d609377/users/bd629d634aee48b8a975013e5fe1cde3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:46:00.337628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fcba-3588-488f-8822-db68cecfa912 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.337956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fcba-3588-488f-8822-db68cecfa912 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.338238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fcba-3588-488f-8822-db68cecfa912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.365785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b469fcba-3588-488f-8822-db68cecfa912 None None] MFA Rules not processed for user `bd629d634aee48b8a975013e5fe1cde3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:46:00.366930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b469fcba-3588-488f-8822-db68cecfa912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:46:00.435198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 752/1502] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:46:00.451567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92830-17ee-4236-9885-fd869331f903 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.451852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92830-17ee-4236-9885-fd869331f903 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.452124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92830-17ee-4236-9885-fd869331f903 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.453546 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 751/1503] 10.222.0.39 () {54 vars in 963 bytes} [Sat Jun 25 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:46:00.458570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c59f-1f55-4752-95e6-9dd4bdafb3c7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.458862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c59f-1f55-4752-95e6-9dd4bdafb3c7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.459164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213c59f-1f55-4752-95e6-9dd4bdafb3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.477959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d213c59f-1f55-4752-95e6-9dd4bdafb3c7 None None] MFA Rules not processed for user `083565d7e7e3423486d9bfd51efaf318`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:46:00.479201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d213c59f-1f55-4752-95e6-9dd4bdafb3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:46:00.522801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:00.531617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 753/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 25 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:46:00.541400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92830-17ee-4236-9885-fd869331f903 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.553277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92830-17ee-4236-9885-fd869331f903 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.557306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.557949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.558213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.558488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.566801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.568248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.577270 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 752/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:46:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:46:00.622537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae46fc-85ce-4a54-8183-3a713f689fc1 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.622845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae46fc-85ce-4a54-8183-3a713f689fc1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.623125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae46fc-85ce-4a54-8183-3a713f689fc1 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.624442 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 754/1506] 10.222.0.39 () {52 vars in 829 bytes} [Sat Jun 25 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:46:00.628306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.696734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f31393-b3e2-476d-9359-5bebcaf87ba5 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.701715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.702591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.702867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.703139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] PATH_INFO: `/v3/users/bd629d634aee48b8a975013e5fe1cde3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.704335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd629d634aee48b8a975013e5fe1cde3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:00.705387 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:00.705387 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:46:00.705387 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:46:00.706583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:00.775818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd629d634aee48b8a975013e5fe1cde3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:00.776530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd629d634aee48b8a975013e5fe1cde3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:00.786205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd629d634aee48b8a975013e5fe1cde3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:00.808623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd629d634aee48b8a975013e5fe1cde3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:00.817237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:00.822269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd629d634aee48b8a975013e5fe1cde3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:00.830796 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 753/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:46:00 2022] DELETE /identity/v3/users/bd629d634aee48b8a975013e5fe1cde3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:46:00.835331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.835622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.835900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:00.853785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:46:00.854981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:46:00.919322 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 755/1508] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:46:00.929722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:00.932109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:46:00.990470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47449-e60d-4f7f-87f0-b45686f02562 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:00.994546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:00.995191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:00.995475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:00.995752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:01.005360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:01.006820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10426e0-a45d-4c20-95e0-3e4b0cd980d3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:01.016517 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 754/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:46:01.401836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:46:01.403444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:46:01.415559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00989142-8f64-40c1-8a0f-1d56478e21ac None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:46:01.420741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:46:01.421640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:46:01.421921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:46:01.422191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] PATH_INFO: `/v3/projects/bfded92d50a344e69230bfb87d609377` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:46:01.423459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfded92d50a344e69230bfb87d609377)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:46:01.424715 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:46:01.424715 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:46:01.424715 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:46:01.425914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:46:01.487542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfded92d50a344e69230bfb87d609377', 'request_id': 'req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:01.497945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfded92d50a344e69230bfb87d609377', 'request_id': 'req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:01.505901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfded92d50a344e69230bfb87d609377', 'request_id': 'req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:01.524453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] The token cache is being invalidate because project bfded92d50a344e69230bfb87d609377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:46:01.524757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:01.525440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d41245f-a7fa-4f3b-96ee-4da9d17aa0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:46:01.527073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 756/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:46:01 2022] DELETE /identity/v3/projects/bfded92d50a344e69230bfb87d609377 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:46:11.012631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=29 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:11.521320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:20.138346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b641e-6286-4ac1-9d1b-ff8ca04f7bdf None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:20.138945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b641e-6286-4ac1-9d1b-ff8ca04f7bdf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:20.138945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b641e-6286-4ac1-9d1b-ff8ca04f7bdf None None] PATH_INFO: `/v3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:20.140185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 755/1511] 10.222.0.16 () {54 vars in 925 bytes} [Sat Jun 25 20:49:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:49:20.146784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccc6e-5b60-4e96-8b65-80577062c50f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:20.147247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccc6e-5b60-4e96-8b65-80577062c50f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:20.147347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccc6e-5b60-4e96-8b65-80577062c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:20.166915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-45fccc6e-5b60-4e96-8b65-80577062c50f None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:49:20.168172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-45fccc6e-5b60-4e96-8b65-80577062c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:49:20.234712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 757/1512] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Jun 25 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:24.414600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9eda9-0c35-482b-bf6f-c512d75e8a0d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:24.415448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9eda9-0c35-482b-bf6f-c512d75e8a0d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:24.415448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9eda9-0c35-482b-bf6f-c512d75e8a0d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:24.417782 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 756/1513] 10.222.0.39 () {54 vars in 960 bytes} [Sat Jun 25 20:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:49:24.426401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307295af-5468-4306-8426-532ec11a7bbc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:24.426843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307295af-5468-4306-8426-532ec11a7bbc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:24.426945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307295af-5468-4306-8426-532ec11a7bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:24.447186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-307295af-5468-4306-8426-532ec11a7bbc None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:49:24.448480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-307295af-5468-4306-8426-532ec11a7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:49:24.459490 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 758/1514] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 25 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:24.467931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9eda9-0c35-482b-bf6f-c512d75e8a0d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:49:24.484341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9eda9-0c35-482b-bf6f-c512d75e8a0d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:49:24.493059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:49:24.493738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:24.494186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:24.494590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:24.509764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:49:24.512393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166cc80-811a-4ca2-9fa2-6ad8eaaeff11 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:49:24.526365 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 757/1515] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:49:25.219741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a6d0-ac9a-4ccd-ba84-b18333566eb4 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:25.220217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a6d0-ac9a-4ccd-ba84-b18333566eb4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:25.220717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a6d0-ac9a-4ccd-ba84-b18333566eb4 None None] PATH_INFO: `/v3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:25.222884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 759/1516] 10.222.0.20 () {54 vars in 925 bytes} [Sat Jun 25 20:49:25 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:49:25.231745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7824f-7bfa-44f6-9833-beae927bb62b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:25.232230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7824f-7bfa-44f6-9833-beae927bb62b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:25.232760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7824f-7bfa-44f6-9833-beae927bb62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:25.256390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-04e7824f-7bfa-44f6-9833-beae927bb62b None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:49:25.257704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04e7824f-7bfa-44f6-9833-beae927bb62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:49:25.268040 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 758/1517] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Jun 25 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:29.004955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eac60-ca94-4bf6-81ab-cd544408ff9f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:29.005451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eac60-ca94-4bf6-81ab-cd544408ff9f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:29.005788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eac60-ca94-4bf6-81ab-cd544408ff9f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:29.007611 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 760/1518] 10.222.0.39 () {54 vars in 960 bytes} [Sat Jun 25 20:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:49:29.013670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fd19-a651-42b6-b1c6-c986a2296db5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:29.014130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fd19-a651-42b6-b1c6-c986a2296db5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:29.014273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fd19-a651-42b6-b1c6-c986a2296db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:29.038126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9341fd19-a651-42b6-b1c6-c986a2296db5 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:49:29.039318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9341fd19-a651-42b6-b1c6-c986a2296db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:49:29.048950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 759/1519] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 25 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:29.057108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eac60-ca94-4bf6-81ab-cd544408ff9f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:49:29.072566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eac60-ca94-4bf6-81ab-cd544408ff9f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:49:29.078430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:49:29.079024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:29.079309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:29.079613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:29.088447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:49:29.090094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c184e-4548-4bd3-8c94-24eb121248a5 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:49:29.100633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 761/1520] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:49:39.032457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:39.096579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=38 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:02.920019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:02.920652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:02.920652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:02.922039 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 760/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:50:02.927272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de128-59de-456e-9bcb-05c6af8acd91 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:02.927707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de128-59de-456e-9bcb-05c6af8acd91 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:02.927831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de128-59de-456e-9bcb-05c6af8acd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:02.946423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d06de128-59de-456e-9bcb-05c6af8acd91 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:02.947642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d06de128-59de-456e-9bcb-05c6af8acd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:03.010678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 762/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:50:03.177011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:03.180346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:03.262350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148492c3-b288-44de-a5ae-5aa68d52a09b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:03.267830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:03.268483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:03.268785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:03.269061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:03.277736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:03.279340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb9a6e-e12e-46bb-871b-ec428b6994e2 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:03.288862 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 761/1523] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:04.149284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bd85-a2fb-4987-9495-0406752ddad5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:04.149816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bd85-a2fb-4987-9495-0406752ddad5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:04.149816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bd85-a2fb-4987-9495-0406752ddad5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:04.151133 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 763/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:50:04.156369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50697f1-4cbf-425e-9fc1-48150c1b3c21 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:04.156827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50697f1-4cbf-425e-9fc1-48150c1b3c21 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:04.156942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50697f1-4cbf-425e-9fc1-48150c1b3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:04.177182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c50697f1-4cbf-425e-9fc1-48150c1b3c21 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:04.178401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c50697f1-4cbf-425e-9fc1-48150c1b3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:04.187625 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 762/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:50:04.348091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62bd85-a2fb-4987-9495-0406752ddad5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:04.369979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62bd85-a2fb-4987-9495-0406752ddad5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:04.376056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:04.376800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:04.377087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:04.377359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:04.386076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:04.387660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32747dd-d1ce-4916-9d6f-052536d3e9d2 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:04.397408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 764/1526] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:08.366771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:08.367633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:08.367633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:08.369919 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 763/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:50:08.379002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf89b2-64fc-4fdd-9198-53f983f07c1f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:08.379435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf89b2-64fc-4fdd-9198-53f983f07c1f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:08.379622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf89b2-64fc-4fdd-9198-53f983f07c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:08.398847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e3bf89b2-64fc-4fdd-9198-53f983f07c1f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:08.400052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3bf89b2-64fc-4fdd-9198-53f983f07c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:08.408814 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 765/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:50:08.447101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:08.449223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:08.509137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ed413-0516-4e18-a8f0-25e5f201319e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:08.513063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:08.513700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:08.513990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:08.514264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:08.523642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:08.525129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c81d2-f43d-419c-aa29-4b484d5a8c64 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:08.534728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 764/1529] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:10.793446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f1fb-9bdf-4e04-b79c-6c922f3a196f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:10.794021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f1fb-9bdf-4e04-b79c-6c922f3a196f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:10.794021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f1fb-9bdf-4e04-b79c-6c922f3a196f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:10.795371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 766/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:50:10.801112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f7dc-87ed-4b12-953f-09312ef42249 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:10.801657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f7dc-87ed-4b12-953f-09312ef42249 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:10.801657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f7dc-87ed-4b12-953f-09312ef42249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:10.823269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6909f7dc-87ed-4b12-953f-09312ef42249 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:10.824474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6909f7dc-87ed-4b12-953f-09312ef42249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:10.832939 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 765/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:50:10.873936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f1fb-9bdf-4e04-b79c-6c922f3a196f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:10.886525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f1fb-9bdf-4e04-b79c-6c922f3a196f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:10.890538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:10.891174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:10.891453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:10.891728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:10.901588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:10.903028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931456a-1570-49cd-bb38-30ccd4f75e76 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:10.913053 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 767/1532] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:20.817392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=66 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:20.908516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=42 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:03.759269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4f74-9130-4100-bc7d-0e86c2f1e684 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:03.759795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4f74-9130-4100-bc7d-0e86c2f1e684 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:03.759872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4f74-9130-4100-bc7d-0e86c2f1e684 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:03.761365 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 766/1533] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:03.766806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909105a-d973-4953-8af8-dcab40b63a1c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:03.767205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909105a-d973-4953-8af8-dcab40b63a1c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:03.767379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909105a-d973-4953-8af8-dcab40b63a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:03.786111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3909105a-d973-4953-8af8-dcab40b63a1c None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:03.787387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3909105a-d973-4953-8af8-dcab40b63a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:03.796848 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 768/1534] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:51:13.780728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:42.351514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26938b-45f7-49bb-a81f-0113a6706cca None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.352081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26938b-45f7-49bb-a81f-0113a6706cca None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.352081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26938b-45f7-49bb-a81f-0113a6706cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.377366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4b26938b-45f7-49bb-a81f-0113a6706cca None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.378579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4b26938b-45f7-49bb-a81f-0113a6706cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.389290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 767/1535] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.398221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f332ff-914b-47ef-af6b-bc474f256be0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.398756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f332ff-914b-47ef-af6b-bc474f256be0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.398756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f332ff-914b-47ef-af6b-bc474f256be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.414286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c472-7f99-4fe4-9977-d6816837c943 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.414637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c472-7f99-4fe4-9977-d6816837c943 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.414885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c472-7f99-4fe4-9977-d6816837c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.432966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-15f332ff-914b-47ef-af6b-bc474f256be0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.434675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-15f332ff-914b-47ef-af6b-bc474f256be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.446047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5832c472-7f99-4fe4-9977-d6816837c943 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.447373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5832c472-7f99-4fe4-9977-d6816837c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.451301 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 769/1536] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.457051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.457583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.458066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.463240 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 768/1537] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.465650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15498fb3-9829-4af9-8282-8dc781ae8cfb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.465943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15498fb3-9829-4af9-8282-8dc781ae8cfb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.466224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15498fb3-9829-4af9-8282-8dc781ae8cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.486726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.487844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.504519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-15498fb3-9829-4af9-8282-8dc781ae8cfb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.506167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15498fb3-9829-4af9-8282-8dc781ae8cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.506462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 770/1538] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.507411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.522031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e57e-0640-4f0b-a872-09b42c5695c3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.531649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.531649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.531649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.531649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.532025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:42.532025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.532938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf681d-ea10-424b-ab20-0d45faa9c391 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.536382 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 769/1539] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 25 20:51:42.537952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d622-0e2d-436c-9633-78f69206f78e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.538428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d622-0e2d-436c-9633-78f69206f78e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.538884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d622-0e2d-436c-9633-78f69206f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.546842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 771/1540] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:42.548291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d3491-7d0c-499f-a21d-702a2adc2a68 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.548589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d3491-7d0c-499f-a21d-702a2adc2a68 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.548868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d3491-7d0c-499f-a21d-702a2adc2a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.561042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9d38d622-0e2d-436c-9633-78f69206f78e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.562979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9d38d622-0e2d-436c-9633-78f69206f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.567671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bb2d3491-7d0c-499f-a21d-702a2adc2a68 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.568888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb2d3491-7d0c-499f-a21d-702a2adc2a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.571735 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 770/1541] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.573298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cec1-72d2-4b8a-99b1-eeed1afcd2b6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.573594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cec1-72d2-4b8a-99b1-eeed1afcd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.573879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cec1-72d2-4b8a-99b1-eeed1afcd2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.577513 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 772/1542] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.579266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.579708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.580119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.594116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8b4cec1-72d2-4b8a-99b1-eeed1afcd2b6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.595180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8b4cec1-72d2-4b8a-99b1-eeed1afcd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.602648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.603959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.605254 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 771/1543] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.606523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.606810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.607089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.612674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 773/1544] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.613700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.626429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929d06-daca-45fd-95e2-0119150674d1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.631939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.632771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.636530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.636530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.636768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.636882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:42.636882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.637032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.637113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35d459-f828-4fa0-9f24-6dd02cb6a448 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.647719 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 772/1545] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.648650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.649570 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 774/1546] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:42.650723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c11e-8c3f-445a-acf2-d0d3aa1ee6af None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.651017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c11e-8c3f-445a-acf2-d0d3aa1ee6af None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.651299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852c11e-8c3f-445a-acf2-d0d3aa1ee6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.665838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359de1-a361-4278-8676-3ce533cdab43 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.670371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.671031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.671342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.671678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.672362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.672851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e852c11e-8c3f-445a-acf2-d0d3aa1ee6af None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.675306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e852c11e-8c3f-445a-acf2-d0d3aa1ee6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.675423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.682266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 775/1547] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.683507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eaca-6722-4338-a13f-034555820dd9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.683795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eaca-6722-4338-a13f-034555820dd9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.684072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36eaca-6722-4338-a13f-034555820dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.703219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 773/1548] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:42.703873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.705431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8c36eaca-6722-4338-a13f-034555820dd9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.707370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c36eaca-6722-4338-a13f-034555820dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.772840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea0f0e-29af-4cbf-929f-d76b480b7ed8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.777415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.778078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.778359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.778635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.778733 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 776/1549] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.779355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:42.779660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.779931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d136a4-44bd-4126-aacf-d32ae93596d3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.780225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d136a4-44bd-4126-aacf-d32ae93596d3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.780538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d136a4-44bd-4126-aacf-d32ae93596d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.780886 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:42.780886 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:51:42.780886 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:51:42.781847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fbd31-25f1-4a01-ae15-2e7d61b6cec7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.793930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 774/1550] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:42.795217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.795503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.795779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.800846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-54d136a4-44bd-4126-aacf-d32ae93596d3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.802318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-54d136a4-44bd-4126-aacf-d32ae93596d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.814063 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 777/1551] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.814063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.814063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.814063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.815485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.816730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.824871 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 775/1552] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.825501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.835116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927a4d2-a327-47cb-aff8-8c5635ed7ed7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.835513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:42.836766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:42.840088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.840806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.841088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.841364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.842050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.844035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.845385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 778/1553] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:42.846311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.855560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e938796-8ee2-4460-b333-c967c22f09c5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.860101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.860783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.861062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.861332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.862044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:42.862346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.863971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.875269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 776/1554] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:42.876219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 779/1555] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:42.876339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.881367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.899411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2f6e-8e50-4f24-97b2-bebfc293525d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.951511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a9d40-d402-4c2f-a8ec-02d79ec04c15 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.956277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.956277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.956514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.956801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.957223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.957533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:42.957842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.957930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.958173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.958449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.959156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.959525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.960190 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:42.960190 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:51:42.960190 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:51:42.961432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:42.970993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:42.979497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 780/1556] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:42.979497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.986464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9c43-62b2-4f48-b66f-7c57c4d2aa9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:42.988764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 777/1557] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:42.989702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:42.993257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:42.993953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:42.994235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:42.994513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:42.995203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:42.996232 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:42.996232 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:51:42.996232 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:51:42.997462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.000299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f647d-8759-4a6a-a2fd-76f4fc830021 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.001783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:43.005110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.005758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.006036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.006313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.007031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:43.007337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.008976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebe4f7-0273-4bc5-9f7a-0851b72035af admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.022479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 778/1558] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:43.022479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.022479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.022479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.029994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 781/1559] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:42 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.029994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.045813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:43.047204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:43.089588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd30-cbca-4c9b-88a5-8ef2612adf00 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.095293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.095993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.096283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.096582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.097311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:43.097618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.099248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.111408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 782/1560] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:43.112448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.113895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 779/1561] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:43.114891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.122038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcffeae-a8df-4eb2-9e86-2b594d68f0e0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.127117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c5b0-65e3-4259-892b-1f5c7d5335e1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.127329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.127991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.128278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.128602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.129293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.131225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.132389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.133295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.133711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.134018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.134702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.136651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.153694 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 783/1562] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.154594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.163706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 780/1563] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.164540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546cc12-d343-4ae1-baae-f11d7be36c64 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.164961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.222112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.222781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.223063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.223339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.224028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.226115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.229459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaba19-a368-41cd-be45-2f564b96b4b3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.234242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.234916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.235198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.235475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.236230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.237887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.251375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 781/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.251375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.252695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 784/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.253523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.258769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ec2b-c675-482e-831d-8d8b61ff152c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.309034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:43.314849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:43.322544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.323441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.323814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56086dd-f7f8-4658-9ccf-cdd902fe7a51 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.323932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.324175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.324994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.327161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.329380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.330056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.330341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.330618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.331312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.333270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.348459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 782/1566] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.349495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.359900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa98b8-9723-4448-992a-fc40a56a394c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.360595 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 785/1567] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.361227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.420483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.421283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.421617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.421951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.422748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:43.423232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.425223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.426135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7432-29c4-4410-9e49-d7488f307e7c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.430800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.431469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.431753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.432029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.432762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.434681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.437863 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 783/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:43.438698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.448663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089721b-1823-4c4b-b0c9-aed5617fd904 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.454695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.455356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.455636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.455907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.456652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.458260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.470042 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 784/1569] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.470879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.478544 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 786/1570] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.478544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.482756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815750f-6f1c-4846-98cb-58cf79434c6d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.539851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8175291-fc52-4b24-a900-ae030d0ca0b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.543085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.543085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.543085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.543085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.543778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.545151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.545789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.545888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.546093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.546401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.551973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.557933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.572181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 785/1571] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.572356 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 787/1572] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.572476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.572569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.581333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d1d5-b79d-41e3-b49e-e577bac5581b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.583857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938080a7-7a6e-43b0-94e5-a69a91e400ac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.586057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.586700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.586982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.587256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.588110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.588701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.589367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.590025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.590129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.590310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.591000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.592957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.600119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 788/1573] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.604229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.613676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 786/1574] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.614462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93580c7-9a6d-4f82-bdda-73c29d1e6e8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.614583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.619226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.619890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.620174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.620501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.621164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.623089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.624303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc747-fe3f-4cb6-8034-1b340663b627 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.628930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.629592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.629880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.630158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.632636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.634579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.645485 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 789/1575] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.646323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.657790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab808b0-b224-49f3-a91a-f3ddb1dec40e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.662807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.663479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.663758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.664034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.664787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.666422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.669455 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 787/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.672715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.678425 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 790/1577] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.682552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.692094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:43.693419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a94391-21aa-4325-84fb-7b4c8ab905a7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.706702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:43.736968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11fbd-b355-40a3-a91d-4b758a272d0e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.741769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.742491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.742745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.743022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.743712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.745753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.759476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.760183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.760542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.760839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.761633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.763256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.770283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 788/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.770283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.774326 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 791/1579] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.775297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.782863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d78e3a-c259-4beb-9ef1-8d83af967831 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.785132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f50f8-3427-48cd-9107-4f4cd3d9f14a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.787584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.788515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.788807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.789099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] PATH_INFO: `/v3/projects/4ac47b62cfec4f4dbe0af7582adb297c/users/a6598a465d994108ba50373a85313225/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.790102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.790777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.791061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.791339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.792098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.793735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.804284 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 792/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.805960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac47b62cfec4f4dbe0af7582adb297c, user_id=a6598a465d994108ba50373a85313225, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.808483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.808864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.818975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6294-b2ab-4739-ab14-16d504d56a0a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.825795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.826444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.826693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 789/1581] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:43 2022] PUT /identity/v3/projects/4ac47b62cfec4f4dbe0af7582adb297c/users/a6598a465d994108ba50373a85313225/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:43.826804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.827000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.827732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.827835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.829483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.841253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 793/1582] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.841985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.851704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432edb8-27f9-4f77-8562-ea9d8b77a29e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.898603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb1e2-653f-46d4-8e32-7e1cefae8a3d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.903226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.903936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.904220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.904541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.905273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.906920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.910384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.911073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.911354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.911628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.912319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.914284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.916844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 790/1583] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:43.920710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.930820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eea53-8269-4559-95d7-834538f36457 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:43.935694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:43.936650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:43.937072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:43.937355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] PATH_INFO: `/v3/projects/fb34595547bf4acc9abbb87c043554ca/users/259e4c3f5ff24d5b955ec36009319598/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:43.953543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb34595547bf4acc9abbb87c043554ca, user_id=259e4c3f5ff24d5b955ec36009319598, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:43.956625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:43.959169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 794/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:43 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:43.960129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.972564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 791/1585] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:43 2022] PUT /identity/v3/projects/fb34595547bf4acc9abbb87c043554ca/users/259e4c3f5ff24d5b955ec36009319598/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:43.973423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:43.992129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee88b6-cd02-4721-ab1f-11dc61c0b7fa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.034099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.036618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.068380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.069078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.069359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.069631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.071051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.072707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.083230 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 795/1586] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.083951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.088697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a0a8-e81c-4e9a-b857-73a208a96fd2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.094144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f4b0-c65b-4162-88b0-48ddd230118d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.094267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.094812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.095092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.095366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.096087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.097760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413576-ed63-4e2c-bc77-79ed994c06a8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.098852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.099729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.100046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.100325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] PATH_INFO: `/v3/projects/9b9e4621cb39462ba663e92f2e38a0b5/users/de7f658e8ff74ef2bc3a90c74b0013eb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.109752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 792/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.111214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.111404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.111662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.116968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9e4621cb39462ba663e92f2e38a0b5, user_id=de7f658e8ff74ef2bc3a90c74b0013eb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.118060 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:44.118060 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:51:44.118060 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:51:44.119986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.134860 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 796/1588] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/9b9e4621cb39462ba663e92f2e38a0b5/users/de7f658e8ff74ef2bc3a90c74b0013eb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:44.135704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.148226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] MFA Rules not processed for user `a6598a465d994108ba50373a85313225`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:44.149636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:44.205367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08b75d-6329-4c88-a7cc-45f62484f69c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.210099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.210807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.211096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.211332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.212056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.213747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.221215 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 793/1589] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:44.222064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.228982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 797/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.230204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.232392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b561-8b77-4f2d-8a81-ee837892b15b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.236955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.237664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.237941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.238212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.238929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.240550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ace8b-41c8-4488-9fd7-73930712a68a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.241027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86dc4-298d-4324-abbf-6da2487e753e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.245648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.246301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.246582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.246857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.247582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.249380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.250792 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 794/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.252023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.252721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.252721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.262241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 798/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.263146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.274660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6839-d73d-4119-b4be-6c5f7013a9e9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.280535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.281133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] MFA Rules not processed for user `259e4c3f5ff24d5b955ec36009319598`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:44.281279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.281480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.281908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.282405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:44.282691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.284357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.297009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 799/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.298067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.308380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347a323-ce09-4a14-91f4-ed497d24b413 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.314005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.314876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.315153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.315421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] PATH_INFO: `/v3/projects/664d01c5d78e44c285637b71109a64cf/users/6051f7618a54487583f39d4c8291a4e8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.331179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d01c5d78e44c285637b71109a64cf, user_id=6051f7618a54487583f39d4c8291a4e8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.333961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314b1a-c0a8-4fef-bff9-ed067186f787 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.348802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 800/1594] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/664d01c5d78e44c285637b71109a64cf/users/6051f7618a54487583f39d4c8291a4e8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:44.350238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.350339 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 795/1595] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:44.350413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.350613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.350959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.364790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2bd56-b3a0-403e-8d83-5fee12fcc4e3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.379643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] MFA Rules not processed for user `de7f658e8ff74ef2bc3a90c74b0013eb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:44.381022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:44.381498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.418503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.427787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.428633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.429054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.429343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.430076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.432013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.447713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 801/1596] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:44.448591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.458671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f02660-e69b-4ba5-8bfd-88fbcdca601f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.465469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 796/1597] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:44.465620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.465736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.465828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.465828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.465828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] PATH_INFO: `/v3/projects/83b590e72dc1455aa37da0d5bf462da8/users/da4f361889f74aa5aa22873d9d33f98c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.481119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b590e72dc1455aa37da0d5bf462da8, user_id=da4f361889f74aa5aa22873d9d33f98c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.483980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.498463 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 802/1598] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/83b590e72dc1455aa37da0d5bf462da8/users/da4f361889f74aa5aa22873d9d33f98c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:44.499320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.528822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b2df8-cb8e-44ba-b5a7-8af26eddaeaa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.563206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2fabf-6eec-4a4c-9887-cdd2630cf884 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.568788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.569512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.569803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.570080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.570821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.572489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.582460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 803/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:44.583254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.584630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.585582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.586172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.586454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] PATH_INFO: `/v3/projects/c4358e7685ba41f4bfe0b618802adbe7/users/c0f0e6e1053d4f25b9da4adfd2b6d0e6/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.593194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40784a-a9cf-41af-97f9-828543cf9cd9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.599317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.600308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.600733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.601006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] PATH_INFO: `/v3/projects/a64e77a822d5456ebbd476d69ff88efd/users/ce466f09e3fd47ccb15ecd50338aed3a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.603469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4358e7685ba41f4bfe0b618802adbe7, user_id=c0f0e6e1053d4f25b9da4adfd2b6d0e6, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.606123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.619584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e77a822d5456ebbd476d69ff88efd, user_id=ce466f09e3fd47ccb15ecd50338aed3a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.620968 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 797/1600] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/c4358e7685ba41f4bfe0b618802adbe7/users/c0f0e6e1053d4f25b9da4adfd2b6d0e6/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:44.621875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.622305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de3768-3b52-4648-a719-62a8e45f8267 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.642205 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 804/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/a64e77a822d5456ebbd476d69ff88efd/users/ce466f09e3fd47ccb15ecd50338aed3a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:44.643505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.643795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.644072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.664928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.669856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] MFA Rules not processed for user `6051f7618a54487583f39d4c8291a4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:44.671086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:44.693342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d26e61-cbc7-471e-bf76-60c324a05353 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.735702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 805/1602] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:44.740273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.748581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.749291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.749613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.749888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.750615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.752551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.756917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.778601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 798/1603] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:44.779408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.805725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45de20c-d224-4036-9987-e0bff37da973 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.845141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328321-93bb-4aa5-aed9-a3156ee3b8f1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.851279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.851965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.852247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.852563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.853282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.855243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5820d3-5653-4083-810b-21305a572b1a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.863015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.863691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.863975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.864284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.865020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.867103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:44.876225 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 799/1604] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:44.877625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ce75-edf6-4ead-a81a-79eec336a1aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.878029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ce75-edf6-4ead-a81a-79eec336a1aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.878309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ce75-edf6-4ead-a81a-79eec336a1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.900401 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 806/1605] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:44.901583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:44.906633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7630ce75-edf6-4ead-a81a-79eec336a1aa None None] MFA Rules not processed for user `da4f361889f74aa5aa22873d9d33f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:44.907831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7630ce75-edf6-4ead-a81a-79eec336a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:44.955048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:44.967612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddaec3-6a79-4a9a-8d99-160a773f4817 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:44.972316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:44.973277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.973558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.973832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] PATH_INFO: `/v3/projects/c120d28e8dbc44b6a0fd1c411b828e35/users/432e697b89654407ab9d5d4ed54a9d81/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.979057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 800/1606] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:44.980497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:44.980793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:44.981072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:44.989924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c120d28e8dbc44b6a0fd1c411b828e35, user_id=432e697b89654407ab9d5d4ed54a9d81, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:44.992691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fce306-fc8b-42cd-a505-d6a089a0f32d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.006423 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 807/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:44 2022] PUT /identity/v3/projects/c120d28e8dbc44b6a0fd1c411b828e35/users/432e697b89654407ab9d5d4ed54a9d81/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:45.007895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.008187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.008386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] MFA Rules not processed for user `c0f0e6e1053d4f25b9da4adfd2b6d0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:45.008505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.009688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:45.040364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] MFA Rules not processed for user `ce466f09e3fd47ccb15ecd50338aed3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:45.041652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:45.060397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.079305 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 801/1608] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:45.080305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.111331 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 808/1609] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:45.112235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.151187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4eb66-7a1c-44a6-a418-0432924fcb4b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.155976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.156747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.157034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.157297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.158024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.159953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.173239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccb3e9-9c67-46bb-9a0e-b4b95c38c14b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.179148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.179853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.180141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.180432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.181142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.183091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.189140 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 802/1610] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.189140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.210045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 809/1611] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.210045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.216379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25745930-7776-48d0-90a2-81686303da4d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.256131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85481-248a-45b1-b849-ad209c6bdf93 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.260974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.261664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.261953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.262231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.262957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.264615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.265937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.273999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.274673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.274952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.275246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.275929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.276663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 803/1612] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:45.277546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.277920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4670-5a58-448b-80cf-2d5d362b2515 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.287504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece576a8-a84d-493d-a345-b7ef698fcc2d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.292711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.293375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.293661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.293989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.294672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.296801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.302432 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 810/1613] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.302432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.302432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.302432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.327641 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 804/1614] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.327641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.327937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] MFA Rules not processed for user `432e697b89654407ab9d5d4ed54a9d81`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:45.328014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:45.328101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:45.356976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.403299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 811/1615] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:45.404046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.434349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fe78e-69a1-44ed-b150-fe3aacd1eda3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.438160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.438807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.439090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.439372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.466931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6165e-00f3-409f-b279-610a43b9141d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.471730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.472398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.472715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.472989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.473695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.475628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.498872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.500392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.501546 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 812/1616] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.502364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.509843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 805/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:45.510646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.521537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a12ab-3937-42b1-8a11-685d185c6ddd service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.573947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.579859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972e4ed-bee6-4594-ae06-9b4f2037711e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.585096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.585328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.585832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.586120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.586227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.586398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.586494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.586826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.587157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.587631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.588816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.590176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.600285 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 806/1618] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:45.600975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.614045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2883d6-763d-4e99-9210-7dd340713d6e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.615864 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 813/1619] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.619131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.619919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.620181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.620494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.620835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] PATH_INFO: `/v3/projects/5429a69a71ab4ba5958b1e1419d39216/users/b60f2ea21b304fc9b002e826e91a2d3b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.629997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75037c-2ecb-4b8e-af21-752477231468 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.635164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.636002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.636308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.636685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.637469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.637804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5429a69a71ab4ba5958b1e1419d39216, user_id=b60f2ea21b304fc9b002e826e91a2d3b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.639203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.640566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.650802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 814/1620] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:45.651724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.664247 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 807/1621] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:45 2022] PUT /identity/v3/projects/5429a69a71ab4ba5958b1e1419d39216/users/b60f2ea21b304fc9b002e826e91a2d3b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:45.665172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.667869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf4a0-d3d2-4010-8ae5-3ec793e2bef5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.708722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.732100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167547f-4dc4-4768-bd3f-56ce039e7da5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.737136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.737819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.738103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.738380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.739107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.741074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.746190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.746190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.746190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.746190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.746644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.747831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.769737 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 808/1622] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.770632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.775715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 815/1623] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.775715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.786959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034272d3-217b-45ee-a8c2-f2a4a7403460 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.855249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.855542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca061708-4147-4a7f-b6c4-6323bc500f88 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.856157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.856461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.856735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] PATH_INFO: `/v3/projects/8619324782ff425faf4367cfa4e5d7ef/users/d6bfa817f7b14b84a07bd6652fe0466d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.860319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.861028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.861316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.861593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.862290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.864223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.870938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8619324782ff425faf4367cfa4e5d7ef, user_id=d6bfa817f7b14b84a07bd6652fe0466d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.873631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.887950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 809/1624] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:45.888116 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 816/1625] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:45 2022] PUT /identity/v3/projects/8619324782ff425faf4367cfa4e5d7ef/users/d6bfa817f7b14b84a07bd6652fe0466d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:45.888932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.889280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.899695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d586-fd08-44b5-b6ac-3a19dae51a96 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.937950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:45.952503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467a44-3381-41c4-bb68-90d056d2a3eb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.956908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.957238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.957870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.957961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.958158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.958259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.958437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] PATH_INFO: `/v3/projects/6df32fdb9d9d4277bd36a129adaddc20/users/d7abe5e437a9421682db3fb6f26cebfd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.958521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.959269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.960870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.971465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 817/1626] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:45.972262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:45.974479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df32fdb9d9d4277bd36a129adaddc20, user_id=d7abe5e437a9421682db3fb6f26cebfd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.977245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.982405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc762c86-478c-4fdc-a580-9caf8f9eb4c7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:45.987573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:45.988247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:45.988570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:45.988848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:45.989592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:45.991343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:45.992141 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 810/1627] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:45 2022] PUT /identity/v3/projects/6df32fdb9d9d4277bd36a129adaddc20/users/d7abe5e437a9421682db3fb6f26cebfd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:45.995226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.005317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 818/1628] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.005317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.013134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f03c-b244-4dac-817f-94a184afc004 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.042651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.057174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9b91-270e-402f-acda-59e739c5d2dd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.062188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.062575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.062860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.063138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.063835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.065827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.072192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.072976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.073256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.073538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.074265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.075929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.086384 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 811/1629] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:45 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:46.090283 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 819/1630] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.090357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.090424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.099017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598409db-e7ca-4218-ae05-624406e65b6e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.099706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847796-fd56-4321-a643-14123b8a4c76 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.103891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.104415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.104804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.105098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.105343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.105440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.105627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.105904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] PATH_INFO: `/v3/users/c0f0e6e1053d4f25b9da4adfd2b6d0e6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.106080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.107100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f0e6e1053d4f25b9da4adfd2b6d0e6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.107681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.109257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.118067 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 820/1631] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.118667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.128161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880927e8-4bba-43cd-bf2e-74fdb4b85e36 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.132830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.133518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.133843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.134470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.135451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.137287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.149393 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 821/1632] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.150344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.157724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f0e6e1053d4f25b9da4adfd2b6d0e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:46.158401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f0e6e1053d4f25b9da4adfd2b6d0e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:46.160266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49511be6-3f49-4eca-9d4c-b2d55b795f08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.165892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.166548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f0e6e1053d4f25b9da4adfd2b6d0e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:46.166740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.167025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.167307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] PATH_INFO: `/v3/projects/d3b4d6664b004fa898eb78144546bf84/users/13367ece59fb49a7adf9bc261c65b4e0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.179325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f0e6e1053d4f25b9da4adfd2b6d0e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:46.182876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4d6664b004fa898eb78144546bf84, user_id=13367ece59fb49a7adf9bc261c65b4e0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.185787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.186413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f0e6e1053d4f25b9da4adfd2b6d0e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:46.192552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 812/1633] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:46 2022] DELETE /identity/v3/users/c0f0e6e1053d4f25b9da4adfd2b6d0e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.193411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.194856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.203850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 822/1634] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/d3b4d6664b004fa898eb78144546bf84/users/13367ece59fb49a7adf9bc261c65b4e0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.204833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.206298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.224236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.264000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779f531-a185-43f0-9f06-a256c486289c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.269209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec3c-ef81-427a-971e-fcde54f64d5d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.269825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.270654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.270966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.271270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.272030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.273732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.274967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.275658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.276227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.276227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] PATH_INFO: `/v3/projects/5429a69a71ab4ba5958b1e1419d39216/users/b60f2ea21b304fc9b002e826e91a2d3b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.278349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5429a69a71ab4ba5958b1e1419d39216, user_id=b60f2ea21b304fc9b002e826e91a2d3b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.281055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.284484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 813/1635] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.285389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.287169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.294778 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 823/1636] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/5429a69a71ab4ba5958b1e1419d39216/users/b60f2ea21b304fc9b002e826e91a2d3b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.295907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.298599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.300329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ac95-f275-491d-b6cb-02567e3f6f72 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.355923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.356648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.356933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.357212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.357932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.359567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.363471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553683bd-78ba-4f4a-a88e-1abec34c9b72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.368578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.369624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 814/1637] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.369742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.369821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.370105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] PATH_INFO: `/v3/projects/8143b15a5abe446a99c9ea26783559d9/users/8ed19dea3e834d3badffd07782515894/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.370246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.371883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.384227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab36253-ffdd-4cfd-8713-62c132408918 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.385799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8143b15a5abe446a99c9ea26783559d9, user_id=8ed19dea3e834d3badffd07782515894, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.388574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.389373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.390308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.390571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.390828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] PATH_INFO: `/v3/projects/e28a0c65d709457097bf6d59e5760dee/users/bda5aed11d1e4376b08891beeeee5678/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.397527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.404271 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 824/1638] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/8143b15a5abe446a99c9ea26783559d9/users/8ed19dea3e834d3badffd07782515894/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.405089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.406924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.408729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28a0c65d709457097bf6d59e5760dee, user_id=bda5aed11d1e4376b08891beeeee5678, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.411456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c895-37ac-494b-8941-665f927a788a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.425559 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 815/1639] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/e28a0c65d709457097bf6d59e5760dee/users/bda5aed11d1e4376b08891beeeee5678/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.427112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.427514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.427795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.455712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:46.456960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.472549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107fe3b-f02b-4177-a574-631fd0f33a40 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.516971 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 816/1640] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:46.517825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.519201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.531809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce608c-d758-4757-aa54-96af2d497079 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.534391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.535339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.535620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.535901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] PATH_INFO: `/v3/projects/8619324782ff425faf4367cfa4e5d7ef/users/d6bfa817f7b14b84a07bd6652fe0466d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.537138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.537875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.538134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8619324782ff425faf4367cfa4e5d7ef, user_id=d6bfa817f7b14b84a07bd6652fe0466d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.538231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.538440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.539248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.540920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.541028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42063-2f3f-4fed-bc76-1c79a2a884ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.554407 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 817/1641] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.554570 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 825/1642] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/8619324782ff425faf4367cfa4e5d7ef/users/d6bfa817f7b14b84a07bd6652fe0466d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.554678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.554775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.554775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.554775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.567597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b5cac-2b2b-47c5-9cf8-c442963a0b61 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.580530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.583592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] MFA Rules not processed for user `b60f2ea21b304fc9b002e826e91a2d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:46.585040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.627824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.628797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.629080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.629360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] PATH_INFO: `/v3/projects/6df32fdb9d9d4277bd36a129adaddc20/users/d7abe5e437a9421682db3fb6f26cebfd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.631365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df32fdb9d9d4277bd36a129adaddc20, user_id=d7abe5e437a9421682db3fb6f26cebfd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.634090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.644649 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 818/1643] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/6df32fdb9d9d4277bd36a129adaddc20/users/d7abe5e437a9421682db3fb6f26cebfd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.645476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.665507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 826/1644] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:46.666366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.679505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a531ba3-f82a-4ed5-ac6c-555b43c7f498 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.703027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.722605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec117a-bfaf-4abb-8c24-85c63f9216a4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.728540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.729682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.729959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.730229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] PATH_INFO: `/v3/projects/5ccc26c557b14392ab352f289a191271/users/f92c71346ae3442e9343399bba81031a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.742614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.743345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.743672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.744064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.744156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccc26c557b14392ab352f289a191271, user_id=f92c71346ae3442e9343399bba81031a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.744834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.746474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.746792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.759580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 827/1645] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.759580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.762856 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 819/1646] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/5ccc26c557b14392ab352f289a191271/users/f92c71346ae3442e9343399bba81031a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.763670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.765316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.767065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f655dc-1983-453e-893b-e3031a1b460f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.824099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.824359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea123-3878-49e1-987c-be174da0fecc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.824858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.825144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.825423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.826195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.827918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.828027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.828689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.828969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.829251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.838464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 828/1647] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:46.838707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.839250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.840502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cfbb6-5021-418e-af17-5f1cc290b9c5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.849274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadb9d-21b1-42c0-a689-1aa092499334 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:46.850482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 820/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:46.851725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841bbe-ecc5-4fbc-9c1b-d2f28f905c60 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.852172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841bbe-ecc5-4fbc-9c1b-d2f28f905c60 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.852801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841bbe-ecc5-4fbc-9c1b-d2f28f905c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.854269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:46.855146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.855429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.855706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] PATH_INFO: `/v3/projects/d3b4d6664b004fa898eb78144546bf84/users/13367ece59fb49a7adf9bc261c65b4e0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.857898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4d6664b004fa898eb78144546bf84, user_id=13367ece59fb49a7adf9bc261c65b4e0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:46.860680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fbb66-2a83-4c92-a5fa-e78c5786b156 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:46.872371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 829/1649] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/d3b4d6664b004fa898eb78144546bf84/users/13367ece59fb49a7adf9bc261c65b4e0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:46.873717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.874008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.874317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.892941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-65841bbe-ecc5-4fbc-9c1b-d2f28f905c60 None None] MFA Rules not processed for user `d6bfa817f7b14b84a07bd6652fe0466d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:46.895394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65841bbe-ecc5-4fbc-9c1b-d2f28f905c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.902826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] MFA Rules not processed for user `d7abe5e437a9421682db3fb6f26cebfd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:46.904089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:46.924520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.979479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 821/1650] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:46.981167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6156-7aca-4fef-88ea-f4ca4379221a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:46.981519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6156-7aca-4fef-88ea-f4ca4379221a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:46.982161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c6156-7aca-4fef-88ea-f4ca4379221a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:46.984153 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 822/1651] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 25 20:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:46.989594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c6156-7aca-4fef-88ea-f4ca4379221a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:46.993986 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 830/1652] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:46.995135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.048542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.085393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c6156-7aca-4fef-88ea-f4ca4379221a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.087434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f5c5a-59f8-484d-a862-d2082475e9d7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.090440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.091397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.091672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.091942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] PATH_INFO: `/v3/projects/8143b15a5abe446a99c9ea26783559d9/users/8ed19dea3e834d3badffd07782515894/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.094458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.094851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8143b15a5abe446a99c9ea26783559d9, user_id=8ed19dea3e834d3badffd07782515894, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.095172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.095459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.095736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.096600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.098176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866afe3-9bc3-4a09-a513-835bec1a76a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.098287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.109700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 831/1654] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:47.109839 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 823/1654] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:46 2022] PUT /identity/v3/projects/8143b15a5abe446a99c9ea26783559d9/users/8ed19dea3e834d3badffd07782515894/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:47.110522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.112200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2dc48-747d-4a9a-9b82-df3d97b4dbbc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.112681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2dc48-747d-4a9a-9b82-df3d97b4dbbc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.113054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2dc48-747d-4a9a-9b82-df3d97b4dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.133195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e706c-aa47-4696-ab9c-63a67dd95af8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.152767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f7c2dc48-747d-4a9a-9b82-df3d97b4dbbc None None] MFA Rules not processed for user `13367ece59fb49a7adf9bc261c65b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.154241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f7c2dc48-747d-4a9a-9b82-df3d97b4dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.204039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.205209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.205593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.205833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] PATH_INFO: `/v3/projects/e28a0c65d709457097bf6d59e5760dee/users/bda5aed11d1e4376b08891beeeee5678/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.208144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28a0c65d709457097bf6d59e5760dee, user_id=bda5aed11d1e4376b08891beeeee5678, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.211115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7285d-8c45-4809-a184-f1656e17fbc4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.222717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 832/1655] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:47 2022] PUT /identity/v3/projects/e28a0c65d709457097bf6d59e5760dee/users/bda5aed11d1e4376b08891beeeee5678/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:47.224096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb8a2-6c86-473a-b180-281c0e77d48a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.224513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb8a2-6c86-473a-b180-281c0e77d48a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.224733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb8a2-6c86-473a-b180-281c0e77d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.243110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 824/1656] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.244337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36b60-3550-4468-b54c-8d144b84afb2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.244704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36b60-3550-4468-b54c-8d144b84afb2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.244984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada36b60-3550-4468-b54c-8d144b84afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.248560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8b1bb8a2-6c86-473a-b180-281c0e77d48a None None] MFA Rules not processed for user `259e4c3f5ff24d5b955ec36009319598`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.249933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8b1bb8a2-6c86-473a-b180-281c0e77d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.263849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ada36b60-3550-4468-b54c-8d144b84afb2 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.265103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ada36b60-3550-4468-b54c-8d144b84afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.298921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.305772 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 833/1657] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.307513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e2-5dbf-4271-953a-adeeac946cfd None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.307960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e2-5dbf-4271-953a-adeeac946cfd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.308506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e2-5dbf-4271-953a-adeeac946cfd None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.310078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 834/1658] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 25 20:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:47.310960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271101e2-5dbf-4271-953a-adeeac946cfd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.339140 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 825/1659] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.340821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972470-e823-4939-9b0e-7b5af54565bd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.341108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972470-e823-4939-9b0e-7b5af54565bd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.341383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972470-e823-4939-9b0e-7b5af54565bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.366481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-83972470-e823-4939-9b0e-7b5af54565bd None None] MFA Rules not processed for user `8ed19dea3e834d3badffd07782515894`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.367682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-83972470-e823-4939-9b0e-7b5af54565bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.375799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271101e2-5dbf-4271-953a-adeeac946cfd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.380509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.381404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.381689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.381966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] PATH_INFO: `/v3/projects/5ccc26c557b14392ab352f289a191271/users/f92c71346ae3442e9343399bba81031a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.383942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccc26c557b14392ab352f289a191271, user_id=f92c71346ae3442e9343399bba81031a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.386708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.392296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.398236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 835/1660] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:47 2022] PUT /identity/v3/projects/5ccc26c557b14392ab352f289a191271/users/f92c71346ae3442e9343399bba81031a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:47.409326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.409326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.442053 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 826/1661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.442053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a65487-82a1-473f-af3a-72d3378257d1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.442053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a65487-82a1-473f-af3a-72d3378257d1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.442053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a65487-82a1-473f-af3a-72d3378257d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.468615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-54a65487-82a1-473f-af3a-72d3378257d1 None None] MFA Rules not processed for user `bda5aed11d1e4376b08891beeeee5678`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.469935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-54a65487-82a1-473f-af3a-72d3378257d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.470295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6369bb9-b025-44af-ae17-eb32327996e9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.475089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.475963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.476247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.476573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] PATH_INFO: `/v3/projects/c4358e7685ba41f4bfe0b618802adbe7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.477776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4358e7685ba41f4bfe0b618802adbe7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.479711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.525895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4358e7685ba41f4bfe0b618802adbe7', 'request_id': 'req-ffb29829-39e2-467d-a9da-6c658e644420'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:47.534174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4358e7685ba41f4bfe0b618802adbe7', 'request_id': 'req-ffb29829-39e2-467d-a9da-6c658e644420'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:47.540169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 827/1662] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.540285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4358e7685ba41f4bfe0b618802adbe7', 'request_id': 'req-ffb29829-39e2-467d-a9da-6c658e644420'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:47.542190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf7c6-7dc5-4082-819b-7c20b5fbcdb6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.542486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf7c6-7dc5-4082-819b-7c20b5fbcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.542788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf7c6-7dc5-4082-819b-7c20b5fbcdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.556170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] The token cache is being invalidate because project c4358e7685ba41f4bfe0b618802adbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:47.556489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:47.557181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:47.559188 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 836/1663] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:47 2022] DELETE /identity/v3/projects/c4358e7685ba41f4bfe0b618802adbe7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:47.559718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.562239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.562345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-328bf7c6-7dc5-4082-819b-7c20b5fbcdb6 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.562927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-328bf7c6-7dc5-4082-819b-7c20b5fbcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.607026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.636786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 828/1664] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.638077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.638357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.638638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.642410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29829-39e2-467d-a9da-6c658e644420 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.647973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.648654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.648937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.649210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.651119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.664648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] MFA Rules not processed for user `f92c71346ae3442e9343399bba81031a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.665819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.679615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.720226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.721917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f6878-5546-4f3c-8970-c43af66881b4 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.732048 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 837/1665] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:47.733414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.733800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.734089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.740521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 829/1666] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.741768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.757490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1d602-a503-4739-b89d-7450da170480 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.763230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.764035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.764323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.764791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.767245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.779318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.780690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.834118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.835722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3d7e-8c2c-44dc-9faa-306f1fbeba9f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.846381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 830/1667] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:47.850492 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 838/1668] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:47.860600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.860899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.861178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.879354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:47.880574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:47.888895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 831/1669] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:51:47.893340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.903609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e6a1-fff5-4e79-82eb-d8a7048ef9ed None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.908658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.909300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.909597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.909850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.910576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:47.910879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.912518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.924981 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 839/1670] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:47.929278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.938939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ebe5f-c11b-42ee-9250-f8e91565ed55 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:47.944370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:47.945107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:47.945442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:47.945713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:47.946478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:47.948386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:47.978527 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 832/1671] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:51:47.982709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:47.994166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7946d-c8c9-4112-b801-a597bce78f93 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.009018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.041248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:48.063323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.064014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.064302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.064606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.065311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.067248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.090984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 840/1672] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:47 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:51:48.095387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.097938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4a2c-fa53-4350-a456-a56fb8984490 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.104486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.105262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.105616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.106156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e36aa-4f2a-4a3c-8ad5-12d8cec533d4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.106276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.107872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.111017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.111769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.112097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.112378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.113143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.114740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.128462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 841/1673] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:48.128462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.138379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc4ef6-5bb8-4dc8-acb4-38524c49c905 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.144151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.144808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.145089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.145360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.147414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.156711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:48.181332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.182937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.192631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 833/1674] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:48.193414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.203275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca4c9-7ea1-4d11-8dca-efffc4c68ac6 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.207837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.208589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.208871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.209168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.209862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.211429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.213580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.215565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.222196 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 834/1675] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:48.226501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.229267 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 842/1676] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:48.237769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89273d-9a65-4296-bd13-b3f7742e2816 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.242716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.243797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.244225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.244673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] PATH_INFO: `/v3/projects/225e2ed54264470db5b531662c5a7dc8/users/b343199db9a64f2c952199dee2e6eabd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.262918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225e2ed54264470db5b531662c5a7dc8, user_id=b343199db9a64f2c952199dee2e6eabd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.263074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.265843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecceeb-ec48-4ca3-b4e8-cc05bf46d089 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.274792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c71da-2b2e-4718-ae1d-6654a4f3f4dc service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.283165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 835/1677] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:48 2022] PUT /identity/v3/projects/225e2ed54264470db5b531662c5a7dc8/users/b343199db9a64f2c952199dee2e6eabd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:48.294748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fedd7-4d3b-49d5-8fbe-45d303a0c26e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.295039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fedd7-4d3b-49d5-8fbe-45d303a0c26e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.295320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fedd7-4d3b-49d5-8fbe-45d303a0c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.322488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f23fedd7-4d3b-49d5-8fbe-45d303a0c26e None None] MFA Rules not processed for user `b343199db9a64f2c952199dee2e6eabd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:48.323712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f23fedd7-4d3b-49d5-8fbe-45d303a0c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.342564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.343251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.343530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.343837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.345833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.387761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 836/1678] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:48.389171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cf33-f5e5-4fb7-b01a-931686482579 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.389434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cf33-f5e5-4fb7-b01a-931686482579 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.389715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cf33-f5e5-4fb7-b01a-931686482579 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.391271 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 837/1679] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:48.396075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612cf33-f5e5-4fb7-b01a-931686482579 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.408887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:48.409276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.411125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8f12-21b2-4762-b969-9598837c4619 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.421870 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 843/1680] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:48.425844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.426353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.426638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.444770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:48.446147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.460559 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 844/1681] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:48.467354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612cf33-f5e5-4fb7-b01a-931686482579 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.472368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.473194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.473371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.473521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.473788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.474455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.475233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.476455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.511071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 838/1682] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:48 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:48.512507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.523583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:48.541567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c514e-84ce-483e-9012-c26e3fbd4201 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.586573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f59de-386f-41bf-ba7a-59352ed69d8e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.592526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.592985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.593275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.593575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.593846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.594053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.594363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.594636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.596469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.604453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.605947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.616955 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 845/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:51:48.617755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.664754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.666365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.676816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 839/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:48.681476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb825-983b-4ec4-8dc5-a79c85be6cbc service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.686619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.687641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.687824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.688058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.689129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.690839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.720108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.721396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 846/1685] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:48 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:48.725193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.732944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bc7d6-d164-41fb-9fa9-506cb6ce7828 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.737109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e106f5a-59ee-43d1-b718-3f4f55c42bda admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.738058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.738721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.739008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.739286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.743636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.744311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.744750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.745188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.745989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.747600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.764363 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 847/1686] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:51:48.766294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.766760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:48.778643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135416c-07dd-4449-968e-7ab7dc805953 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.783539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.784449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.784781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.785059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] PATH_INFO: `/v3/projects/3ce69c1efc6440d6998669915aaac84a/users/d7a83251bd5d4d7790d5ef836ad1d17f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.804512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce69c1efc6440d6998669915aaac84a, user_id=d7a83251bd5d4d7790d5ef836ad1d17f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.804685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.807595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.807727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.820036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 840/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:51:48.827043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 848/1688] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:48 2022] PUT /identity/v3/projects/3ce69c1efc6440d6998669915aaac84a/users/d7a83251bd5d4d7790d5ef836ad1d17f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:48.830880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.842666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409338-5582-40bd-be4c-7b5d4e337286 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.899256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.901207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:48.933677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.934900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.935376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.935756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.936929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.938803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.951727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 841/1689] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:48.955835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:48.966380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84366cc5-6ec7-435d-acd5-e3ca29645f78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:48.971989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:48.973018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:48.973424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:48.973951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] PATH_INFO: `/v3/projects/3ce69c1efc6440d6998669915aaac84a/users/d7a83251bd5d4d7790d5ef836ad1d17f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:48.976081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce69c1efc6440d6998669915aaac84a, user_id=d7a83251bd5d4d7790d5ef836ad1d17f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:48.978816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a9dee-03f2-47a0-a6ee-6f7a3d7d79ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:48.992603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 842/1690] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:48 2022] PUT /identity/v3/projects/3ce69c1efc6440d6998669915aaac84a/users/d7a83251bd5d4d7790d5ef836ad1d17f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:49.000055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:49.003425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.003687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.003974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.023133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f114be-7c95-4696-8490-564a147f433e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.038599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] MFA Rules not processed for user `d7a83251bd5d4d7790d5ef836ad1d17f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:49.039935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.088317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.089238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.089519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.090165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] PATH_INFO: `/v3/users/a6598a465d994108ba50373a85313225` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.091496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6598a465d994108ba50373a85313225)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.092973 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.092973 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 20:51:49.092973 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 20:51:49.094161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.122535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 843/1691] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:51:49.180741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6598a465d994108ba50373a85313225'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.205456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6598a465d994108ba50373a85313225'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.235599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6598a465d994108ba50373a85313225'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.236779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6598a465d994108ba50373a85313225'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.239578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2482552e-b58b-48b9-8a31-0f76a4f4d223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6598a465d994108ba50373a85313225'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.280627 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 849/1692] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:48 2022] DELETE /identity/v3/users/a6598a465d994108ba50373a85313225 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:51:49.281649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.284943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.285340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.285713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.307685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:49.308958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.330219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:49.375553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 850/1693] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:49.376537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.377831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.378077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe026c9-d353-46fb-a601-74b19c0c6a7b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.402433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:49.457702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.458438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.458787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.459045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.459175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc55e4-c7ea-41e5-bdb0-fb9dbe4d7e23 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.461446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.467922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.468643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.468925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.469200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.470946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.482412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.484041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.495554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 851/1694] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:49.496391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.497697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.523794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.525434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.535375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 844/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:49.536023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.537445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.551333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f866-8740-4c1e-ba31-e4766e5aed13 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.557068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.557735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.558024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.558308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.559232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d225-4d2b-42a5-aba0-54c11f9a99f8 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.560569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.566403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.566403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.566403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.566403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.577639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.579093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.591486 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 852/1696] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:49.592352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.593847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.612031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5d40b-9c1c-490c-ad1e-3de7a9338970 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.619363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.620261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.620610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.620892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] PATH_INFO: `/v3/users/b343199db9a64f2c952199dee2e6eabd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.622134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b343199db9a64f2c952199dee2e6eabd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.624173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.661490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.663770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364ac7-1fd2-44cc-95da-d5b0c7441634 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.677053 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 845/1697] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:49.705087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6912-7ca8-43db-893c-c8a8598bef2f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.705087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6912-7ca8-43db-893c-c8a8598bef2f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.705087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab6912-7ca8-43db-893c-c8a8598bef2f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.705087 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 846/1698] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:51:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:51:49.713348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.713641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.713924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.724988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:49.739628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:49.741102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.743419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b343199db9a64f2c952199dee2e6eabd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.756509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b343199db9a64f2c952199dee2e6eabd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.766031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 847/1699] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:51:49.766900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.770137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.801731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b343199db9a64f2c952199dee2e6eabd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.803124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b343199db9a64f2c952199dee2e6eabd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.804197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b343199db9a64f2c952199dee2e6eabd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.809019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5d117-4bdc-41c6-99be-1aa45ed5d4f4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.822006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.823039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.823334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.823469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] PATH_INFO: `/v3/users/6051f7618a54487583f39d4c8291a4e8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.828512 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 853/1700] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:49 2022] DELETE /identity/v3/users/b343199db9a64f2c952199dee2e6eabd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:49.829406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:49.831262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6051f7618a54487583f39d4c8291a4e8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.835118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:49.837807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.873336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:49.946902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6051f7618a54487583f39d4c8291a4e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.948313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6051f7618a54487583f39d4c8291a4e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.959919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e63d4-5b2f-4a5a-a341-e3cec5865e80 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:49.962925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6051f7618a54487583f39d4c8291a4e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.966900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:49.967661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:49.967983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:49.968266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:49.970272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:49.989284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6051f7618a54487583f39d4c8291a4e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:49.991408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:49.993171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.005979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01d89a05-321e-45a2-842a-9cd76aced5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6051f7618a54487583f39d4c8291a4e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.019855 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 848/1701] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:49 2022] DELETE /identity/v3/users/6051f7618a54487583f39d4c8291a4e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:50.022737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beaf00-f053-41d2-b878-7b53cde48f5e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.023473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beaf00-f053-41d2-b878-7b53cde48f5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.023935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beaf00-f053-41d2-b878-7b53cde48f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.029437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 854/1702] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:50.030740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.035439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.067837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c2beaf00-f053-41d2-b878-7b53cde48f5e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:50.069146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c2beaf00-f053-41d2-b878-7b53cde48f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.150124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540e66a-c8b0-4e8c-9d01-1cf04148453d service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:50.202498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 849/1703] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:50.205301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892644-99e2-460c-b06f-6b3fdc66383a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.205604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892644-99e2-460c-b06f-6b3fdc66383a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.206031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892644-99e2-460c-b06f-6b3fdc66383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.226062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b7892644-99e2-460c-b06f-6b3fdc66383a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:50.227172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:50.227438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7892644-99e2-460c-b06f-6b3fdc66383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.228482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.228908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.229322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] PATH_INFO: `/v3/projects/4ac47b62cfec4f4dbe0af7582adb297c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.230858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac47b62cfec4f4dbe0af7582adb297c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:50.233166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.239350 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 850/1704] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:50.239350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.239350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.239350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.261572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] MFA Rules not processed for user `de7f658e8ff74ef2bc3a90c74b0013eb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:50.263456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.302584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac47b62cfec4f4dbe0af7582adb297c', 'request_id': 'req-6486fca4-417f-4140-9348-646b309181dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.311305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac47b62cfec4f4dbe0af7582adb297c', 'request_id': 'req-6486fca4-417f-4140-9348-646b309181dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.313952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:50.319915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac47b62cfec4f4dbe0af7582adb297c', 'request_id': 'req-6486fca4-417f-4140-9348-646b309181dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.334623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] The token cache is being invalidate because project 4ac47b62cfec4f4dbe0af7582adb297c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:50.334942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.335626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.337389 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 855/1705] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:50 2022] DELETE /identity/v3/projects/4ac47b62cfec4f4dbe0af7582adb297c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:50.338169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.341682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.342573 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 851/1706] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:50.343995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.345492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.357498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:50.406573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486fca4-417f-4140-9348-646b309181dc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:50.410822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:50.412346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.412760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.413112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.428291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b555aa-46bb-4f28-bb41-f0092ff350ba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:50.431296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.435598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:50.436341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.436813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.437334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.441000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.516827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:50.517851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.526868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:50.528125 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 856/1707] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:50.532660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.534040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.537829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.548872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dff5f-8735-408e-8640-2aabee98bb9a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:50.550245 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 852/1708] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:50.551180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.552641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.569182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef270f-2164-41b0-affc-62a92bc64f8d service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:50.576059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:50.577980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.578274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.578555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] PATH_INFO: `/v3/users/b60f2ea21b304fc9b002e826e91a2d3b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.580313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60f2ea21b304fc9b002e826e91a2d3b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:50.582281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:50.582569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.585035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.585323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.585603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] PATH_INFO: `/v3/users/ce466f09e3fd47ccb15ecd50338aed3a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.588821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce466f09e3fd47ccb15ecd50338aed3a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:50.591210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:50.650455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60f2ea21b304fc9b002e826e91a2d3b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.651155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60f2ea21b304fc9b002e826e91a2d3b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.664273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60f2ea21b304fc9b002e826e91a2d3b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.685764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60f2ea21b304fc9b002e826e91a2d3b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.700790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60f2ea21b304fc9b002e826e91a2d3b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.706182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce466f09e3fd47ccb15ecd50338aed3a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.716078 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 853/1709] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:50 2022] DELETE /identity/v3/users/b60f2ea21b304fc9b002e826e91a2d3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:50.717183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:50.720047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.725164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce466f09e3fd47ccb15ecd50338aed3a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.753662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce466f09e3fd47ccb15ecd50338aed3a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.755086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce466f09e3fd47ccb15ecd50338aed3a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.757075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d01c5019-8897-407a-89c6-7a7a22a3411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce466f09e3fd47ccb15ecd50338aed3a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:50.791905 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 857/1710] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:50 2022] DELETE /identity/v3/users/ce466f09e3fd47ccb15ecd50338aed3a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:50.797243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3a0e-5999-4d83-96d7-6b98786c7b6e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.797984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3a0e-5999-4d83-96d7-6b98786c7b6e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.799346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3a0e-5999-4d83-96d7-6b98786c7b6e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.808291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 858/1711] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:51:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:50.810295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe472-7821-4994-97dc-8edbad2ffcb3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:50.810768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe472-7821-4994-97dc-8edbad2ffcb3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:50.811224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fe472-7821-4994-97dc-8edbad2ffcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:50.838336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:50.850681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c39fe472-7821-4994-97dc-8edbad2ffcb3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:50.865100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c39fe472-7821-4994-97dc-8edbad2ffcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:50.872692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:50.931688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb194d-7e1d-4517-9cc0-63fdc81b265e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.001618 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 859/1712] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:51.007686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.008473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.008473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.029553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:51.030943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.032053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.032980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.033256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.033596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.035572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.045209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 860/1713] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:51.046458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.048143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.064513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabc9f2-d3b6-4001-9bb0-59ee6a915685 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.070926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.071841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.072113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.072519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] PATH_INFO: `/v3/projects/664d01c5d78e44c285637b71109a64cf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.073815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=664d01c5d78e44c285637b71109a64cf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.075781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.120047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.121810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.131938 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 854/1714] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:51.132717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.134171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.154114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664d01c5d78e44c285637b71109a64cf', 'request_id': 'req-9679e5b1-e0de-4925-858a-fcfa3f5279ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.169394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664d01c5d78e44c285637b71109a64cf', 'request_id': 'req-9679e5b1-e0de-4925-858a-fcfa3f5279ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.190876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664d01c5d78e44c285637b71109a64cf', 'request_id': 'req-9679e5b1-e0de-4925-858a-fcfa3f5279ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.224834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] The token cache is being invalidate because project 664d01c5d78e44c285637b71109a64cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:51.225961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.229004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.239124 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 861/1715] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:51 2022] DELETE /identity/v3/projects/664d01c5d78e44c285637b71109a64cf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:51.239124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.242149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.266632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e9c1-ee07-4c84-aa47-867e7f5ab742 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.308148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:51.332748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e5b1-e0de-4925-858a-fcfa3f5279ac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.337415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.338380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.338931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.339218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.342834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.346224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.346976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.347270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.347551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.349657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.406968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:51.452835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.454600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.466725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.468908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.470734 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 855/1716] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:51.471472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.474057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.487512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792378e7-730a-4701-9769-bb62b6aceb1c service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.493151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.494314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.494676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.495019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] PATH_INFO: `/v3/projects/225e2ed54264470db5b531662c5a7dc8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.496461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] RBAC: Authorizing `identity:delete_project(project_id=225e2ed54264470db5b531662c5a7dc8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.498405 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:51.498405 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 20:51:51.498405 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 20:51:51.499923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.511455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 862/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:51.512775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.517570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.550819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b70a6f-a9e9-4e14-9538-7fe4775918f2 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.595928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225e2ed54264470db5b531662c5a7dc8', 'request_id': 'req-ac284ed5-f89c-476c-a193-093e4d75615d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.613700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225e2ed54264470db5b531662c5a7dc8', 'request_id': 'req-ac284ed5-f89c-476c-a193-093e4d75615d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.624920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225e2ed54264470db5b531662c5a7dc8', 'request_id': 'req-ac284ed5-f89c-476c-a193-093e4d75615d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.662725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] The token cache is being invalidate because project 225e2ed54264470db5b531662c5a7dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:51.663043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.664415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.671259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.671259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.671259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.671259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] PATH_INFO: `/v3/users/13367ece59fb49a7adf9bc261c65b4e0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.672018 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 856/1718] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:51 2022] DELETE /identity/v3/projects/225e2ed54264470db5b531662c5a7dc8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:51.673294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13367ece59fb49a7adf9bc261c65b4e0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.673460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.675587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.676709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.694204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac284ed5-f89c-476c-a193-093e4d75615d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:51.713763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:51.716140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.716756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.719177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] PATH_INFO: `/v3/projects/5429a69a71ab4ba5958b1e1419d39216` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.722658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5429a69a71ab4ba5958b1e1419d39216)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:51.730262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:51.804549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13367ece59fb49a7adf9bc261c65b4e0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.813068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13367ece59fb49a7adf9bc261c65b4e0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.844467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13367ece59fb49a7adf9bc261c65b4e0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.844467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13367ece59fb49a7adf9bc261c65b4e0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.844467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13367ece59fb49a7adf9bc261c65b4e0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.853581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5429a69a71ab4ba5958b1e1419d39216', 'request_id': 'req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.856127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:51.861557 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 863/1719] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:51 2022] DELETE /identity/v3/users/13367ece59fb49a7adf9bc261c65b4e0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:51.862645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:51.864326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:51.880227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5429a69a71ab4ba5958b1e1419d39216', 'request_id': 'req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.915504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5429a69a71ab4ba5958b1e1419d39216', 'request_id': 'req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.939332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] The token cache is being invalidate because project 5429a69a71ab4ba5958b1e1419d39216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:51.939644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.942986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b554a727-4bb2-4c1a-b5a8-c8677b0390f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:51.946354 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 857/1720] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:51 2022] DELETE /identity/v3/projects/5429a69a71ab4ba5958b1e1419d39216 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:51.953052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4783-fbfb-49c6-8f65-ec8918fc0d4a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:51.953341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4783-fbfb-49c6-8f65-ec8918fc0d4a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:51.953626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4783-fbfb-49c6-8f65-ec8918fc0d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:51.994034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:51.994225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-070e4783-fbfb-49c6-8f65-ec8918fc0d4a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:51.997110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-070e4783-fbfb-49c6-8f65-ec8918fc0d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.033649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05050c-c7b8-43da-abc4-9d6a8c8dde2a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:52.045702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:52.046653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.046985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.047864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] PATH_INFO: `/v3/users/d7a83251bd5d4d7790d5ef836ad1d17f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.049329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a83251bd5d4d7790d5ef836ad1d17f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:52.066713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:52.125990 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 858/1721] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:52.127344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.127551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.127836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.184854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:52.186461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.187462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a83251bd5d4d7790d5ef836ad1d17f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.195395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 859/1722] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:52.196077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:52.202127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.211514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a83251bd5d4d7790d5ef836ad1d17f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.231531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a83251bd5d4d7790d5ef836ad1d17f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.231799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164d57-4bfa-46aa-93f4-993232488a42 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:52.232440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a83251bd5d4d7790d5ef836ad1d17f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.233512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d4f6a62-a5b0-470d-ae13-3534c76cba86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a83251bd5d4d7790d5ef836ad1d17f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.239631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:52.241467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.241839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.242403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] PATH_INFO: `/v3/projects/a64e77a822d5456ebbd476d69ff88efd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.243845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64e77a822d5456ebbd476d69ff88efd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:52.247239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:52.268522 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 864/1723] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:51 2022] DELETE /identity/v3/users/d7a83251bd5d4d7790d5ef836ad1d17f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:52.270438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.270955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.271389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.311875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:52.313293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.391203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64e77a822d5456ebbd476d69ff88efd', 'request_id': 'req-40165a0a-8508-43ee-b5e3-ee20a1869c7e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.403526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64e77a822d5456ebbd476d69ff88efd', 'request_id': 'req-40165a0a-8508-43ee-b5e3-ee20a1869c7e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.410992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64e77a822d5456ebbd476d69ff88efd', 'request_id': 'req-40165a0a-8508-43ee-b5e3-ee20a1869c7e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.428244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] The token cache is being invalidate because project a64e77a822d5456ebbd476d69ff88efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:52.428244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.430512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.436598 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 860/1724] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:52 2022] DELETE /identity/v3/projects/a64e77a822d5456ebbd476d69ff88efd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:52.436598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:52.438931 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 865/1725] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:52.443522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.445730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:52.451178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.475894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6835-3579-420a-8db2-9098205b2ad1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:52.537089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:52.547347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:52.548076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165a0a-8508-43ee-b5e3-ee20a1869c7e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:52.548405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.548715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.549117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] PATH_INFO: `/v3/users/bda5aed11d1e4376b08891beeeee5678` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.550734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda5aed11d1e4376b08891beeeee5678)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:52.552991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:52.554911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:52.555939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.556231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.556677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.559683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:52.561382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.660619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda5aed11d1e4376b08891beeeee5678'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.673620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda5aed11d1e4376b08891beeeee5678'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.703457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda5aed11d1e4376b08891beeeee5678'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.704959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda5aed11d1e4376b08891beeeee5678'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.705905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda5aed11d1e4376b08891beeeee5678'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:52.728384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:52.733174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:52.739952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 866/1726] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:51:52 2022] DELETE /identity/v3/users/bda5aed11d1e4376b08891beeeee5678 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:52.741537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:52.746028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.773941 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 861/1727] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:51:52.776073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:52.780886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:52.813864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ca2d4-b7ac-44a5-86a0-78e8dbd93c5d service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:52.979939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:52.980858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:52.981134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:52.981471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] PATH_INFO: `/v3/projects/d3b4d6664b004fa898eb78144546bf84` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:52.995991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b4d6664b004fa898eb78144546bf84)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:52.999081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.072944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3fa-1d39-4778-a414-cd40730af945 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:53.108061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:53.108863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.109185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.109508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.110286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:53.121082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:53.123155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.151894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b4d6664b004fa898eb78144546bf84', 'request_id': 'req-a9a476ab-940e-4595-8b26-6dcb2bd678b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.174485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b4d6664b004fa898eb78144546bf84', 'request_id': 'req-a9a476ab-940e-4595-8b26-6dcb2bd678b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.176399 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 867/1728] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:53.177525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:53.182098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.196190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b4d6664b004fa898eb78144546bf84', 'request_id': 'req-a9a476ab-940e-4595-8b26-6dcb2bd678b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.225523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16f6f9-848b-489c-87c6-7f87aa00cc8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:53.234021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] The token cache is being invalidate because project d3b4d6664b004fa898eb78144546bf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:53.234330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.237299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.243187 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 862/1729] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:52 2022] DELETE /identity/v3/projects/d3b4d6664b004fa898eb78144546bf84 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:53.244339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:53.247708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.361928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:53.435972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:53.438396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.439884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.440176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] PATH_INFO: `/v3/projects/3ce69c1efc6440d6998669915aaac84a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.446212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce69c1efc6440d6998669915aaac84a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:53.452833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.463340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a476ab-940e-4595-8b26-6dcb2bd678b0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:53.474209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:53.474921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.475249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.475657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.480263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:53.482997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8ad0e-21b1-4ae6-95fb-c601b802fc10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.536578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:53.540361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 863/1730] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:53 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:53.542467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.542888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.543177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.583433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:53.584319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.653955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce69c1efc6440d6998669915aaac84a', 'request_id': 'req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.669350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce69c1efc6440d6998669915aaac84a', 'request_id': 'req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.688276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce69c1efc6440d6998669915aaac84a', 'request_id': 'req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.711600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] The token cache is being invalidate because project 3ce69c1efc6440d6998669915aaac84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:53.711924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.714121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.721342 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 868/1731] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:53 2022] DELETE /identity/v3/projects/3ce69c1efc6440d6998669915aaac84a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:53.725563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:53.734601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.736391 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 864/1732] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:53.737616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:53.739085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.783078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9285fc-3e42-4f63-9895-521c3f28b503 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:53.785971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b4c-246b-4661-8b1d-5e9f58f3b1db admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:53.794097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:53.795082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.795562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.795905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.796942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:53.799610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879906b7-2519-497a-937f-ecd36db36c70 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.805756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:53.806700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.810278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.810805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] PATH_INFO: `/v3/projects/e28a0c65d709457097bf6d59e5760dee` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.814107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28a0c65d709457097bf6d59e5760dee)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:53.818083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:53.855295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 869/1733] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:53 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:53.860728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:53.861018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:53.861264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:53.925689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:53.927977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:53.965614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28a0c65d709457097bf6d59e5760dee', 'request_id': 'req-5405b4ea-42d2-45a8-948e-8392483e49f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:53.993135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28a0c65d709457097bf6d59e5760dee', 'request_id': 'req-5405b4ea-42d2-45a8-948e-8392483e49f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:54.002658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28a0c65d709457097bf6d59e5760dee', 'request_id': 'req-5405b4ea-42d2-45a8-948e-8392483e49f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:54.047425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] The token cache is being invalidate because project e28a0c65d709457097bf6d59e5760dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:51:54.047749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:54.051471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5405b4ea-42d2-45a8-948e-8392483e49f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:51:54.059017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 865/1734] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:51:53 2022] DELETE /identity/v3/projects/e28a0c65d709457097bf6d59e5760dee => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:54.060441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2e0a-448f-4563-b334-3fd5dde22c24 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.060968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2e0a-448f-4563-b334-3fd5dde22c24 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.061207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2e0a-448f-4563-b334-3fd5dde22c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.101810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-53bb2e0a-448f-4563-b334-3fd5dde22c24 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:54.103074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53bb2e0a-448f-4563-b334-3fd5dde22c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.169236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 870/1735] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.172404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.174794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.193476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:54.231875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130e31-8574-4710-b3e2-bbedbc3f7aee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.260554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.261745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.262259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.262741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.267480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.270955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983f6aa-32d0-4882-9ada-d07bb5977443 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.313488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 866/1736] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.314759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3f-6b2b-4cdc-a748-5acf27551fe3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.315049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3f-6b2b-4cdc-a748-5acf27551fe3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.315328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3f-6b2b-4cdc-a748-5acf27551fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.326984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 871/1737] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:54.344392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.345641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.346130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.365814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d072ab3f-6b2b-4cdc-a748-5acf27551fe3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:54.367038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d072ab3f-6b2b-4cdc-a748-5acf27551fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.391368 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 867/1738] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.392963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.393257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.393554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.416389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:54.417785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.437660 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 872/1739] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.438813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.462595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eac7a-3c9e-4b57-b4a2-3114ef9b1596 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.472985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.473241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.473617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.473989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.474987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:54.475245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.477018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.505741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:54.507054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.509255 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 873/1740] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:54.510403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.542878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a808fd-6285-4181-b020-f791e7c72f5a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.550437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.551389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.551774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.552158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.553038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.554816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817bde5-e464-4c09-a909-162ab953f433 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.589228 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 874/1741] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:54.591231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.597448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.597811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.624050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:54.625456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:54.634853 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 875/1742] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.639135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.650054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13528-eca0-488e-bb6d-3e001ae82533 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.657806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.658717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.659354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.659638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.660753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:54.661077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.662735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.671804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 868/1743] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:54.672985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.677366 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 876/1744] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:54.678198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.690605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a5ba-4891-4826-857f-2b60eac4e7f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.699534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263072a7-e0b9-42a8-8e3e-cb33bcf22602 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.700386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.701608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.702457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.703479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] PATH_INFO: `/v3/projects/e6bafd21c6734b378874ebf67e23b231/users/cc6883d9d1354036835a16a2ea6d7e6b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.710298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.711196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.711638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.712058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.713215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.715778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.735414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bafd21c6734b378874ebf67e23b231, user_id=cc6883d9d1354036835a16a2ea6d7e6b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.742872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.758255 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 869/1745] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:54.760511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.778759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 877/1746] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:54 2022] PUT /identity/v3/projects/e6bafd21c6734b378874ebf67e23b231/users/cc6883d9d1354036835a16a2ea6d7e6b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:54.780597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.816267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:54.866768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330973-5ed0-406d-85a3-3eaaa5c02576 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.917546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ff461-4efc-46c0-a312-1940a194caef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:54.927318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:54.944702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.945114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:54.945574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.945850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:54.945985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.946172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.946390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:54.946537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:54.946880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:51:54.947191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.947361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:54.949006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.949322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:54.976257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 870/1747] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:51:54.977578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:54.980144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:55.010571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 878/1748] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:54 2022] POST /identity/v3/projects => generated 403 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.010571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.057325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5037-55a2-4874-a7d7-ecb49903eb1b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.109248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044df10-a887-4f24-8d20-a7fea3b2490e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.117084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.117957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.118081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.118486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.123096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.124641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.125487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.125963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.126957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.127791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.129429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d5e6-a616-442b-a7d7-5d4dafe922e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.129662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2a063-8056-4450-8004-fc89918e45ef service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.139213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 871/1749] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:55.140708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.141050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.141340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.162149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:55.163452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:55.171154 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 879/1750] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.173044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.180638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.181027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.238114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] MFA Rules not processed for user `cc6883d9d1354036835a16a2ea6d7e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:55.239427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:55.252886 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 872/1751] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:55.266291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.299113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df898d-8927-4d73-8e18-8e1b97ed6c5e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.312862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.313837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.314145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.315644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.317197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.319180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.410751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 873/1752] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.411816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.438163 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 880/1753] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:55.440026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.463257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d0320-c3a6-4a0e-a1ee-079e037e540f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.485944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:55.501457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:55.579182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4831f3-9368-4915-ade8-8d9760bd5038 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.599679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.600882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.601352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.601891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.602812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.609397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.661718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 874/1754] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/users => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.661718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.661718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:55.664874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.667887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.667887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.668093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.670718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.672617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.706196 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 881/1755] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:55.706196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.721104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dea8-0b67-4513-8971-62e421e1c91c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.726530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.727722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.729048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.729048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.729454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.731881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.759674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 882/1756] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/users => generated 297 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.760901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.774112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf053f5-e22d-4e39-a465-8a8c9afa0967 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.779132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.780002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.780445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.780845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.781678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.784550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.785473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5998-4227-436e-b9c3-b7777da0a820 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:55.793739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:55.794106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:55.794388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:55.794666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:55.838154 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 883/1757] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:55 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:55.838912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.938025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:55.941985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:55.958566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 875/1758] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:51:55.959613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:55.984463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ace4d-d421-4013-b9e2-44ef914d401e service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.059781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819e22-eec2-4175-9c1b-9d1225d43352 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.080323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.081325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.081773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.082219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.083121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.086060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.101752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 884/1759] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.102949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.124953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.125681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.126036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.126350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.127189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.130236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.135086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:56.138325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003b77b-9d69-4b11-bd51-45202d830478 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.149229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 876/1760] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.150125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.161841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.162613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.163160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.163857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.166227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96524f-b5a3-454f-a92d-c216c6fac8d7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.166871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.173589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.174526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.175548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.175898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.176611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.190861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.201642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 885/1761] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.202814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.215011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.227362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731c74-fef8-4dd0-8afe-b6fc93a27307 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.246178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.252048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.252371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.252704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.258554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.261862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.266190 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 877/1762] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:56 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:56.268209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.300492 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 886/1763] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.302356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.318434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fec7-197c-43b0-a257-f7b7bad3ef6d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.327937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2415ed-6ed8-4a6a-965d-cd196a630f01 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.331179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.333739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.334651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.336150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] PATH_INFO: `/v3/projects/fa9f68b86e444f52a2f5e73e40aadfa9/users/250a630cc65342b5a782a022fe145a06/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.342689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.344159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.345648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.349138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.350476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.355507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.401248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9f68b86e444f52a2f5e73e40aadfa9, user_id=250a630cc65342b5a782a022fe145a06, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.405247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.406015 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 887/1764] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.408655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.450299 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 878/1765] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:56 2022] PUT /identity/v3/projects/fa9f68b86e444f52a2f5e73e40aadfa9/users/250a630cc65342b5a782a022fe145a06/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:56.451730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.460702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c440d42-e307-4d91-a402-ce9e2484cdb5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.566410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:56.665337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.666568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.666858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.667144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.668074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.669887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.705879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6eae2-d30e-4e36-992e-fbbca65bbd17 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.719181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.722201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.722487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.722769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] PATH_INFO: `/v3/projects/af62bf0347fa45a19dd2b9091ac99623/users/68692a535dd0447a9e68c00644194480/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.731291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 888/1766] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:56.735963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.776299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd2f99-b9d7-4b9a-b24f-617c6cafcea6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:56.796203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:56.797260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.797547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.797824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] PATH_INFO: `/v3/projects/78c875f569324e3b87feb4a93ddbc8f9/users/72a4c33489514bbc9fa7bf80bc175ca8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.803593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af62bf0347fa45a19dd2b9091ac99623, user_id=68692a535dd0447a9e68c00644194480, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.809304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71272-b9b2-4165-a535-aa407511f44c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.842306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c875f569324e3b87feb4a93ddbc8f9, user_id=72a4c33489514bbc9fa7bf80bc175ca8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:56.842999 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 879/1767] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:56 2022] PUT /identity/v3/projects/af62bf0347fa45a19dd2b9091ac99623/users/68692a535dd0447a9e68c00644194480/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:56.846531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c8bf-8b08-46e9-9a6b-9a183e546c9c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:56.846531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c8bf-8b08-46e9-9a6b-9a183e546c9c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:56.846912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c8bf-8b08-46e9-9a6b-9a183e546c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:56.858667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:56.915759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 889/1768] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:56 2022] PUT /identity/v3/projects/78c875f569324e3b87feb4a93ddbc8f9/users/72a4c33489514bbc9fa7bf80bc175ca8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:56.916851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:56.930434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cf04c8bf-8b08-46e9-9a6b-9a183e546c9c None None] MFA Rules not processed for user `250a630cc65342b5a782a022fe145a06`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:56.931252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf04c8bf-8b08-46e9-9a6b-9a183e546c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:57.136131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be0cef-59e0-4bbb-9677-36b7ddc16932 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:57.162026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:57.162984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.163270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.163553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] PATH_INFO: `/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb/users/195eda60d95a461092008b62f4039c9f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.228585 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 880/1769] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:57.228778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d54fe8760e14f21bd8487ed94d50bfb, user_id=195eda60d95a461092008b62f4039c9f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:57.231631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a27ed-62fa-46af-9b4c-5cc668515a28 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:57.232372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.239133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.239133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.276842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 890/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:56 2022] PUT /identity/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb/users/195eda60d95a461092008b62f4039c9f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:57.278727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.279026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.279301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.324907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] MFA Rules not processed for user `68692a535dd0447a9e68c00644194480`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:57.325574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:57.362259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] MFA Rules not processed for user `72a4c33489514bbc9fa7bf80bc175ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:57.363487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:57.369354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:57.480736 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 881/1771] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:57.481617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:57.642253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be02bc7-b0f5-4210-b116-a1ba8fe0b3df None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:57.643681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 891/1772] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:57.645152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:57.649783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:57.650547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.651149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.651377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.652148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:57.654219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477cc1-4f1e-41a7-85f4-6abd4bb58f5c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:57.684902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c4dc6-d743-4294-a993-a021e27b60f9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:57.708967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:57.710179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.712379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.713199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.715615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:57.724352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:57.735049 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 882/1773] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:57.736581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c5cd-c711-4ce4-8219-bc44be370019 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.736885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c5cd-c711-4ce4-8219-bc44be370019 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.737170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c5cd-c711-4ce4-8219-bc44be370019 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.738957 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 883/1774] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:57.739743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4c5cd-c711-4ce4-8219-bc44be370019 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:57.771017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 892/1775] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:57.773962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:57.800351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:57.809173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60d956-8c91-4ebd-887b-a6ffae3b3cf5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:57.950209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:57.951014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.951770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.952304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.953213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:57.955319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:57.978643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4c5cd-c711-4ce4-8219-bc44be370019 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:57.992268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:57.993176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:57.993561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:57.993936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:57.995653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:57.997968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.052127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 893/1776] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:57 2022] POST /identity/v3/projects => generated 391 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:58.053497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.057073 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 884/1777] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:51:57 2022] POST /identity/v3/projects => generated 401 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:58.058204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.150821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:58.211025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c7b59-f6f6-4cd7-95ea-7d9f955ff3f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.221025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.221025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.221025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.221025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] PATH_INFO: `/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb/users/195eda60d95a461092008b62f4039c9f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.222976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d54fe8760e14f21bd8487ed94d50bfb, user_id=195eda60d95a461092008b62f4039c9f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.226646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318d24-0c97-455b-b568-50135123b30d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.240538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0606d-b3c2-42fa-922b-9beb479d424e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.246583 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 885/1778] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:58 2022] PUT /identity/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb/users/195eda60d95a461092008b62f4039c9f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:58.249295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.249660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.250291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.357507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:58.359162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:58.389956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.390685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.390961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.397427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.398281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.400319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29926a6c-1f21-4ba8-bfa2-86066cedc62e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.445767 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 894/1779] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/users => generated 298 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:58.447334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25956b3b-98f7-4b01-9559-439575dc296f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.447504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25956b3b-98f7-4b01-9559-439575dc296f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.447789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25956b3b-98f7-4b01-9559-439575dc296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.488881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-25956b3b-98f7-4b01-9559-439575dc296f None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:58.490526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25956b3b-98f7-4b01-9559-439575dc296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:58.490970 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 886/1780] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:58.491963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.519073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4e5be-4ecf-48dc-9096-fe0ee0f8f41d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.524694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.525511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.525892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.526375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.527303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.529433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.549523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:58.562334 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 887/1781] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/users => generated 302 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:58.573627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.586333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95072ca-ef4a-4276-add2-65fa8f9c11ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.593840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.595114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.595646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.596153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.597198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.599987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.605843 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 895/1782] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:58.607433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.607986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.608554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.636171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 888/1783] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/users => generated 307 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:51:58.637484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.658757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0ed4-650f-4673-9c3b-33e761afc1cc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.665276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] MFA Rules not processed for user `195eda60d95a461092008b62f4039c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:51:58.666718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:58.672390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.673410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.674180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.674588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.675731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.678745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.698960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 889/1784] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:58.700244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.702574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:58.721004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747bbdc-8b78-4be7-90e1-5b75e6f16df4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.727183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.728090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.728377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.728677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.738706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.740693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.752783 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 890/1785] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:58.753725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.765509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dc600-c21a-4680-a9e6-34102f281880 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.771158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.771858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.772145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.772492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.773326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.775180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.789398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 896/1786] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:51:58.789398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.789988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 891/1787] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:58.789988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.810877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4aec5-9efb-41a8-928c-5ec47ffce6f8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.813540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae819e0-7ef4-4e38-b542-5e7d2a0c1820 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.821109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.822558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.823255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.823511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.823806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.824957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.826209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.827923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.828257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.828507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] PATH_INFO: `/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928/users/42f353b8f1a84847be12f4da31d2aba2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.844609 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 897/1788] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:58.845668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.861534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0206e2fd8ca4e1e9427bf7eff9ba928, user_id=42f353b8f1a84847be12f4da31d2aba2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.862703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2740c1-ecf8-49db-a513-4e5c79dbfd11 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:58.864723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.871129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:58.875027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:58.875325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:58.875954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] PATH_INFO: `/v3/projects/b76855c93e214679a58d3e677676a286/users/4a5a77415b2d4cc4a16118551c275455/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:58.895404 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 892/1789] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:58 2022] PUT /identity/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928/users/42f353b8f1a84847be12f4da31d2aba2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:58.897254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:58.904307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:51:58.915603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:58.930902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76855c93e214679a58d3e677676a286, user_id=4a5a77415b2d4cc4a16118551c275455, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:58.934917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:58.968820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 898/1790] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:58 2022] PUT /identity/v3/projects/b76855c93e214679a58d3e677676a286/users/4a5a77415b2d4cc4a16118551c275455/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:58.970871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.139062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab879c6-8224-4047-bc8c-23bbb6d8c703 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.192131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc8f6-49fd-4a1f-b3b1-86bf4e4ded70 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.197316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.198743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.199127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.199509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] PATH_INFO: `/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc/users/4e33144a84224668ae91b62a7438a010/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.229608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21d9dfe4f9e43419319585b02f6d6cc, user_id=4e33144a84224668ae91b62a7438a010, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.234052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.267128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 899/1791] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:58 2022] PUT /identity/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc/users/4e33144a84224668ae91b62a7438a010/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:59.268668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.292946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.295172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.296682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:59.297238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.297782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.420985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6071fa-6d26-433e-8b18-00f1982d8877 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.434503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.437278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.437564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.437833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.438586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.443171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.445694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.447343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.466227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 900/1792] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:59.467159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.478257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 893/1793] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:59.479646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.504305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9cd6a-beb2-4c57-bd54-ba353455945f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.524172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e1ac6-92a5-42e3-a3da-8180c8938ea0 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.529254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.530154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.530154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.530380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.535703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.537444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.541649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.544635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.544864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.545149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.546026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.557973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade023c-a70b-44d1-b695-6124fea07f7a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.570264 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 901/1794] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:59.571801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.590286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 894/1795] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:51:59.592129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056b27-aae2-42ac-8083-9f27a98d2b4a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.592252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056b27-aae2-42ac-8083-9f27a98d2b4a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.592919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056b27-aae2-42ac-8083-9f27a98d2b4a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.597267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263853-32fd-41f5-955f-ff5c095589bc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.606525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 895/1796] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:51:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:51:59.608833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8056b27-aae2-42ac-8083-9f27a98d2b4a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.612893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.614436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.614890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.615589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] PATH_INFO: `/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928/users/42f353b8f1a84847be12f4da31d2aba2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.619220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0206e2fd8ca4e1e9427bf7eff9ba928, user_id=42f353b8f1a84847be12f4da31d2aba2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.629877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.655317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 902/1797] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:59 2022] PUT /identity/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928/users/42f353b8f1a84847be12f4da31d2aba2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:59.665199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:59.669698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8056b27-aae2-42ac-8083-9f27a98d2b4a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.721754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:59.846908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:59.847900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:59.848342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:59.848794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] PATH_INFO: `/v3/projects/b76855c93e214679a58d3e677676a286/users/4a5a77415b2d4cc4a16118551c275455/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:59.851352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76855c93e214679a58d3e677676a286, user_id=4a5a77415b2d4cc4a16118551c275455, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:59.854304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:59.875092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d57ba-aea9-4a93-a240-b6d0cfffa54c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:59.889491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 896/1798] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:59 2022] PUT /identity/v3/projects/b76855c93e214679a58d3e677676a286/users/4a5a77415b2d4cc4a16118551c275455/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:51:59.890571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:00.009199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.011026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.011026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.011026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] PATH_INFO: `/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc/users/4e33144a84224668ae91b62a7438a010/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.018097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21d9dfe4f9e43419319585b02f6d6cc, user_id=4e33144a84224668ae91b62a7438a010, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.021195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd9bf2-2351-4533-80f9-b65b65fd0713 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.056579 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 903/1799] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:51:59 2022] PUT /identity/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc/users/4e33144a84224668ae91b62a7438a010/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:00.058031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13edf-91a3-4739-b178-b4006d91d7db None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.058353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13edf-91a3-4739-b178-b4006d91d7db None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.058603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13edf-91a3-4739-b178-b4006d91d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.114811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-67a13edf-91a3-4739-b178-b4006d91d7db None None] MFA Rules not processed for user `42f353b8f1a84847be12f4da31d2aba2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:00.115807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-67a13edf-91a3-4739-b178-b4006d91d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:00.126693 ncdv-master-1 devstack@keystone.service[97720]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 25 20:52:00.127046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.131350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:00.237831 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 904/1800] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:00.240356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.240356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.240878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.269310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1b03-d5ec-476d-a575-dd93806defd8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.281361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] MFA Rules not processed for user `4a5a77415b2d4cc4a16118551c275455`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:00.289345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:00.394727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:00.406765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195eda60d95a461092008b62f4039c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d54fe8760e14f21bd8487ed94d50bfb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.408338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.409135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.409633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] PATH_INFO: `/v3/projects/e6bafd21c6734b378874ebf67e23b231` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.411894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: Authorizing `identity:get_project(project_id=e6bafd21c6734b378874ebf67e23b231)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.414418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d210-c23c-4d10-8817-d4861dd518aa tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.417024 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 897/1801] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:51:59 2022] GET /identity/v3/projects/e6bafd21c6734b378874ebf67e23b231 => generated 377 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:00.419231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.419657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.420093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.433136 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 905/1802] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:00.463188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.477746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] MFA Rules not processed for user `4e33144a84224668ae91b62a7438a010`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:00.479873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:00.591682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66459f-9a7d-46a4-99c7-c69330210269 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.598496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.599313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.599779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.600124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.610948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.613044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.637908 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 906/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:00.640790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.676349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fda2-d170-4b3d-b508-acde3ce5ea5b service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.696752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.697847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.698204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.698557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.699375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 898/1804] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:00.706489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.710015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.712008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.724144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 907/1805] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:00.725172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.726152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f105dc9-4996-4c61-b534-c864ab70f9d1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.726798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:00.738862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.741153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.742689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.743245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:00.744083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.865291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0394b8-943d-49b0-9ec3-3af2ba351124 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.870807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.872257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.872754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.873909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.884231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.886725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.890819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.893030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba8e60-8660-4871-afe3-359702779710 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:00.898719 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 908/1806] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:00.899946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:00.915045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1f491-0280-43f5-9a60-62101c30f910 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:00.924882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:00.925837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:00.926313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:00.926741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:00.932991 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 899/1807] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:00.957183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:00.959371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:01.004507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 909/1808] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:01.292262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57897d-37fb-4e61-9f52-18d73f42f54d None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:01.293010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57897d-37fb-4e61-9f52-18d73f42f54d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:01.293877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57897d-37fb-4e61-9f52-18d73f42f54d None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:01.295910 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 900/1809] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:01.303301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:01.325895 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 25 20:52:01.326518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:01.354139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea6d5-63a6-4e0b-b7f3-7ce98bb344e8 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:01.368847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '195eda60d95a461092008b62f4039c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d54fe8760e14f21bd8487ed94d50bfb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:01.370299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:01.370762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:01.371222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] PATH_INFO: `/v3/projects/e6bafd21c6734b378874ebf67e23b231` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:01.376355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: Authorizing `identity:get_project(project_id=e6bafd21c6734b378874ebf67e23b231)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:01.379137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:01.396179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 910/1810] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:01 2022] GET /identity/v3/projects/e6bafd21c6734b378874ebf67e23b231 => generated 377 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:01.454870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57897d-37fb-4e61-9f52-18d73f42f54d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:01.497737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:01.540415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57897d-37fb-4e61-9f52-18d73f42f54d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:01.574250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:01.574962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:01.575254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:01.575573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:01.654812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984d6-df6d-48ac-aa61-f6a8d30cdde2 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:01.666363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:01.667283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:01.667568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:01.667865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] PATH_INFO: `/v3/users/250a630cc65342b5a782a022fe145a06` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:01.669399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250a630cc65342b5a782a022fe145a06)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:01.672936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:01.764112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250a630cc65342b5a782a022fe145a06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:01.778507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250a630cc65342b5a782a022fe145a06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:01.809385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250a630cc65342b5a782a022fe145a06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:01.810188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250a630cc65342b5a782a022fe145a06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:01.810838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-521909df-dc4d-4d91-80da-d155d27ff0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250a630cc65342b5a782a022fe145a06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:01.837247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 911/1811] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:01 2022] DELETE /identity/v3/users/250a630cc65342b5a782a022fe145a06 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:01.838789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:01.839089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:01.839729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:01.848874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:01.851016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:01.856814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:01.878943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:01.884507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:01.919891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 901/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:02.070865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 912/1813] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:02.081439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:02.094508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bf39-747f-4d34-9520-0d7a88a9cdbe service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:02.182903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:02.329134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:02.331671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:02.332324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:02.332911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:02.356882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:02.358491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3335cc8-3aa0-411b-b40b-7e939ad2125f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:02.373170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:02.375639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:02.401671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 902/1814] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:02.407880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4927b-b214-4c0f-bfa5-3b72a0c8829b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:02.421281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:02.422715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:02.423240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:02.423668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] PATH_INFO: `/v3/users/72a4c33489514bbc9fa7bf80bc175ca8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:02.425410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a4c33489514bbc9fa7bf80bc175ca8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:02.427842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:02.555360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a4c33489514bbc9fa7bf80bc175ca8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:02.573308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a4c33489514bbc9fa7bf80bc175ca8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:02.612944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a4c33489514bbc9fa7bf80bc175ca8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:02.618712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a4c33489514bbc9fa7bf80bc175ca8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:02.619890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-769b482e-21e5-4371-a288-dc42f0048f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a4c33489514bbc9fa7bf80bc175ca8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:02.657371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 913/1815] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:02 2022] DELETE /identity/v3/users/72a4c33489514bbc9fa7bf80bc175ca8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:02.659470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1089e-10dc-428c-ad93-269c1ff59aee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:02.659963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1089e-10dc-428c-ad93-269c1ff59aee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:02.660496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1089e-10dc-428c-ad93-269c1ff59aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:02.692873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-62c1089e-10dc-428c-ad93-269c1ff59aee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:02.704684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62c1089e-10dc-428c-ad93-269c1ff59aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:02.915900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:02.916984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:02.917475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:02.920704 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 914/1816] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:52:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:02.987750 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 903/1817] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:03.007196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:03.010226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:03.089820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:03.090830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:03.093216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:03.147000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:03.153652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:03.179590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efcf0-c1f1-4af8-b677-a5013593cb5f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:03.184897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:03.185828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:03.186259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:03.186595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:03.205339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:03.206818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:03.248828 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 915/1818] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:03.522776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:03.524414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:03.543660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 904/1819] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:03.563011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b4a0-da88-4dfc-b34f-1b9b0af72598 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:03.569540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:03.577211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:03.577949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:03.578329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] PATH_INFO: `/v3/users/cc6883d9d1354036835a16a2ea6d7e6b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:03.580152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6883d9d1354036835a16a2ea6d7e6b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:03.582407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:03.604497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:03.667421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6883d9d1354036835a16a2ea6d7e6b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:03.770919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:03.770919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:03.789208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ad80-e107-45f3-97f3-c2b967d49dbf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:03.791163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6883d9d1354036835a16a2ea6d7e6b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:03.797980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:03.799359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:03.799359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:03.799359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:03.823515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:03.825780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd594d08-a535-4450-96e2-1854094ac21c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:03.866574 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 905/1820] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:03.873147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6883d9d1354036835a16a2ea6d7e6b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:03.877249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6883d9d1354036835a16a2ea6d7e6b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:03.879748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6883d9d1354036835a16a2ea6d7e6b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:03.935729 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 916/1821] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:03 2022] DELETE /identity/v3/users/cc6883d9d1354036835a16a2ea6d7e6b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:03.940857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:03.941207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:03.941558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:03.986342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:03.986758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:03.988152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:03.988896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.092140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:04.143577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce87-69c9-4c88-9a03-e44e8303ed5c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:04.147632 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 906/1822] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:04.162661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:04.163657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:04.163990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:04.164221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] PATH_INFO: `/v3/users/68692a535dd0447a9e68c00644194480` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:04.176973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:04.178593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.180864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68692a535dd0447a9e68c00644194480)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:04.195674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:04.322564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68692a535dd0447a9e68c00644194480'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.336947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68692a535dd0447a9e68c00644194480'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.377176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0628f9-6e0c-4429-b43b-8d62fe06db7e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:04.388289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:04.391998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:04.391998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:04.392418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:04.397818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68692a535dd0447a9e68c00644194480'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.400911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68692a535dd0447a9e68c00644194480'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.402763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68692a535dd0447a9e68c00644194480'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.408355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.446656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 917/1823] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:03 2022] DELETE /identity/v3/users/68692a535dd0447a9e68c00644194480 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:04.447951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:04.458414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.508305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:04.520333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:04.529001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:04.580322 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 907/1824] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:04.581238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:04.587489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.641116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0f1c3-dec7-4f9d-95ae-d157e77f4ec1 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:04.661814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:04.665522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:04.665819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:04.666088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] PATH_INFO: `/v3/projects/78c875f569324e3b87feb4a93ddbc8f9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:04.670858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c875f569324e3b87feb4a93ddbc8f9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:04.674558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:04.679757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f61d2-6e50-479b-9857-807be8c30c0f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:04.695924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:04.699183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:04.702722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:04.702722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] PATH_INFO: `/v3/projects/fa9f68b86e444f52a2f5e73e40aadfa9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:04.704049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9f68b86e444f52a2f5e73e40aadfa9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:04.708465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:04.808112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c875f569324e3b87feb4a93ddbc8f9', 'request_id': 'req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.828352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c875f569324e3b87feb4a93ddbc8f9', 'request_id': 'req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.838644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c875f569324e3b87feb4a93ddbc8f9', 'request_id': 'req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.877892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] The token cache is being invalidate because project 78c875f569324e3b87feb4a93ddbc8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:04.878271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.879217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa9f0fe1-3a4a-4225-a665-8abc4b1e904f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.882356 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 908/1825] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:04 2022] DELETE /identity/v3/projects/78c875f569324e3b87feb4a93ddbc8f9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:04.888198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:04.888683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:04.889201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:04.895289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9f68b86e444f52a2f5e73e40aadfa9', 'request_id': 'req-93f8727c-29f6-49c7-8aa2-e26c6f005571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.929276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9f68b86e444f52a2f5e73e40aadfa9', 'request_id': 'req-93f8727c-29f6-49c7-8aa2-e26c6f005571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:04.941387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:04.945750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:04.954755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9f68b86e444f52a2f5e73e40aadfa9', 'request_id': 'req-93f8727c-29f6-49c7-8aa2-e26c6f005571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.005335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] The token cache is being invalidate because project fa9f68b86e444f52a2f5e73e40aadfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:05.007695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.008943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.012213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 918/1826] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:04 2022] DELETE /identity/v3/projects/fa9f68b86e444f52a2f5e73e40aadfa9 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:05.012870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:05.014479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:05.088815 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 909/1827] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:05.088815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:05.097648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:05.124384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639dc19-697d-4dc4-9064-d4cbdfdb7783 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:05.140717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:05.141869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:05.142132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:05.142938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] PATH_INFO: `/v3/users/42f353b8f1a84847be12f4da31d2aba2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:05.146262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f353b8f1a84847be12f4da31d2aba2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:05.148309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:05.169807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:05.278410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f353b8f1a84847be12f4da31d2aba2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.279241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f353b8f1a84847be12f4da31d2aba2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.288250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8727c-29f6-49c7-8aa2-e26c6f005571 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:05.301337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:05.302533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:05.302797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:05.303902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] PATH_INFO: `/v3/users/4a5a77415b2d4cc4a16118551c275455` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:05.305595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5a77415b2d4cc4a16118551c275455)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:05.306064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f353b8f1a84847be12f4da31d2aba2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.312490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:05.334087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f353b8f1a84847be12f4da31d2aba2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.351969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f353b8f1a84847be12f4da31d2aba2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.370832 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 910/1828] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:05 2022] DELETE /identity/v3/users/42f353b8f1a84847be12f4da31d2aba2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:05.371938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:05.378819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:05.417384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:05.420812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5a77415b2d4cc4a16118551c275455'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.436184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5a77415b2d4cc4a16118551c275455'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.468032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5a77415b2d4cc4a16118551c275455'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.471869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5a77415b2d4cc4a16118551c275455'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.476582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5a77415b2d4cc4a16118551c275455'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:05.517964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 919/1829] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:05 2022] DELETE /identity/v3/users/4a5a77415b2d4cc4a16118551c275455 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:05.519889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741fd5d-f8e2-4202-8907-6eb6d02a68d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:05.671744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:05.673413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:05.673734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:05.674292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:05.678704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:05.754009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:05.755813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:05.817067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:05.844156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:05.849695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebfeaa-68ac-44ae-b0e0-82be94626521 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:05.854714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:05.871407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:05.873646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:05.873943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:05.874334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] PATH_INFO: `/v3/projects/e6bafd21c6734b378874ebf67e23b231` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:05.877664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bafd21c6734b378874ebf67e23b231)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:05.883317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:05.888096 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 911/1830] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:06.009154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bafd21c6734b378874ebf67e23b231', 'request_id': 'req-22853707-cbb2-4f59-afa7-68e07aa8d562'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.023596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bafd21c6734b378874ebf67e23b231', 'request_id': 'req-22853707-cbb2-4f59-afa7-68e07aa8d562'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.041078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bafd21c6734b378874ebf67e23b231', 'request_id': 'req-22853707-cbb2-4f59-afa7-68e07aa8d562'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.055087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] The token cache is being invalidate because project e6bafd21c6734b378874ebf67e23b231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:06.055441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.056079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.061184 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 920/1831] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:05 2022] DELETE /identity/v3/projects/e6bafd21c6734b378874ebf67e23b231 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:06.063749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:06.078789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a452403-1204-40d3-97dd-f96b4f95bea1 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:06.248414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:06.250304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:06.250791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:06.251404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] PATH_INFO: `/v3/users/195eda60d95a461092008b62f4039c9f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:06.253864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] RBAC: Authorizing `identity:delete_user(user_id=195eda60d95a461092008b62f4039c9f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:06.257489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:06.300131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:06.301691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:06.343286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853707-cbb2-4f59-afa7-68e07aa8d562 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:06.368021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:06.369065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:06.369353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:06.369627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] PATH_INFO: `/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:06.375161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0206e2fd8ca4e1e9427bf7eff9ba928)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:06.375908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195eda60d95a461092008b62f4039c9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.376669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195eda60d95a461092008b62f4039c9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.377974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:06.390907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195eda60d95a461092008b62f4039c9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.416638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195eda60d95a461092008b62f4039c9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.429521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a052307-5455-4551-8e1b-8ba1d40e625a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195eda60d95a461092008b62f4039c9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.444615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 912/1832] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:06 2022] DELETE /identity/v3/users/195eda60d95a461092008b62f4039c9f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:06.487238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:06.491156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0206e2fd8ca4e1e9427bf7eff9ba928', 'request_id': 'req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.504820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0206e2fd8ca4e1e9427bf7eff9ba928', 'request_id': 'req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.523312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0206e2fd8ca4e1e9427bf7eff9ba928', 'request_id': 'req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.542703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] The token cache is being invalidate because project b0206e2fd8ca4e1e9427bf7eff9ba928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:06.542963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.543655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:06.560574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 921/1833] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:06 2022] DELETE /identity/v3/projects/b0206e2fd8ca4e1e9427bf7eff9ba928 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:06.562173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bd30-e752-47c1-b589-6d377841dc16 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:06.562556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bd30-e752-47c1-b589-6d377841dc16 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:06.562958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bd30-e752-47c1-b589-6d377841dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:06.605842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f8c2bd30-e752-47c1-b589-6d377841dc16 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:06.608670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8c2bd30-e752-47c1-b589-6d377841dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:06.796171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:06.801326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:06.824807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 913/1834] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:06.826599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:06.827138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:06.827428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:06.851058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:06.852601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:06.866302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 914/1835] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:06.867308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:06.868781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:06.877930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:06.889915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d510b88-f58a-49a8-b348-d1cfd457b8e6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:06.900404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:06.901533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:06.901909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:06.902302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] PATH_INFO: `/v3/projects/af62bf0347fa45a19dd2b9091ac99623` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:06.903863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af62bf0347fa45a19dd2b9091ac99623)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:06.906218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.018122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af62bf0347fa45a19dd2b9091ac99623', 'request_id': 'req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.026601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa43a9-8c85-44fe-8d38-845ac57b4fa0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.030597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af62bf0347fa45a19dd2b9091ac99623', 'request_id': 'req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.041587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af62bf0347fa45a19dd2b9091ac99623', 'request_id': 'req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.066359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] The token cache is being invalidate because project af62bf0347fa45a19dd2b9091ac99623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:07.066359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.067040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.071001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 915/1836] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:06 2022] DELETE /identity/v3/projects/af62bf0347fa45a19dd2b9091ac99623 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:07.075692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.079600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.157486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.158651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.159590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.160127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] PATH_INFO: `/v3/projects/b76855c93e214679a58d3e677676a286` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.162855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76855c93e214679a58d3e677676a286)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.165188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.191290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4fe6-5722-4929-8efe-fe91de9d9e78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.203201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.204089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.204377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.204768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.205625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:07.207718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.210454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.241813 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 916/1837] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:07.242891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.253881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.285223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76855c93e214679a58d3e677676a286', 'request_id': 'req-a0a9554d-9924-440f-a0f9-478abc9a02a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.285971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c58e6-a276-4e20-beae-ef19c150a0a8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.295480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76855c93e214679a58d3e677676a286', 'request_id': 'req-a0a9554d-9924-440f-a0f9-478abc9a02a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.309895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76855c93e214679a58d3e677676a286', 'request_id': 'req-a0a9554d-9924-440f-a0f9-478abc9a02a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.324207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] The token cache is being invalidate because project b76855c93e214679a58d3e677676a286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:07.324684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.325183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.327151 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 922/1838] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:06 2022] DELETE /identity/v3/projects/b76855c93e214679a58d3e677676a286 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:07.328094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.329238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.358196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:07.398909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.399972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.400274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.400606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] PATH_INFO: `/v3/users/4e33144a84224668ae91b62a7438a010` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.401975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e33144a84224668ae91b62a7438a010)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.404068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.436987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:07.446981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9554d-9924-440f-a0f9-478abc9a02a0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.454595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.455651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.456011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.456407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] PATH_INFO: `/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.458029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d54fe8760e14f21bd8487ed94d50bfb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.460498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.482179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e33144a84224668ae91b62a7438a010'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.483193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e33144a84224668ae91b62a7438a010'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.494432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e33144a84224668ae91b62a7438a010'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.524166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e33144a84224668ae91b62a7438a010'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.527537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d54fe8760e14f21bd8487ed94d50bfb', 'request_id': 'req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.535243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e33144a84224668ae91b62a7438a010'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.540575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d54fe8760e14f21bd8487ed94d50bfb', 'request_id': 'req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.548168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d54fe8760e14f21bd8487ed94d50bfb', 'request_id': 'req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.549937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 917/1839] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:07 2022] DELETE /identity/v3/users/4e33144a84224668ae91b62a7438a010 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:07.551347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.552894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.584014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] The token cache is being invalidate because project 7d54fe8760e14f21bd8487ed94d50bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:07.584887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.587211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7909a24f-e984-4d6d-9b09-57c0eb9e4e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:07.592936 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 923/1840] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:07 2022] DELETE /identity/v3/projects/7d54fe8760e14f21bd8487ed94d50bfb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:07.596130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.598663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.599151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.650263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:07.651591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.670797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d732e1-9881-444d-a22b-3e565328eea8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.681774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.682724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.682963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.683375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.684410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.688077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8dce-4a44-4c8f-9115-ed9ed9ac0d27 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.734344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 918/1841] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:07.736287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd3a-26f3-4902-9a16-34fab0b42837 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.736819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd3a-26f3-4902-9a16-34fab0b42837 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.737220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7cd3a-26f3-4902-9a16-34fab0b42837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.759118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-74f7cd3a-26f3-4902-9a16-34fab0b42837 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:07.761177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-74f7cd3a-26f3-4902-9a16-34fab0b42837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.764784 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 924/1842] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:07.772446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.775029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.810519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c3a32-1618-4be8-961f-3567d2d58791 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.881586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:07.908663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 919/1843] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:07.909905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.910733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.911022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.911300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.911576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.911994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.912236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.912716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.914009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b57519-58c1-48f9-b2ae-7e6d17e8c270 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.936713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:07.938388 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 925/1844] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:07.938909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.939977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.940304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.940603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.951477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 920/1845] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:07.952826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.961216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:07.962570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:07.972232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec186-b383-4dee-80dd-afb6c04e8d1c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.973048 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 926/1846] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:07.973872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:07.981114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.982007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.982296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.982577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.983568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.985327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.986461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b36954-5149-4983-b5e7-f0596aa9e3f4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:07.991703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:07.992508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:07.992815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:07.993020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:07.993790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:07.994107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:07.995780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:07.998933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 921/1847] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:07.999847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.015896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81557f99-b515-4bf9-9dd4-f00bea6a5c14 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.016457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 927/1848] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:08.017498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.027811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.028890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.029332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.029784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.032049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0644e-72ef-4afb-b20b-81054ae5625f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.035232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:08.035749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.037758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.038598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.038947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.039276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.040112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.040777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.042010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.043006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.059123 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 922/1849] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:08.059989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.067829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 928/1850] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.068792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.073153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.078598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab060-08fa-4ffd-8361-1571ed57abfe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.084209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.085094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.085385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.085657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.086355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.088292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.092409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351bae-0630-49ea-b518-33bbedd7641c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.097433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.098338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.098620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.098900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] PATH_INFO: `/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.100116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21d9dfe4f9e43419319585b02f6d6cc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.102088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.115739 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 923/1851] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.116637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.152666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21d9dfe4f9e43419319585b02f6d6cc', 'request_id': 'req-b816a54a-a365-47a7-9ff7-bfaf52515192'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:08.160307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21d9dfe4f9e43419319585b02f6d6cc', 'request_id': 'req-b816a54a-a365-47a7-9ff7-bfaf52515192'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:08.165997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21d9dfe4f9e43419319585b02f6d6cc', 'request_id': 'req-b816a54a-a365-47a7-9ff7-bfaf52515192'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:08.177934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] The token cache is being invalidate because project e21d9dfe4f9e43419319585b02f6d6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:08.178223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:08.178998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:08.180695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 929/1852] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:08 2022] DELETE /identity/v3/projects/e21d9dfe4f9e43419319585b02f6d6cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:08.181465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.182741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce96ce-deea-4f78-8d6c-b751d4755ef6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.183139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.241996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.242681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.242967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.243244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.243966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.245952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.246137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a54a-a365-47a7-9ff7-bfaf52515192 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.251057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.251973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.252257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.252569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] PATH_INFO: `/v3/projects/18c64cf08c40400288980afacb9c4af1/users/d590b5ca4ced417699084cc92dc76879/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.268226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c64cf08c40400288980afacb9c4af1, user_id=d590b5ca4ced417699084cc92dc76879, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.270968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886b7d8-7308-46d5-910f-23c0ba446504 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.275599 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 924/1853] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/projects => generated 395 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.275599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.275599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.288568 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 930/1854] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:08 2022] PUT /identity/v3/projects/18c64cf08c40400288980afacb9c4af1/users/d590b5ca4ced417699084cc92dc76879/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:08.289675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.289971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.290253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.302815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.308653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:08.310751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.352176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb44a-9949-4146-952f-8db0f3112c81 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.361026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.374046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 931/1855] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:08.375003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.376230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.388365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1f78-b7de-44b1-8ec6-47ee730ff93e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.393128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.393807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.394093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.394370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.395067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.397076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1112c-9939-40f9-a097-fbb8992cea0d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.413228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.414064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.414637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.414918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.415633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.417627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bf071-12cc-4ecc-8313-adb9ac98a6ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.422203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 932/1856] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.422203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.422203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.422203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.443777 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 925/1857] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/users => generated 304 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.445276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.445566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.445850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.453593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] MFA Rules not processed for user `d590b5ca4ced417699084cc92dc76879`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:08.454909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.464764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:08.466000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.475022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 926/1858] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:08.475874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.486207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31f80d-3d29-4f6f-9cd7-9dc2509fe11c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.491711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.492476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.492726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.493031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.493779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.495462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.506286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 927/1859] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.507307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.517768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40c60-e078-43ad-af74-16de853bec53 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.522471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.523137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.523417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.523690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.524407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.526043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.526182 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 933/1860] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:08.527093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.538557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 928/1861] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.538843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb37c8-a332-4779-8710-b8bc594686be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.539409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.546471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.547166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.547437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.547695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.548537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:08.548857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.549176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9977c-45a7-401a-8c69-40140455bee2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.550678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.554064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.554713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.554991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.555264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.555975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.557623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.563065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 934/1862] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:08.563981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.572404 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 929/1863] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.573324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.574339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b1f7-a6c1-48ee-ad65-7e049d3df666 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.579914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.580624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.580916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.581194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.581932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.583296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d1bc4-4d25-43da-9358-8df07d31bf7b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.583916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.587872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.588577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.588859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.589133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.590199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.591869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.603895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 930/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.604940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.613705 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 935/1865] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.614692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.616286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8efab-15d5-4078-8fdf-d57557eb5032 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.662299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.676734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.676981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.677265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.677543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.678246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.680100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f87ddb-3fa8-41f8-93e4-0ef8205e2e42 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.680221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.684862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.685847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.686136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.686406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b/users/09de5e17cfef4914ad400fade6819a73/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.702535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f39dd45affa48fa836488de7e0f501b, user_id=09de5e17cfef4914ad400fade6819a73, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.705339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.710435 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 931/1866] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.710435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.732449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 936/1867] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:08 2022] PUT /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b/users/09de5e17cfef4914ad400fade6819a73/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:08.732449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.756013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.780525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ae4e-2987-4437-b22f-01944cc63329 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.793674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecaca-7a31-467f-8c9e-b0f802fc8cb8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.798903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.799608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.799900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.800176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.800946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.802925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.828563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 937/1868] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.829408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.840142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef1e34-efe2-4ef6-97b9-0ea245fad731 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.843155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.844113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.844402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.844732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] PATH_INFO: `/v3/projects/4ed6752b2897473cbdd87c1ea50fdc6c/users/1636417dff5a4857a2eaf9acd150e5fe/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.845164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.845832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.846118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.846399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.847095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.849128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688eca0-5210-4a30-9770-55b72e43daa6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.860448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed6752b2897473cbdd87c1ea50fdc6c, user_id=1636417dff5a4857a2eaf9acd150e5fe, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.863287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.871769 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 938/1869] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/users => generated 304 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:08.871769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.871769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.871769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.878304 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 932/1870] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:08 2022] PUT /identity/v3/projects/4ed6752b2897473cbdd87c1ea50fdc6c/users/1636417dff5a4857a2eaf9acd150e5fe/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:08.879369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.904955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] MFA Rules not processed for user `09de5e17cfef4914ad400fade6819a73`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:08.906320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:08.960073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142853-7571-4f5b-8f5f-71c37aba3d55 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:08.967641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:08.968414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.968725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.969015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:08.969754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:08.971367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7bf50-2a90-4acc-97b9-6c6bf2ada573 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:08.984703 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 939/1871] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:08.985688 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 933/1872] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:08.985801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:08.987279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:08.987560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:08.987866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.003767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b2f7-162b-4f32-9555-c95c261b81f7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.009058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.009680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.009968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.010247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.010988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.012924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.021787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] MFA Rules not processed for user `1636417dff5a4857a2eaf9acd150e5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:09.023144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:09.026241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 940/1873] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.029962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.041308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2260f-c0b8-418b-982f-68ec795fb73f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.047449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.049629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.049629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.049629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.049878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.051763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.068547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.089858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.101349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 941/1874] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:09.102295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.113876 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 934/1875] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:09.114939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.127774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f88a6-12f9-4335-ad27-34b67b9b3cec None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.180311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bd3b1-6b95-4887-b9a6-87617b39f44c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.185177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.186176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.187508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.187508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] PATH_INFO: `/v3/projects/dfe5c060210343ca96b58c1b913bd9fc/users/13f786ca774f477c9292122fe1dd73f3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.203054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5c060210343ca96b58c1b913bd9fc, user_id=13f786ca774f477c9292122fe1dd73f3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.203490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.204211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.204531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.204840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.205641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.205825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.207287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.223420 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 935/1876] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.223420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.223696 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 942/1877] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/dfe5c060210343ca96b58c1b913bd9fc/users/13f786ca774f477c9292122fe1dd73f3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.223696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.234630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04694639-6079-4e14-9d64-7c9b6ccc1991 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.298174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.298783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.299070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.299388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.300087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.302096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.306430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d581b-c588-496a-95ae-94a3770ff4ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.311057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.311716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.312001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.312276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.313075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.315114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.323667 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 936/1878] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:09.324523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.335109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078a6e-7776-45c6-a513-1fa1fad0f91b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.341056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.341968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.342255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.342529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] PATH_INFO: `/v3/projects/912d29d01f1a45a09a0a8d1a2da1e3a0/users/afe855a61c584a728633d50d240d53f1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.345140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 943/1879] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/projects => generated 407 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:09.349110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.361554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912d29d01f1a45a09a0a8d1a2da1e3a0, user_id=afe855a61c584a728633d50d240d53f1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.364229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.378154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 937/1880] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/912d29d01f1a45a09a0a8d1a2da1e3a0/users/afe855a61c584a728633d50d240d53f1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.378952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.408562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8d3b1-b36f-4bc2-9d79-713b4cf11084 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.416736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.434217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.446676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1899c9-f7f7-4160-8a5b-2e3453acb1d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.453137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.453828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.454178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.454461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.455214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.456865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.469010 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 938/1881] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.469919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.477516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.478214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.478496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.478791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.479528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.480629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69fbbf-7f14-471a-b9a2-00f7b07d8759 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.481202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7c0e5-df58-464a-bac8-397f3891d234 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.485338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.485992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.486270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.486542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.487226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.489163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.491813 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 944/1882] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.493897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.494265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.494659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.512631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 939/1883] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/users => generated 310 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:09.512631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.521993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6dbc2-461a-44a4-8595-53446b9962ec admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.523957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] MFA Rules not processed for user `afe855a61c584a728633d50d240d53f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:09.525224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:09.526607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.527484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.527758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.528033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] PATH_INFO: `/v3/projects/f77fec7e28f1495b8207391a39352008/users/43ecdca15957494abb92bfe30a030fe0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.543325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77fec7e28f1495b8207391a39352008, user_id=43ecdca15957494abb92bfe30a030fe0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.546087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.559888 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 940/1884] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/f77fec7e28f1495b8207391a39352008/users/43ecdca15957494abb92bfe30a030fe0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.560810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.597030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 945/1885] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:09.598082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.609290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5f844-0ce7-4d64-9939-114eb24092de None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.629228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d324d5-a21c-4fd7-8ad1-75f049a640ac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.634306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.635264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.635550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.635815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] PATH_INFO: `/v3/projects/dfe5c060210343ca96b58c1b913bd9fc/users/13f786ca774f477c9292122fe1dd73f3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.637917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5c060210343ca96b58c1b913bd9fc, user_id=13f786ca774f477c9292122fe1dd73f3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.640655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.651414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 941/1886] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/dfe5c060210343ca96b58c1b913bd9fc/users/13f786ca774f477c9292122fe1dd73f3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.652529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.664912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.665597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.665879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.666156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.666889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.668581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.681851 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 946/1887] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.681851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.692537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6368fb-14f1-42ca-8f94-08acc975a7a7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.720143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135179fb-f238-4926-92db-63bc2699ffdd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.724065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.726125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.726879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.727165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.727446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.728754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.729854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1593-9672-43d5-be98-3bd18662e8f6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.740470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 942/1888] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:09.741915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.742195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.742495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.754022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.754753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.755304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.755304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.756164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.758209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.769603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] MFA Rules not processed for user `13f786ca774f477c9292122fe1dd73f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:09.770923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:09.789765 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 947/1889] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/projects => generated 411 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:09.789765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.801586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:09.851095 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 943/1890] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:09.852076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.854240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b746c-e185-4f99-9abb-d879dd8f27a5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.860611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.861708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.862207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.862483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] PATH_INFO: `/v3/projects/9b57aea414a84712bfa37be5ff1691c8/users/dc4144db571c464c9cdb446852bcd876/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.866503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec105a-7272-4de9-9dbe-a8b4db077eeb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:09.872148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:09.873156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:09.873579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:09.873858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] PATH_INFO: `/v3/projects/f77fec7e28f1495b8207391a39352008/users/43ecdca15957494abb92bfe30a030fe0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:09.876215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77fec7e28f1495b8207391a39352008, user_id=43ecdca15957494abb92bfe30a030fe0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.877796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57aea414a84712bfa37be5ff1691c8, user_id=dc4144db571c464c9cdb446852bcd876, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:09.879163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.880480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:09.892532 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 944/1891] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/f77fec7e28f1495b8207391a39352008/users/43ecdca15957494abb92bfe30a030fe0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.893123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.905566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 948/1892] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:09 2022] PUT /identity/v3/projects/9b57aea414a84712bfa37be5ff1691c8/users/dc4144db571c464c9cdb446852bcd876/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:09.906575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:09.909507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:09.959151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c54f-f7bc-4712-b4ad-d433e75fea24 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.015646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.016340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.016667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.016917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975a663-0805-43d3-bcb9-f0cb43ce0309 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.017022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.017698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.019649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ed1ed-8e38-4885-b804-f4d9c091b07e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.022550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.023212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.023525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.023804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.034519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.041695 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 945/1893] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:09 2022] POST /identity/v3/users => generated 312 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:10.043048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.043338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.044104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.071432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] MFA Rules not processed for user `43ecdca15957494abb92bfe30a030fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:10.072701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.088342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.090460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.100560 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 949/1894] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:10.101552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.113109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dd7b-2c89-47ae-ad44-fdfe58c8f897 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.117438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.120111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.122516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.122680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.122960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.123740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.125476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.139539 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 950/1895] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:10.140496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.154349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef22a77-f755-49bd-951e-93539e1a6d3b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.159767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.160447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.160742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.161019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.161780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.163655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.172059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 946/1896] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:10.172059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.178975 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 951/1897] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:10.181975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.182104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb2b1-03e7-4dbf-a650-3e9dc78b057e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.187487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.188615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.188998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.189375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] PATH_INFO: `/v3/projects/9b57aea414a84712bfa37be5ff1691c8/users/dc4144db571c464c9cdb446852bcd876/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.191579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57aea414a84712bfa37be5ff1691c8, user_id=dc4144db571c464c9cdb446852bcd876, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.192329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8b98-ea41-4c2c-bd6e-a3abbd24326f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.195029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.197925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.198781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.199339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.199905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.200828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.203444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb24d-f141-42f4-93e4-8a2b0400deb9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.208945 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 947/1898] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:10 2022] PUT /identity/v3/projects/9b57aea414a84712bfa37be5ff1691c8/users/dc4144db571c464c9cdb446852bcd876/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:10.219797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.244363 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 952/1899] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/projects => generated 395 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:10.246153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.246451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.246733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.293900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] MFA Rules not processed for user `dc4144db571c464c9cdb446852bcd876`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:10.295411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.314915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af61f-62d9-4983-8218-4be5e578e0c8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.394326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.395680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.396086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.396379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] PATH_INFO: `/v3/projects/9043b81c9654478c9a0a4c21b74044e1/users/ced6cbaa77664e5799b7a66e1a7d4a6a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.410253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 953/1900] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:10.410990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.421967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9043b81c9654478c9a0a4c21b74044e1, user_id=ced6cbaa77664e5799b7a66e1a7d4a6a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.425321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4a0ec-27f4-4428-9368-5427e2f18a2f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.425647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.431241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.432386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.432716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.433087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.433802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.436466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.448091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 948/1901] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:10 2022] PUT /identity/v3/projects/9043b81c9654478c9a0a4c21b74044e1/users/ced6cbaa77664e5799b7a66e1a7d4a6a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:10.451483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.468466 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 954/1902] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/users => generated 298 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:10.469818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.487699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9acac-396e-4b26-becf-a35e65db00da admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.508405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.533416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a631e3-b1bf-4c27-9e4e-5cbdf36b6153 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.538107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.538822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.539108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.539389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.540112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.541400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.541797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.552845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 949/1903] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:10.553697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.564101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567baff0-ae0d-49e7-bf91-ee18f51dfe24 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.568828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.569693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.569975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.570282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] PATH_INFO: `/v3/users/d590b5ca4ced417699084cc92dc76879` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.571512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d590b5ca4ced417699084cc92dc76879)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.573479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.574461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.575141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.575457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.575745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.576541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.578173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.587985 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 955/1904] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:10.588923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.623232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd590b5ca4ced417699084cc92dc76879'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:10.623854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd590b5ca4ced417699084cc92dc76879'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:10.632326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd590b5ca4ced417699084cc92dc76879'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:10.644913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd590b5ca4ced417699084cc92dc76879'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:10.652248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd590b5ca4ced417699084cc92dc76879'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:10.658858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 950/1905] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:10 2022] DELETE /identity/v3/users/d590b5ca4ced417699084cc92dc76879 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:10.659446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.660869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.663237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95904c5-b7b9-4ea8-85fe-f8f35ea64d7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.730252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042f5d9-bf7f-4789-8e1c-714cb0e7120d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.734998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.735160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.735872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.735971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.736200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.736352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.736511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] PATH_INFO: `/v3/projects/9043b81c9654478c9a0a4c21b74044e1/users/ced6cbaa77664e5799b7a66e1a7d4a6a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.736794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.738528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9043b81c9654478c9a0a4c21b74044e1, user_id=ced6cbaa77664e5799b7a66e1a7d4a6a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.738735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.741322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.755075 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 951/1906] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:10 2022] PUT /identity/v3/projects/9043b81c9654478c9a0a4c21b74044e1/users/ced6cbaa77664e5799b7a66e1a7d4a6a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:10.756212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.762643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.802564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.804342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ba10-9a22-41b0-a9fe-6d5cc1ad67f8 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.809740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.814615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.816775 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 956/1907] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:10.817891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba5dce-4ee6-40a2-935e-393ec2cca08b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.818176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba5dce-4ee6-40a2-935e-393ec2cca08b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.818458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba5dce-4ee6-40a2-935e-393ec2cca08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.828708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eeed7-34de-46d2-9515-b706018d09dd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.835145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.835882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.836165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.836477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.837265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.837503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f3ba5dce-4ee6-40a2-935e-393ec2cca08b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:10.838914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3ba5dce-4ee6-40a2-935e-393ec2cca08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.839560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.847793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 957/1908] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:10.849410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819522-3143-4785-a831-6efc0493ce27 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.849662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819522-3143-4785-a831-6efc0493ce27 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.850038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819522-3143-4785-a831-6efc0493ce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.857570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 952/1909] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:10.857745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.859439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.887556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-62819522-3143-4785-a831-6efc0493ce27 None None] MFA Rules not processed for user `ced6cbaa77664e5799b7a66e1a7d4a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:10.888744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-62819522-3143-4785-a831-6efc0493ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.921829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dd7a-89e9-417f-8d60-b249b292cc7b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.925865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.926536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.926821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.927444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.937261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.938733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:10.948760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 953/1910] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:10.949648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.957592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 958/1911] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:10.958530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62819522-3143-4785-a831-6efc0493ce27 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:10.959870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-62819522-3143-4785-a831-6efc0493ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:10.960677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ebeeb-97b2-4ec4-ad5f-45d49f636281 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:10.966004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:10.966937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:10.967257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:10.967901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] PATH_INFO: `/v3/projects/1694d79cb0c646a39fa29b96aaa15507/users/a0297a17b4924d71b358f021b88af6cc/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:10.985579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1694d79cb0c646a39fa29b96aaa15507, user_id=a0297a17b4924d71b358f021b88af6cc, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:10.988905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.007614 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 954/1912] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:10 2022] PUT /identity/v3/projects/1694d79cb0c646a39fa29b96aaa15507/users/a0297a17b4924d71b358f021b88af6cc/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:11.017431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.020170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.056982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62819522-3143-4785-a831-6efc0493ce27 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.109539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e00a76-22f7-46ee-a3ba-6b4fca8386ba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.115269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.115964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.116242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.116830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.128488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.129170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.129486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.129725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.131697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.143077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.184350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.186121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fca2a-891b-4263-bb64-bab51785881c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.190432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.198550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.200863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.204689 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 955/1913] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:11.206895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.207405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.207693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.211574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 959/1914] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:11.245632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] MFA Rules not processed for user `a0297a17b4924d71b358f021b88af6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:11.248238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.254939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.270931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435561ed-7d73-4cb9-9752-3242cb9a0651 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.280913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.283337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.283540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.283889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.293709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.343458 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 956/1915] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:11.344344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.345728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.379778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.381766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.392503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 960/1916] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:11.424112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.426658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b0937-243c-43b4-b549-a963afa235e2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.432817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.433921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.434201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.434484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] PATH_INFO: `/v3/projects/18c64cf08c40400288980afacb9c4af1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.435791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c64cf08c40400288980afacb9c4af1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.436136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9849f7-a95e-4cea-8b71-d2d8ab3cede1 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.437956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.442427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.443197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.443557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.443904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.445874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.510893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c64cf08c40400288980afacb9c4af1', 'request_id': 'req-3c863cc7-119a-4285-b63c-b8541a073e9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.520019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c64cf08c40400288980afacb9c4af1', 'request_id': 'req-3c863cc7-119a-4285-b63c-b8541a073e9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.540528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c64cf08c40400288980afacb9c4af1', 'request_id': 'req-3c863cc7-119a-4285-b63c-b8541a073e9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.549583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.551198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.555332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] The token cache is being invalidate because project 18c64cf08c40400288980afacb9c4af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:11.555332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.556388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.560376 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 957/1917] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:11 2022] DELETE /identity/v3/projects/18c64cf08c40400288980afacb9c4af1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:11.561205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.562545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.566183 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 961/1918] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:11.567344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.578724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33406e-9736-4a85-814f-9cce1bf45e8e service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.597206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.644288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.657989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863cc7-119a-4285-b63c-b8541a073e9b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.662633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.662877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.663694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.663838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.664012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.664145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.664285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] PATH_INFO: `/v3/users/afe855a61c584a728633d50d240d53f1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.664588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] PATH_INFO: `/v3/users/13f786ca774f477c9292122fe1dd73f3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.665575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe855a61c584a728633d50d240d53f1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.665997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f786ca774f477c9292122fe1dd73f3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.667849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.668225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.722907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe855a61c584a728633d50d240d53f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.723466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f786ca774f477c9292122fe1dd73f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.724204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe855a61c584a728633d50d240d53f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.734335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe855a61c584a728633d50d240d53f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.737603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f786ca774f477c9292122fe1dd73f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.753832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe855a61c584a728633d50d240d53f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.754001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f786ca774f477c9292122fe1dd73f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.754001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f786ca774f477c9292122fe1dd73f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.754627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1313f034-9272-4dd0-a555-67ea0b9effa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f786ca774f477c9292122fe1dd73f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.760610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe855a61c584a728633d50d240d53f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.767768 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 958/1919] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:11 2022] DELETE /identity/v3/users/afe855a61c584a728633d50d240d53f1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:11.768807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.770148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.773656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 962/1920] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:11 2022] DELETE /identity/v3/users/13f786ca774f477c9292122fe1dd73f3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:11.775128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2cf49-6bd6-4e48-8c30-cb64094c892f None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.775424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2cf49-6bd6-4e48-8c30-cb64094c892f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.775707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2cf49-6bd6-4e48-8c30-cb64094c892f None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.781784 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 963/1921] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:11.788175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.788581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.788862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.810204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:11.812485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.847365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e48a0-59da-4d14-8807-5d949b62eb18 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:11.878299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 964/1922] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:11.882443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:11.884858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:11.892123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.911721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:11.912596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:11.912875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:11.913145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] PATH_INFO: `/v3/users/1636417dff5a4857a2eaf9acd150e5fe` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:11.914530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1636417dff5a4857a2eaf9acd150e5fe)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:11.916451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:11.984450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1636417dff5a4857a2eaf9acd150e5fe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.985117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:11.985300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1636417dff5a4857a2eaf9acd150e5fe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.993804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:11.995602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1636417dff5a4857a2eaf9acd150e5fe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:11.996609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.011669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1636417dff5a4857a2eaf9acd150e5fe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.020029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1636417dff5a4857a2eaf9acd150e5fe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.028872 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 959/1923] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:11 2022] DELETE /identity/v3/users/1636417dff5a4857a2eaf9acd150e5fe => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:12.033324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.034893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.077483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eef44-7a44-458a-b643-cdea38b4cb31 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.103685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf31be7-1df4-40bb-a70d-5d9e4029d738 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.107675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.108338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.108658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.108940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.111081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.156887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.157916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.158262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.158613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.160092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.162553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016be3c-4aba-4b4e-8fba-13382afc5bc9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.164651 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 965/1924] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:11 2022] GET /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 395 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:12.166117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.166459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.166802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.186973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:12.188628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.196747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.198236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725819d8-0626-449e-a6ef-9089bde39f79 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.201637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 966/1925] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:12.205597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.207015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.213800 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 960/1926] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:12.216615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbddb2c-1b0f-4f9a-b34c-db3d1ce23706 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.216976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbddb2c-1b0f-4f9a-b34c-db3d1ce23706 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.217266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbddb2c-1b0f-4f9a-b34c-db3d1ce23706 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.218780 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 961/1927] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:12.219347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbddb2c-1b0f-4f9a-b34c-db3d1ce23706 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.220997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119325cb-5917-44bd-b65e-49cff6795103 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.227690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.228727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.229005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.229282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] PATH_INFO: `/v3/projects/dfe5c060210343ca96b58c1b913bd9fc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.230757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe5c060210343ca96b58c1b913bd9fc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.231228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbddb2c-1b0f-4f9a-b34c-db3d1ce23706 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.233314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.235598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.236406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.236556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.236821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.249228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.250948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.257929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:12.266344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 962/1928] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:12.267766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:12.270867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.306125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe5c060210343ca96b58c1b913bd9fc', 'request_id': 'req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.317134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe5c060210343ca96b58c1b913bd9fc', 'request_id': 'req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.325150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe5c060210343ca96b58c1b913bd9fc', 'request_id': 'req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.340036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] The token cache is being invalidate because project dfe5c060210343ca96b58c1b913bd9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:12.340327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.341213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-71115deb-f4c3-4958-9a95-c4f0a7fb9c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:12.343060 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 967/1929] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:12 2022] DELETE /identity/v3/projects/dfe5c060210343ca96b58c1b913bd9fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:12.348364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a45e-79c4-40aa-82f1-9536e8f0b421 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.348764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a45e-79c4-40aa-82f1-9536e8f0b421 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.349295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a45e-79c4-40aa-82f1-9536e8f0b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.370615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6910a45e-79c4-40aa-82f1-9536e8f0b421 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:12.372111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6910a45e-79c4-40aa-82f1-9536e8f0b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.379363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.381074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.396077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:12.398149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6748-e756-44f6-838d-7230af5beae6 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.480459 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 968/1930] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:12.483468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.487020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.487958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.488253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.489004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.489113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.489366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.490308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.492211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.494371 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 963/1931] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:12 2022] GET /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 395 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:12.521478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:12.522916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.531937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 969/1932] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:12.536820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.551519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a5c7e-f4c7-42fa-b00f-26b9379b875e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.559199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.559949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.560603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.560986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.561943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:12.562489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.564805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f0bc5-29ba-47b9-b563-196dd75d3d34 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.597545 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 964/1933] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:12.603186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.620143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c1568-ea0e-41ad-bbb8-44ced824f995 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.627606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.627606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.629778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.629778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.629778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.634117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.659792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.660265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.660529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.663008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 965/1934] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:12.668835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:12.671150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.686520 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 970/1935] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:12 2022] POST /identity/v3/projects => generated 395 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:12.693578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.812355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.814028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.849881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392fc19-44fd-47c9-ab6f-17c42d1054bb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.868088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:12.872761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35182f-e580-4c9d-a34d-803f375e4465 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.878206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.878910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.879199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.879482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.880201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.882515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.910481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 971/1936] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:12 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:52:12.912199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.917271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.933583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbaf79-75ad-464e-85b1-71c4b1983286 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.935310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.936371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.937589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.937589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.938378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.940479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.940621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.941531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.941879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.942219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] PATH_INFO: `/v3/projects/912d29d01f1a45a09a0a8d1a2da1e3a0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.943185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 966/1937] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:12 2022] GET /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 395 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:52:12.944043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:12.944490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] RBAC: Authorizing `identity:delete_project(project_id=912d29d01f1a45a09a0a8d1a2da1e3a0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.945870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:12.948346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:12.965021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df3b9-0753-4c62-9e55-f97605a6f7b2 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:12.970961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:12.972119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:12.972494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:12.972848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] PATH_INFO: `/v3/projects/4ed6752b2897473cbdd87c1ea50fdc6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:12.974288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed6752b2897473cbdd87c1ea50fdc6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:12.976742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.036968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912d29d01f1a45a09a0a8d1a2da1e3a0', 'request_id': 'req-d24c0f89-2c2f-459d-9878-095feb88264f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.049493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed6752b2897473cbdd87c1ea50fdc6c', 'request_id': 'req-465194c0-3966-467a-80e9-cc47f85f3f43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.051278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912d29d01f1a45a09a0a8d1a2da1e3a0', 'request_id': 'req-d24c0f89-2c2f-459d-9878-095feb88264f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.060661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed6752b2897473cbdd87c1ea50fdc6c', 'request_id': 'req-465194c0-3966-467a-80e9-cc47f85f3f43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.064132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912d29d01f1a45a09a0a8d1a2da1e3a0', 'request_id': 'req-d24c0f89-2c2f-459d-9878-095feb88264f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.069156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed6752b2897473cbdd87c1ea50fdc6c', 'request_id': 'req-465194c0-3966-467a-80e9-cc47f85f3f43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.083109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] The token cache is being invalidate because project 4ed6752b2897473cbdd87c1ea50fdc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:13.083285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.083997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.084406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] The token cache is being invalidate because project 912d29d01f1a45a09a0a8d1a2da1e3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:13.085190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.085963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 967/1938] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:12 2022] DELETE /identity/v3/projects/4ed6752b2897473cbdd87c1ea50fdc6c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:13.086077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.086821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.090049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.091008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 972/1939] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:12 2022] DELETE /identity/v3/projects/912d29d01f1a45a09a0a8d1a2da1e3a0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:13.091906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.103533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.119798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:13.180233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465194c0-3966-467a-80e9-cc47f85f3f43 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.185844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.188731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.188731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.188731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.188731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.190096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.197407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0f89-2c2f-459d-9878-095feb88264f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.204144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 968/1940] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:13.204144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.204144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.206935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.207844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.208125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.208401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] PATH_INFO: `/v3/users/dc4144db571c464c9cdb446852bcd876` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.210073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4144db571c464c9cdb446852bcd876)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.212069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.228246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd084-827a-4227-af59-7c35b053d8ff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.228246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.228246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.228246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.228758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] PATH_INFO: `/v3/users/ced6cbaa77664e5799b7a66e1a7d4a6a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.228758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced6cbaa77664e5799b7a66e1a7d4a6a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.228758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.277580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4144db571c464c9cdb446852bcd876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.286476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:13.289883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4144db571c464c9cdb446852bcd876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.304570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4144db571c464c9cdb446852bcd876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.305405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4144db571c464c9cdb446852bcd876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.306015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced6cbaa77664e5799b7a66e1a7d4a6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.306159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4144db571c464c9cdb446852bcd876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.306814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced6cbaa77664e5799b7a66e1a7d4a6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.316045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced6cbaa77664e5799b7a66e1a7d4a6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.328278 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 973/1941] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:13 2022] DELETE /identity/v3/users/dc4144db571c464c9cdb446852bcd876 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:13.328278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.330076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced6cbaa77664e5799b7a66e1a7d4a6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.337392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced6cbaa77664e5799b7a66e1a7d4a6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:13.341038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.348808 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 969/1942] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:13 2022] DELETE /identity/v3/users/ced6cbaa77664e5799b7a66e1a7d4a6a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:13.349710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.351519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.435001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1434-912e-4e29-be23-f92db5acb25b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.438901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa00b8-789d-4869-a3e6-8a74b6b661c3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.445833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.446562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.446821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.447099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.449638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.501243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:13.533941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.534792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.535151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.535908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.536650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.538737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.544743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.546835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20af9a-5da0-42ba-88d2-c5a82402f208 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.552477 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 974/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:13.556195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.557797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.561178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 970/1944] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:13.575973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8625ac-5ede-4fa7-8e1e-e10bc084556a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.583205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.583205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.583205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.583205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] PATH_INFO: `/v3/projects/06e70855762d488086f9750692f43408/users/64cc8bb214134a639e032c2f3b90b525/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.601501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e70855762d488086f9750692f43408, user_id=64cc8bb214134a639e032c2f3b90b525, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.604910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b2e94-a6d5-4ae9-b2cc-12a0791d6ddc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.635215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 975/1945] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:13 2022] PUT /identity/v3/projects/06e70855762d488086f9750692f43408/users/64cc8bb214134a639e032c2f3b90b525/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:13.647539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.647836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.648125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.690272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] MFA Rules not processed for user `64cc8bb214134a639e032c2f3b90b525`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:13.692931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.731682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.731957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.732236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.733787 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 976/1946] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:52:13.739565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:13.756637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:13.831168 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 971/1947] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:13.832233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.843850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.876384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:13.877741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:13.957263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091130b-36bd-4869-b07e-7d0abcd2679b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.963308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.964638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.965305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.965413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] PATH_INFO: `/v3/projects/9b57aea414a84712bfa37be5ff1691c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.966705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b57aea414a84712bfa37be5ff1691c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.968788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:13.979887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511efd-2106-4a97-8a47-70a25f7786fd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:13.988763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:13.990425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:13.990719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:13.991002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:13.995326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:13.999842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.013320 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 977/1948] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:13 2022] GET /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 395 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:52:14.014621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.035729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e715e6-985f-427e-96f1-f27653742a5a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.061235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b57aea414a84712bfa37be5ff1691c8', 'request_id': 'req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.078200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b57aea414a84712bfa37be5ff1691c8', 'request_id': 'req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.088017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b57aea414a84712bfa37be5ff1691c8', 'request_id': 'req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.102697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.103376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] The token cache is being invalidate because project 9b57aea414a84712bfa37be5ff1691c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:14.103764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.105457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.108108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 972/1949] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:13 2022] DELETE /identity/v3/projects/9b57aea414a84712bfa37be5ff1691c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:14.108999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.110728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.132755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.134487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.134843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.135191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.136222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.138947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b76871-6414-4181-960c-4ce26aad2c94 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.178344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 978/1950] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:14.180206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2e72-d206-4a44-9d56-bc6b034ff03b None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.180206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2e72-d206-4a44-9d56-bc6b034ff03b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.180588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da2e72-d206-4a44-9d56-bc6b034ff03b None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.182349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 979/1951] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:14.184404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.184801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.185154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.208773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7b01-01f3-42a5-8ba2-52eddd773ced admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.208945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:14.209954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.222487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.285187 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 980/1952] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:14.288722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.289564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.289708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.289879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.290162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] PATH_INFO: `/v3/projects/9043b81c9654478c9a0a4c21b74044e1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.291118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.291398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9043b81c9654478c9a0a4c21b74044e1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.293618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.303832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d691-c57b-40f2-aa17-ab36a521a103 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.308500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.309232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.309574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.309911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.310733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.312757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.336095 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 981/1953] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:14.336095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:14.336095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.346824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9043b81c9654478c9a0a4c21b74044e1', 'request_id': 'req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.356661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9043b81c9654478c9a0a4c21b74044e1', 'request_id': 'req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.362920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9043b81c9654478c9a0a4c21b74044e1', 'request_id': 'req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.374660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] The token cache is being invalidate because project 9043b81c9654478c9a0a4c21b74044e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:14.374965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.375695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43dd41f4-8a3b-4b3e-9049-ec21e941c0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:14.377427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 973/1954] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:14 2022] DELETE /identity/v3/projects/9043b81c9654478c9a0a4c21b74044e1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:14.378748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.379037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.379543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.399649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:14.400894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.413946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.415180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.462076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 974/1955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:14.462843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.464472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.467965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.476953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c16a-e639-4aac-8f0c-ebb4087fae77 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.481871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.482547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.482835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.483141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.483873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.485101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e872-371a-444d-b4f4-426973316fbc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.485514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f332f-0a0b-4c2a-84a1-f1c2c87f871e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.495635 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 975/1956] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:14.496928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.497351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.497648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.516057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:14.517318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.526072 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 976/1957] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:14.526680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.536679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6202-12f4-443c-887c-1ea94f2ad792 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.541477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.542135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.542438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.542717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.543545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:14.543854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.545569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.550325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.551202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.551492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.551760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.553346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.555814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac087aa-444c-4a32-8ce4-b57e4c2267d6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.557577 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 977/1958] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:14.557689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 982/1959] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 395 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:14.561953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.562564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67906-0563-4843-b653-640881e6ac91 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.563069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67906-0563-4843-b653-640881e6ac91 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.563364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67906-0563-4843-b653-640881e6ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.572598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009fc0c-d061-4a10-9fa2-6baf95cbda66 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.577647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.578542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.578969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.579256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] PATH_INFO: `/v3/projects/4512444c655049cca23b69ed11b19d97/users/d375f4198a8641429b7a588bb39321a4/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.589750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bab67906-0563-4843-b653-640881e6ac91 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:14.589750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bab67906-0563-4843-b653-640881e6ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.594093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.597774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4512444c655049cca23b69ed11b19d97, user_id=d375f4198a8641429b7a588bb39321a4, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.601553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.602506 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 983/1960] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:14.603256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67906-0563-4843-b653-640881e6ac91 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.615648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67906-0563-4843-b653-640881e6ac91 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.628907 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 978/1961] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:14 2022] PUT /identity/v3/projects/4512444c655049cca23b69ed11b19d97/users/d375f4198a8641429b7a588bb39321a4/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:14.629966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.696453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.697242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.697533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.697864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.698824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.701484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.716778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988935a4-aa29-45d1-b112-ff3916c08b6d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.725715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.726955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.727247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.727533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.728456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:14.728774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.730982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46677a-ce5b-4de8-b82e-4200b92d9596 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.741358 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 984/1962] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:14.741358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.750122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 979/1963] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:14.753391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821538e3-0f3b-41f8-9495-856a9df2fefd None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.753702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821538e3-0f3b-41f8-9495-856a9df2fefd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.754260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821538e3-0f3b-41f8-9495-856a9df2fefd None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.755722 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 980/1964] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:14.756450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821538e3-0f3b-41f8-9495-856a9df2fefd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.815752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4d549-3a0b-441f-a64e-45f2b52fc26c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.822930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.823646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.823938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.824200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.825044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.826822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.836063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821538e3-0f3b-41f8-9495-856a9df2fefd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.838202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 985/1965] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:14.839452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.843705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.845143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.845609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.846141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.846843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.848949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.850077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc43c4-ea9f-47fa-83cb-b49b24764cf2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.855427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.856090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.856353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.856663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.857348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.859583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.871464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.876211 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 981/1966] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:14.876211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:14.878750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.898685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 986/1967] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:14 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:14.900219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.963133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:14.964723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:14.968330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db396-2544-4bdb-a44c-53c5ab8e9840 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:14.973217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:14.974138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:14.974418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:14.974719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] PATH_INFO: `/v3/projects/4512444c655049cca23b69ed11b19d97/users/d375f4198a8641429b7a588bb39321a4/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:14.975843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:14.977027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4512444c655049cca23b69ed11b19d97, user_id=d375f4198a8641429b7a588bb39321a4, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:14.980375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:14.993244 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 987/1968] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:14 2022] PUT /identity/v3/projects/4512444c655049cca23b69ed11b19d97/users/d375f4198a8641429b7a588bb39321a4/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:15.002440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.043537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d008-1a76-4ba0-84e8-90ff07e2d8bd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.075452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0c165-c025-4d69-877f-e9130e006429 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.080313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.081026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.081313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.081596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.082325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.084101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.095031 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 988/1969] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:15.095845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.106128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ecdca15957494abb92bfe30a030fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77fec7e28f1495b8207391a39352008', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.106626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366be1c-7772-412f-bdd3-b443d5dd6280 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.107025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.107312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.107684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] PATH_INFO: `/v3/projects/1694d79cb0c646a39fa29b96aaa15507` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.108925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorizing `identity:get_project(project_id=1694d79cb0c646a39fa29b96aaa15507)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.111015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbaf042-7ddc-4382-9def-0818b4d720dc tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.111780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.112574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.112948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.113108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 982/1970] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:14 2022] GET /identity/v3/projects/1694d79cb0c646a39fa29b96aaa15507 => generated 395 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:15.113350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.114245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.114487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6f5e-4197-4ee4-9a57-952cb3ead852 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.114780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6f5e-4197-4ee4-9a57-952cb3ead852 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.115070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6f5e-4197-4ee4-9a57-952cb3ead852 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.116473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.116595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 983/1971] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:15.117594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.117869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.118150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.155214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 989/1972] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:15.155214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.161684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] MFA Rules not processed for user `d375f4198a8641429b7a588bb39321a4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:15.162946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.165149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e2ac5-b4d2-490e-95d7-c895ae7706ac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.170984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.171743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.172097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.172474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.173395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.175323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee061dc-68ef-4455-967a-b018ee2f9152 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.189065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 990/1973] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:15.190378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.190668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.191196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.233364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:15.235358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.271342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 984/1974] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:15.272269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.280705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:15.283964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a6af-f24c-4414-ada0-b7188a4cde77 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.289736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.290423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.290712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.290970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.291702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.293601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.305423 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 985/1975] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:15.306310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.318358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab14b0-f3cf-4bbd-a02a-bdae8d506be5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.323682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.324253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 991/1976] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:15.324629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.324912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.325190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] PATH_INFO: `/v3/projects/3dbf3e761a474eba89b7f667f843b77e/users/aa7e2c4cd4bd4d739d7a9bdd541ebe1f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.325758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.327423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.342582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4f678-101a-45ea-9d8f-5085f5316624 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.343689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbf3e761a474eba89b7f667f843b77e, user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.346388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.350464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.351443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.351728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.352347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] PATH_INFO: `/v3/users/09de5e17cfef4914ad400fade6819a73` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.354000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09de5e17cfef4914ad400fade6819a73)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.356090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.362152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 986/1977] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:15 2022] PUT /identity/v3/projects/3dbf3e761a474eba89b7f667f843b77e/users/aa7e2c4cd4bd4d739d7a9bdd541ebe1f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:15.363264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.389597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:15.420755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09de5e17cfef4914ad400fade6819a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:15.429781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09de5e17cfef4914ad400fade6819a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:15.445848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09de5e17cfef4914ad400fade6819a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:15.446785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09de5e17cfef4914ad400fade6819a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:15.447831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09de5e17cfef4914ad400fade6819a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:15.462755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 992/1978] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:15 2022] DELETE /identity/v3/users/09de5e17cfef4914ad400fade6819a73 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:15.463415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5b07-8a29-45cf-978d-2f93db329ad3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.463819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.465526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.526404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.527136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.527427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.527706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.529490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962925e-a53f-452b-8d75-3f80c47f53d2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.529625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.534768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.535453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.535738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.536544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.537277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.538907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9121-d7ca-43be-a489-8f8fd82fb4b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.548842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 993/1979] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:15.550051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471a15-1811-462f-ac8e-e7bbbccb127a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.550342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471a15-1811-462f-ac8e-e7bbbccb127a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.550621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471a15-1811-462f-ac8e-e7bbbccb127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.578551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e9471a15-1811-462f-ac8e-e7bbbccb127a None None] MFA Rules not processed for user `aa7e2c4cd4bd4d739d7a9bdd541ebe1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:15.579781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e9471a15-1811-462f-ac8e-e7bbbccb127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.592504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.594107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.603981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 987/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:15.604656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.605932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.607427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:15.621582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ea74-0c17-4883-b148-2b6c9bc8ad16 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.628261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.628953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.629241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.629520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.631349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.644620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.645555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.655186 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 994/1981] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:15.657312 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 988/1982] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:15.658840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.659190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.659527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.661437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.673454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180824e-9062-446f-be8d-c67c66186e5c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.679003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.679986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.680478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.680829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] PATH_INFO: `/v3/projects/abaaac986cdd4340a571f5947ae2bc4b/users/a065ef7954e1443c9f1ad37938407ef3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.681259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:15.682790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.702298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abaaac986cdd4340a571f5947ae2bc4b, user_id=a065ef7954e1443c9f1ad37938407ef3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.703741 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 995/1983] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:15.707197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.707725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.710079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.725572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b98ef-6f78-4bbc-981d-d369c4c4f80e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.740490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 989/1984] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:15 2022] PUT /identity/v3/projects/abaaac986cdd4340a571f5947ae2bc4b/users/a065ef7954e1443c9f1ad37938407ef3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:15.740490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.740490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.741696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:15.822412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44e10e-0402-4db4-a890-279df28b1f19 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:15.826390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.827104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.827398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.827682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.831005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:15.832008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.832338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.832707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.833423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.835614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.841495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:15.843080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fd0f3-e033-4b53-a057-b6babdbb9d35 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:15.866191 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 990/1985] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:15.868339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:15.869025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:15.869461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:15.888547 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 996/1986] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:15.890070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:15.922055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] MFA Rules not processed for user `a065ef7954e1443c9f1ad37938407ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:15.923297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:15.999385 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 991/1987] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:16.000334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.001841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.007879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00eb17-c5a9-4633-be42-b0b795fd8c42 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.014734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.015992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.016329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.016913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.017623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.020915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.060920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 997/1988] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:15 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:16.062619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.081700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3081-ee4a-44ca-bcdf-c2df2540233d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.088381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.089885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.089995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc15894-f120-4332-a16f-5a6a8fe3d809 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.090495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.091467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.093157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.096562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.099349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.100240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.100808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.101846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.103571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.133920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 998/1989] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:16 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:16.135387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.143645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.158893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.193506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.195417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.211507 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 992/1990] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:16.213132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.233618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ac740-bd75-42f7-bd38-169a99296cd9 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.256559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876553b-8f4d-4178-80c9-c8e2cad53a7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.262370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.263652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.264285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.264782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.265612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.267919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.286380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 999/1991] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:16.286380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.288576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.304122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27d27-ba47-4d2b-bed1-f83e45968021 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.311483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.313085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.313519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.313866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] PATH_INFO: `/v3/users/64cc8bb214134a639e032c2f3b90b525` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.315195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cc8bb214134a639e032c2f3b90b525)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.318220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.322358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.323094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.323708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.324471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.325424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.327756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.364414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 993/1992] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:16 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:16.364414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.375172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018468-b9df-4d98-9ce6-5f4aaff159bd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.380071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.381019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.381357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.381581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] PATH_INFO: `/v3/projects/29931cdc2f2e48c891453c79d2fceb56/users/3602791be0094112874d1c16cca92da8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.383562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cc8bb214134a639e032c2f3b90b525'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.393733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cc8bb214134a639e032c2f3b90b525'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.406825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29931cdc2f2e48c891453c79d2fceb56, user_id=3602791be0094112874d1c16cca92da8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.406988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cc8bb214134a639e032c2f3b90b525'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.407667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cc8bb214134a639e032c2f3b90b525'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.408379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cc8bb214134a639e032c2f3b90b525'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.410407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.423474 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1000/1993] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:16 2022] DELETE /identity/v3/users/64cc8bb214134a639e032c2f3b90b525 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.424194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.425780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.428514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 994/1994] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:16 2022] PUT /identity/v3/projects/29931cdc2f2e48c891453c79d2fceb56/users/3602791be0094112874d1c16cca92da8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.430197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.433000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.513583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e2087-bccb-4a68-95b4-e65a54df16c4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.516141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe864-5a86-4180-9a9d-3d429f0b1a0b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.518268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.518949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.519252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.519535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.520264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.521959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d16b9-2db3-4e3c-8766-f8c796839e23 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.522153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.523250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.523907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.524284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] PATH_INFO: `/v3/projects/1f39dd45affa48fa836488de7e0f501b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.528055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f39dd45affa48fa836488de7e0f501b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.530254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.535841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 995/1995] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:16.535841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.535841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.535841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.559330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:16.561458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.566118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.571536 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 996/1996] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:16.574397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.576949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.590256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953a8d-0451-40c8-af9a-eac429e5c4d7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.594312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f39dd45affa48fa836488de7e0f501b', 'request_id': 'req-2a98d3d3-54a6-4157-8293-d9e50f6c73de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.603831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f39dd45affa48fa836488de7e0f501b', 'request_id': 'req-2a98d3d3-54a6-4157-8293-d9e50f6c73de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.610252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f39dd45affa48fa836488de7e0f501b', 'request_id': 'req-2a98d3d3-54a6-4157-8293-d9e50f6c73de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.617952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.623174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] The token cache is being invalidate because project 1f39dd45affa48fa836488de7e0f501b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:16.623547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.624346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.628565 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1001/1997] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:16 2022] DELETE /identity/v3/projects/1f39dd45affa48fa836488de7e0f501b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.629626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.631670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.656140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.656864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.657158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.657425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.658154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.659766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.669607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 997/1998] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:16.670441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.672095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.712062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d3d3-54a6-4157-8293-d9e50f6c73de admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.717122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.718021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.718298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.718592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] PATH_INFO: `/v3/projects/463ce3f7f4264d358204b67a98e29516/users/27e7493af45e45ecb99d3f2d95bba258/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.729419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1535f-ca1c-4d9c-84f6-d9042fe76807 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.733181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ce3f7f4264d358204b67a98e29516, user_id=27e7493af45e45ecb99d3f2d95bba258, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.733388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.734065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.734325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.734621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.735873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.736569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.749698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.751132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.751283 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1002/1999] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:16 2022] PUT /identity/v3/projects/463ce3f7f4264d358204b67a98e29516/users/27e7493af45e45ecb99d3f2d95bba258/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.751952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.754130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.761580 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 998/2000] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:16.762408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.763759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.775808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb90669-5237-4d0a-8c12-6e41abb56119 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.841603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.842668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.842932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.843207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] PATH_INFO: `/v3/projects/29931cdc2f2e48c891453c79d2fceb56/users/3602791be0094112874d1c16cca92da8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.844003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9102-ef16-4c72-8aa2-116018049847 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.845921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29931cdc2f2e48c891453c79d2fceb56, user_id=3602791be0094112874d1c16cca92da8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.848446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.850203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.851158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.851503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.852157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] PATH_INFO: `/v3/users/43ecdca15957494abb92bfe30a030fe0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.853038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ecdca15957494abb92bfe30a030fe0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.855169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.860250 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 999/2001] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:16 2022] PUT /identity/v3/projects/29931cdc2f2e48c891453c79d2fceb56/users/3602791be0094112874d1c16cca92da8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.861132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.899591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.912749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ecdca15957494abb92bfe30a030fe0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.922300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ecdca15957494abb92bfe30a030fe0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.928610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04c018-d1d2-4255-bfc6-cb46088025a8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:16.933348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:16.934010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.934287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.934530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.935372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:16.936989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5026a7-5669-4dcc-903a-291c5bc6f6ae admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:16.938922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:16.953289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ecdca15957494abb92bfe30a030fe0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.954047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ecdca15957494abb92bfe30a030fe0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.954921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ecdca15957494abb92bfe30a030fe0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:16.958479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1000/2002] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:16.959474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:16.959776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:16.960053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:16.971650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1003/2003] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:16 2022] DELETE /identity/v3/users/43ecdca15957494abb92bfe30a030fe0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:16.972668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:16.974337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:16.991068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] MFA Rules not processed for user `3602791be0094112874d1c16cca92da8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:16.992238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.049231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6df5e-424b-4feb-ad75-a19f25fb2e1a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.055280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.056254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.056621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.057075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] PATH_INFO: `/v3/projects/463ce3f7f4264d358204b67a98e29516/users/27e7493af45e45ecb99d3f2d95bba258/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.059813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ce3f7f4264d358204b67a98e29516, user_id=27e7493af45e45ecb99d3f2d95bba258, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.062814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898eb2-309d-471b-9aee-44532bf67215 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.076919 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1004/2004] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:16 2022] PUT /identity/v3/projects/463ce3f7f4264d358204b67a98e29516/users/27e7493af45e45ecb99d3f2d95bba258/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:17.090441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.090734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.091017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.095391 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1001/2005] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:17.096377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.098314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.118333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004acfc-dde8-414e-ac1b-f7414d642d4c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.125057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] MFA Rules not processed for user `27e7493af45e45ecb99d3f2d95bba258`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:17.126434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.185370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.186371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.186732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.187014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] PATH_INFO: `/v3/projects/06e70855762d488086f9750692f43408` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.188578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e70855762d488086f9750692f43408)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.190628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.214597 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1005/2006] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:17.215542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.217308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.250637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e70855762d488086f9750692f43408', 'request_id': 'req-727444c5-1878-4e21-8c52-c0bc6dc62a94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.259105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e70855762d488086f9750692f43408', 'request_id': 'req-727444c5-1878-4e21-8c52-c0bc6dc62a94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.261616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:17.268417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e70855762d488086f9750692f43408', 'request_id': 'req-727444c5-1878-4e21-8c52-c0bc6dc62a94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.282811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] The token cache is being invalidate because project 06e70855762d488086f9750692f43408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:17.283351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.283808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.285476 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1002/2007] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:17 2022] DELETE /identity/v3/projects/06e70855762d488086f9750692f43408 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:17.286239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.287599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.302974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:17.311355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a453a-2171-4d54-be3e-17f16ad21bb4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.369566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727444c5-1878-4e21-8c52-c0bc6dc62a94 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.374453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.375137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.375425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.375712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.376664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:17.376984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.378610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.379494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.380156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.380463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.380744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.382574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.390563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1003/2008] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:17.391483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.393250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.447653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.449419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.459350 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1006/2009] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:17.460282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.461717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.462341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ed1-0641-4423-a495-6afee1f869b5 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.467420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.468309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.468636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.468917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] PATH_INFO: `/v3/users/d375f4198a8641429b7a588bb39321a4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.470115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d375f4198a8641429b7a588bb39321a4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.472062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.475440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517279e1-9893-40b2-876b-15aa7ae0930d service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.480504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.481387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.481864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.482136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] PATH_INFO: `/v3/projects/f77fec7e28f1495b8207391a39352008` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.487225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77fec7e28f1495b8207391a39352008)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.489206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.536020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd375f4198a8641429b7a588bb39321a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.536750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd375f4198a8641429b7a588bb39321a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.551755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd375f4198a8641429b7a588bb39321a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.558825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77fec7e28f1495b8207391a39352008', 'request_id': 'req-a0c2e2fb-d454-44b2-9d83-d29494166d5f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.571304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd375f4198a8641429b7a588bb39321a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.571474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77fec7e28f1495b8207391a39352008', 'request_id': 'req-a0c2e2fb-d454-44b2-9d83-d29494166d5f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.575330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:17.582837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd375f4198a8641429b7a588bb39321a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.587929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77fec7e28f1495b8207391a39352008', 'request_id': 'req-a0c2e2fb-d454-44b2-9d83-d29494166d5f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.590406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1004/2010] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:17 2022] DELETE /identity/v3/users/d375f4198a8641429b7a588bb39321a4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:17.591308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.592995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.611497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] The token cache is being invalidate because project f77fec7e28f1495b8207391a39352008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:17.611759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.612884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:17.615296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1007/2011] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:17 2022] DELETE /identity/v3/projects/f77fec7e28f1495b8207391a39352008 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:17.619611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.622281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.659858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:17.753074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89c2c-0529-4d0f-9385-a4eee2b1ade7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.760279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.761133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.761298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.761579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.762293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.764556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.777773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2e2fb-d454-44b2-9d83-d29494166d5f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.841903 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1005/2012] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:17.847391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:17.849899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:17.904391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.905378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.905661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.905937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] PATH_INFO: `/v3/users/a0297a17b4924d71b358f021b88af6cc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.907207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0297a17b4924d71b358f021b88af6cc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.909235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:17.958876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490cb07-edce-43b3-bdf3-272ddd88f025 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:17.979798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:17.980864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:17.981246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:17.981937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:17.982824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:17.983956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:17.987689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.014071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1006/2013] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:18.014473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0297a17b4924d71b358f021b88af6cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.025740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.028693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.029357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0297a17b4924d71b358f021b88af6cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.056904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0297a17b4924d71b358f021b88af6cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.057675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0297a17b4924d71b358f021b88af6cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.058365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0297a17b4924d71b358f021b88af6cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.080178 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1008/2014] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:17 2022] DELETE /identity/v3/users/a0297a17b4924d71b358f021b88af6cc => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:18.081218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.099182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.141381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:18.206750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568ddb5-94ff-4059-9c49-bea0e39fabae tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.219559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6660a-f2b5-4254-8099-0346a0339eb3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.225529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.226728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.227113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.228345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] PATH_INFO: `/v3/projects/4512444c655049cca23b69ed11b19d97` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.231254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4512444c655049cca23b69ed11b19d97)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.236922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.261456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:18.300297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4512444c655049cca23b69ed11b19d97', 'request_id': 'req-e9001aef-dc5e-4284-9c46-a7a03f2c278a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.312274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4512444c655049cca23b69ed11b19d97', 'request_id': 'req-e9001aef-dc5e-4284-9c46-a7a03f2c278a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.315752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.316911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.317198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.317472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.319507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.320232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4512444c655049cca23b69ed11b19d97', 'request_id': 'req-e9001aef-dc5e-4284-9c46-a7a03f2c278a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.332163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] The token cache is being invalidate because project 4512444c655049cca23b69ed11b19d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:18.332750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.333778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.335171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1009/2015] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:18 2022] DELETE /identity/v3/projects/4512444c655049cca23b69ed11b19d97 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:18.335786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.337190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.394939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.396601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d340ae-18c5-43ae-b499-ce2a8d20c96f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.407172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1007/2016] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:18.410209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caae40-8778-4d47-b0ed-276f719d9a0a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.410658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caae40-8778-4d47-b0ed-276f719d9a0a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.411035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caae40-8778-4d47-b0ed-276f719d9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.413894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9001aef-dc5e-4284-9c46-a7a03f2c278a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.419807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.421123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.421508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.421885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] PATH_INFO: `/v3/users/aa7e2c4cd4bd4d739d7a9bdd541ebe1f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.423713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.425802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.435374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e8caae40-8778-4d47-b0ed-276f719d9a0a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:18.436836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e8caae40-8778-4d47-b0ed-276f719d9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.445286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1008/2017] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:18.446647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3fa5-57eb-4d84-85bb-b701b58337f2 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.446937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3fa5-57eb-4d84-85bb-b701b58337f2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.447204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3fa5-57eb-4d84-85bb-b701b58337f2 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.448637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1009/2018] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:18.452835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.453519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.453519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.474991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:18.476338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.485526 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1010/2019] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:18.486185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:18.487595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.492176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:18.495364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7e2c4cd4bd4d739d7a9bdd541ebe1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.507494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7e2c4cd4bd4d739d7a9bdd541ebe1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.525467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7e2c4cd4bd4d739d7a9bdd541ebe1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.526347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7e2c4cd4bd4d739d7a9bdd541ebe1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.526899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7e2c4cd4bd4d739d7a9bdd541ebe1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.543776 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1010/2020] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:18 2022] DELETE /identity/v3/users/aa7e2c4cd4bd4d739d7a9bdd541ebe1f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:18.547484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.548888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.577273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.578869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.641573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487cd0a-632e-4b6d-b7a2-27372d0d3bbd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.646500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.647180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.647467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.647796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.648561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:18.648873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.650514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db70d6-bfe3-4cc0-8af2-0c83c9e862ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.652405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:18.659517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a2ee2-99f4-432c-8ee5-bd21986059fc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.663591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1011/2021] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:18.664964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.665254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.665534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.683864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:18.685159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.693213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1012/2022] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:18.693989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.695224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.707437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0273f9-8c9b-481e-8d0f-bf528157760c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.712544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.713538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.713821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.714464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] PATH_INFO: `/v3/projects/1694d79cb0c646a39fa29b96aaa15507` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.715665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1694d79cb0c646a39fa29b96aaa15507)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.717667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.721411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.725236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.725854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.726033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects/270bbdc5d9264af796c0c5e4dd999d97` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.727273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:get_project(project_id=270bbdc5d9264af796c0c5e4dd999d97)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.729612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.731564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1011/2023] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:18 2022] GET /identity/v3/projects/270bbdc5d9264af796c0c5e4dd999d97 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:18.732338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.747146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55fca-d62d-4f79-bfa9-5e8f5f5d3b03 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.758873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.759856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.760209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.760605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.762182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.764572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.776210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1694d79cb0c646a39fa29b96aaa15507', 'request_id': 'req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.790181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1694d79cb0c646a39fa29b96aaa15507', 'request_id': 'req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.797175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1694d79cb0c646a39fa29b96aaa15507', 'request_id': 'req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.806371 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1012/2024] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/projects => generated 401 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:18.807675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.814577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.820463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] The token cache is being invalidate because project 1694d79cb0c646a39fa29b96aaa15507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:18.820463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.820463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:18.820463 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1013/2025] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:18 2022] DELETE /identity/v3/projects/1694d79cb0c646a39fa29b96aaa15507 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:18.820463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:18.824486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.870888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:18.895391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dd442-d86b-4735-86b4-dfb507af16dd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.899971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.900671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.900953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.901226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.903155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:18.909389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11afa37-6ab6-4a6f-8944-3fdc22cf4ab2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:18.973172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:18.973409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.973877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.974168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.974451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:18.975147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f5ba-051d-42c0-ac92-14f4203b9a52 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.975388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:18.977598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778a97f-ecba-4d67-b7ff-2bf91b8f79b4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:18.985845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1013/2026] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:18.986940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942570db-4280-41e3-9028-f5888084e245 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:18.987296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942570db-4280-41e3-9028-f5888084e245 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:18.987644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942570db-4280-41e3-9028-f5888084e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.012003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-942570db-4280-41e3-9028-f5888084e245 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:19.012003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-942570db-4280-41e3-9028-f5888084e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.012920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1014/2027] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.015362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.016160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.016614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.020345 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1014/2028] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:19.021364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942570db-4280-41e3-9028-f5888084e245 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.022617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1015/2029] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:19.023690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:19.029063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.033883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942570db-4280-41e3-9028-f5888084e245 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.039553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.040284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.040612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.040829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.041550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.043180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6c95-19e6-4a00-a366-a3e8876a4287 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.053646 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1015/2030] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:19.053646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.053646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.053646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.085881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:19.087631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.103505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1016/2031] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:19.103505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.115567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0ca95-4538-4ee2-9e38-edfce7f5b00d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.116796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.118245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.121633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.122446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.122730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.123044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.123854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.125958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.128817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:19.139789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1017/2032] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:19.140663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.152313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f84a-0eb1-42a0-9c84-3804ad490b8d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.158156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.158946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.159289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.159611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.160476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:19.160794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.162906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.178618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1018/2033] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:19.178618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.202683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8e99f-7e4c-4fe7-89f2-fc2fe5a2e51d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.207779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.208766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.208995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.209326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] PATH_INFO: `/v3/projects/4cf1f66dab46465daf6c81a57afd7da5/users/ced78e43dd604b00bc99b64ebfbbffa0/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.223839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767907f-b49c-4ebf-9625-ca421369648e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.229815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.230185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf1f66dab46465daf6c81a57afd7da5, user_id=ced78e43dd604b00bc99b64ebfbbffa0, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.230855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.231217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.231586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects/270bbdc5d9264af796c0c5e4dd999d97` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.233095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:get_project(project_id=270bbdc5d9264af796c0c5e4dd999d97)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.233523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886df2e-76df-4c7e-817a-711fb4a541bc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.235691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.238088 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1016/2034] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/projects/270bbdc5d9264af796c0c5e4dd999d97 => generated 371 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:19.241545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.275001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1019/2035] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:19 2022] PUT /identity/v3/projects/4cf1f66dab46465daf6c81a57afd7da5/users/ced78e43dd604b00bc99b64ebfbbffa0/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:19.284926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0bc98-6fe7-4896-aa3f-e5b1c6b95ae8 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.289713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:19.290886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.291170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.291598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.332722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] MFA Rules not processed for user `ced78e43dd604b00bc99b64ebfbbffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:19.334103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.421968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.423038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.423302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.423663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.425581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.428791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.431202 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1020/2036] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:19.432242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.482140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1017/2037] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/projects => generated 403 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.483250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.539879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27dcb5-4d27-4a0d-bb51-1bf614fbc22d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.599748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c0e88-0357-4353-b7fe-2bf04fe24f39 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.607676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.607990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.608378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.608814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.609627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.611760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.629805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:19.637582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.638640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.639361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.639779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.640737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:19.641370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.645892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1018/2038] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/projects => generated 401 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.646036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.646127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.659177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1021/2039] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:19.659177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.661475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.675445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc588be-73e9-4d8d-b879-790fcebcf306 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.723511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424ab3-58c5-4170-820a-36b59dd83e02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.729328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.730015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.730406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.730754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.731540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.733663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.737540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.738701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.739154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.739573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] PATH_INFO: `/v3/projects/3dbf3e761a474eba89b7f667f843b77e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.741296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbf3e761a474eba89b7f667f843b77e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.744936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.759731 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1019/2040] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.760672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.770905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9382b1-39b3-483a-a07e-40ca11fea58a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.776039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.776844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.777199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.777540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.778418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.780525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.788487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:19.808614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1020/2041] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/users => generated 307 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.808614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.809561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbf3e761a474eba89b7f667f843b77e', 'request_id': 'req-9691f19b-1e24-4b27-aed2-3609616bafc3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:19.820678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbf3e761a474eba89b7f667f843b77e', 'request_id': 'req-9691f19b-1e24-4b27-aed2-3609616bafc3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:19.827980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbf3e761a474eba89b7f667f843b77e', 'request_id': 'req-9691f19b-1e24-4b27-aed2-3609616bafc3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:19.839971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] The token cache is being invalidate because project 3dbf3e761a474eba89b7f667f843b77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:19.840395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:19.841186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:19.842906 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1022/2042] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:19 2022] DELETE /identity/v3/projects/3dbf3e761a474eba89b7f667f843b77e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:19.843832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.845236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.875178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2d166-191c-4239-b404-a483012f3e8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.909933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f19b-1e24-4b27-aed2-3609616bafc3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.914797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.915512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.915792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.916098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.916816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.918402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.929315 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1023/2043] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:19.929966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.931583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.937213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.937902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.938186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.938483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.939175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.941155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.944079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500c50-cc19-4e7f-a67e-ccfeb1e238e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.950334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.951515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.951815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.952100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.953298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.955414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.962551 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1021/2044] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:19 2022] POST /identity/v3/users => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:19.963374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.965433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:19.969960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1024/2045] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:19.969960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:19.979436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3642-df1c-4bd7-b6d8-fe6845dda3ea tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.979730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c825b8-8dce-4782-aaa8-85da5df02833 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:19.984752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.985625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:19.985871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.986197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.986471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] PATH_INFO: `/v3/users/3602791be0094112874d1c16cca92da8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.986656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:19.986871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:19.987136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:19.987726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3602791be0094112874d1c16cca92da8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.987846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:19.989479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.989700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:19.991225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.004118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1025/2046] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:20.006585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.010708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.025072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8fc-37c8-49ad-ab0e-12726d57efc7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.029565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.030238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.030529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.030799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.031560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:20.031870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.033550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.043975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3602791be0094112874d1c16cca92da8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.046316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1026/2047] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:20.047175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.057004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3602791be0094112874d1c16cca92da8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.058385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba30cc-05b7-4487-8a76-c03c5b54aeaf tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.063675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.064644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.064925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.065209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] PATH_INFO: `/v3/projects/674e8e36cac34029a6970552d1fbfb44/users/77f4ea9b80454b439c0fc86e192982f3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.071633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3602791be0094112874d1c16cca92da8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.072387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3602791be0094112874d1c16cca92da8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.073061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3602791be0094112874d1c16cca92da8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.081091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=7,keystone:SELECT=83,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.082101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674e8e36cac34029a6970552d1fbfb44, user_id=77f4ea9b80454b439c0fc86e192982f3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.084821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32944d46-0a23-457f-84f4-60c279a87928 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.088602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1022/2048] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:19 2022] DELETE /identity/v3/users/3602791be0094112874d1c16cca92da8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:20.093327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.095239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.099445 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1027/2049] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:20 2022] PUT /identity/v3/projects/674e8e36cac34029a6970552d1fbfb44/users/77f4ea9b80454b439c0fc86e192982f3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:20.101046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.101885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.101885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.103833 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1028/2050] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:20.104592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.106303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.177129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26470a-94e0-455e-9860-0cd8cb85d030 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.182257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.183153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.183431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.183868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] PATH_INFO: `/v3/projects/0cada0f9d2ac4114b58afc2eb10f5f74/users/7c9cc1eb5b0f4a618fefd91189a73c11/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.188122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a81d-9a7c-4e4b-9442-f419fd373be4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.193739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.194460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.194746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.195027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.195767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.197966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.201743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cada0f9d2ac4114b58afc2eb10f5f74, user_id=7c9cc1eb5b0f4a618fefd91189a73c11, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.205023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.211956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1029/2051] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:20.211956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:20.215175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.227278 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1023/2052] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:20 2022] PUT /identity/v3/projects/0cada0f9d2ac4114b58afc2eb10f5f74/users/7c9cc1eb5b0f4a618fefd91189a73c11/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:20.228139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.308819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362354d-c1d4-440b-9268-f7f69a843424 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.314518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.316545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.316545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.316545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] PATH_INFO: `/v3/projects/674e8e36cac34029a6970552d1fbfb44/users/77f4ea9b80454b439c0fc86e192982f3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.318918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=674e8e36cac34029a6970552d1fbfb44, user_id=77f4ea9b80454b439c0fc86e192982f3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.321357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.321475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39678c-d1bb-4343-95b8-fa16eb00e43a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.322690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.333228 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1024/2053] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:20 2022] PUT /identity/v3/projects/674e8e36cac34029a6970552d1fbfb44/users/77f4ea9b80454b439c0fc86e192982f3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:20.334635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c21e4-7adf-4bea-a5fd-8974a0547d0d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.334925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c21e4-7adf-4bea-a5fd-8974a0547d0d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.335199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c21e4-7adf-4bea-a5fd-8974a0547d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.359811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a71c21e4-7adf-4bea-a5fd-8974a0547d0d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:20.361080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a71c21e4-7adf-4bea-a5fd-8974a0547d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.394888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.412847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d68b9-471e-4b83-97aa-0f0f2535cc10 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.440578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1025/2054] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:20.445984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.446446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.446933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.475774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] MFA Rules not processed for user `77f4ea9b80454b439c0fc86e192982f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:20.477202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.481905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.490123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.491234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.491641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.492076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects/270bbdc5d9264af796c0c5e4dd999d97` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.493357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:get_project(project_id=270bbdc5d9264af796c0c5e4dd999d97)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.495513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.497295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1030/2055] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/projects/270bbdc5d9264af796c0c5e4dd999d97 => generated 371 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:20.498119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.499796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.522773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9097-600b-49a2-8436-a36a7687770d tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.536932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.539888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.541056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.541463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] PATH_INFO: `/v3/projects/29931cdc2f2e48c891453c79d2fceb56` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.544496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29931cdc2f2e48c891453c79d2fceb56)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.549899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.582818 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1026/2056] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:20.583685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.591826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.635653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29931cdc2f2e48c891453c79d2fceb56', 'request_id': 'req-359981eb-1934-4d2b-b57a-cb77948c7e56'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.648224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29931cdc2f2e48c891453c79d2fceb56', 'request_id': 'req-359981eb-1934-4d2b-b57a-cb77948c7e56'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.657452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29931cdc2f2e48c891453c79d2fceb56', 'request_id': 'req-359981eb-1934-4d2b-b57a-cb77948c7e56'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.671928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] The token cache is being invalidate because project 29931cdc2f2e48c891453c79d2fceb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:20.672262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265c3b-a573-4524-a696-b76d7aba898a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.672372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.673008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:20.674733 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1031/2057] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:20 2022] DELETE /identity/v3/projects/29931cdc2f2e48c891453c79d2fceb56 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:20.675496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.679152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.735827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.736696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.737085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.737483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.739537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.773932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359981eb-1934-4d2b-b57a-cb77948c7e56 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.780832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.781520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.781807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.782089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.783893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.804624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.814092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.820986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968000e-1cc9-4ead-abe4-85eff200bbcb service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.826266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1027/2058] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:20.827570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5f61-99e3-4ee7-9cfc-6dd47ee1e679 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.827859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5f61-99e3-4ee7-9cfc-6dd47ee1e679 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.828135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c5f61-99e3-4ee7-9cfc-6dd47ee1e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.841824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.850166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d74c5f61-99e3-4ee7-9cfc-6dd47ee1e679 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:20.851619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d74c5f61-99e3-4ee7-9cfc-6dd47ee1e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.864169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.865835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.867260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1028/2059] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:20.869533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839f4e-b5a6-4b11-a57e-4ceed6190ed2 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.870157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839f4e-b5a6-4b11-a57e-4ceed6190ed2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.870549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839f4e-b5a6-4b11-a57e-4ceed6190ed2 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.875582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1029/2060] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:20.875582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.875582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.875582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.881047 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1032/2061] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:20.881815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:52:20.883139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.899126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.900864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.906222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:20.907759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.918551 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1030/2062] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:20.926203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.939393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac7bf-f589-40f5-8b19-7d7fa82ae96a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.946529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.947395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.947785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.948998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.949833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:20.950307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.952213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:20.965414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1031/2063] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:20.966291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:20.979482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0f08-2315-409c-a11f-647232519298 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.985899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3096-af47-4ea8-b149-ff8057de796c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:20.988858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.989525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.989893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.990277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.991485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:20.992220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:20.992626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:20.993566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:20.993566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects/270bbdc5d9264af796c0c5e4dd999d97` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:20.995541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:get_project(project_id=270bbdc5d9264af796c0c5e4dd999d97)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:20.998896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.009720 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1033/2064] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/projects/270bbdc5d9264af796c0c5e4dd999d97 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:21.010913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.037613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405637e9-1690-452a-9e70-9a32e9bc6add tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.045278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.046487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.046971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.047525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.048997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.053311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.099123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.100748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.105209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1034/2065] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:21 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:21.106179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.117380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1032/2066] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:21.118373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.131325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04833-5850-468a-8969-deeaf1f0629c service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.186459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060312a2-eb83-4452-8434-5811273ddeb7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.192755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.193811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.194107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.194426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/users/c8b24bdf086246e8b2a359bfd2f004b2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.215129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c8b24bdf086246e8b2a359bfd2f004b2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.218128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.253817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:21.257249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.258059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.258278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.267307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.268154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.270276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.291466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b24bdf086246e8b2a359bfd2f004b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.292191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b24bdf086246e8b2a359bfd2f004b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.305217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b24bdf086246e8b2a359bfd2f004b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.324994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1033/2067] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:21 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:21.329044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.329218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b24bdf086246e8b2a359bfd2f004b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.330788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.340911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b24bdf086246e8b2a359bfd2f004b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.357349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1035/2068] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:21 2022] DELETE /identity/v3/users/c8b24bdf086246e8b2a359bfd2f004b2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:21.358975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.360876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.361457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52737c9f-c4f7-49a6-831e-626df065b8f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.483179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.485020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.485305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.485580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.486325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.490153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.502497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a51f0-d42e-4104-8a0c-2286153bd5a0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.508401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:21.512739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1034/2069] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:52:21.513688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e7493af45e45ecb99d3f2d95bba258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463ce3f7f4264d358204b67a98e29516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.515327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.515834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.515940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] PATH_INFO: `/v3/projects/270bbdc5d9264af796c0c5e4dd999d97` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.517412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.519246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorizing `identity:delete_project(project_id=270bbdc5d9264af796c0c5e4dd999d97)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.523991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.543191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670a2ff-7293-4b67-a23f-edf20ac3a9cf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.548151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.548985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.549151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.549482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.550219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.551988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.568736 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1035/2070] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:21.573387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.590035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49dc83-a99e-44ab-9c2b-21af8a0151c7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.597495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.598697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.599230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.599704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] PATH_INFO: `/v3/projects/6a2d8b5c82f44807b9d01252ea17cff9/users/39e82edaa30d418d96ea37f942d62755/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.638196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2d8b5c82f44807b9d01252ea17cff9, user_id=39e82edaa30d418d96ea37f942d62755, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.641491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1aa6c-dd64-4428-b955-ea59a7c363ce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.645048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270bbdc5d9264af796c0c5e4dd999d97', 'request_id': 'req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.663898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270bbdc5d9264af796c0c5e4dd999d97', 'request_id': 'req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.670161 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1036/2071] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:21 2022] PUT /identity/v3/projects/6a2d8b5c82f44807b9d01252ea17cff9/users/39e82edaa30d418d96ea37f942d62755/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:21.671441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270bbdc5d9264af796c0c5e4dd999d97', 'request_id': 'req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.672947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.673680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.674504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.697507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] The token cache is being invalidate because project 270bbdc5d9264af796c0c5e4dd999d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:21.697806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.702320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.708154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1036/2072] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:21 2022] DELETE /identity/v3/projects/270bbdc5d9264af796c0c5e4dd999d97 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:21.708304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:21.708304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.709691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.711190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.776829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:21.815810 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1037/2073] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:21.832368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83dba-0e94-4d5e-bc34-fd399bf5ec0f tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.835094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.836980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.846614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.846614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.846614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.846614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] PATH_INFO: `/v3/users/a065ef7954e1443c9f1ad37938407ef3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.847113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a065ef7954e1443c9f1ad37938407ef3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.847113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.939169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f905ab-d0ca-4d9e-b9e7-97490eef0cb1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:21.943146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a065ef7954e1443c9f1ad37938407ef3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.944778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a065ef7954e1443c9f1ad37938407ef3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.949454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:21.952732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:21.952732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:21.952732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:21.954926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:21.960952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a065ef7954e1443c9f1ad37938407ef3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.981076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:21.982785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:21.983444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a065ef7954e1443c9f1ad37938407ef3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:21.997032 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1038/2074] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:21.998109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:21.999595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.012361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de1542c-13df-449b-af5f-c9fd4ed8a932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a065ef7954e1443c9f1ad37938407ef3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.032787 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1037/2075] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:21 2022] DELETE /identity/v3/users/a065ef7954e1443c9f1ad37938407ef3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:22.037488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:22.038217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:22.038674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:22.074024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:22.075769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.143958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213245-8790-4a35-9dc7-b5e08f7a74c2 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:22.162677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:22.190715 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1038/2076] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:22.206778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:22.209174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.327099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:22.331059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:22.331346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:22.331627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:22.338582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.357754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:22.365296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a149-4ee2-4e35-a47e-65c97acaab52 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:22.397499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:22.399661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:22.403795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:22.404868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:22.445037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:22.447441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:22.476312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:22.478737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a868ac-03ca-4001-b17e-d4b390a1c139 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:22.490692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1039/2077] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:22.506554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1039/2078] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:22.542832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:22.545298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.566423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd416d-fd94-457c-a7d5-b9722bd1ac3d service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:22.578464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:22.580752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:22.581347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:22.582678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] PATH_INFO: `/v3/users/ced78e43dd604b00bc99b64ebfbbffa0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:22.585238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced78e43dd604b00bc99b64ebfbbffa0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:22.588776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:22.671423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced78e43dd604b00bc99b64ebfbbffa0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.672584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced78e43dd604b00bc99b64ebfbbffa0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.687264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced78e43dd604b00bc99b64ebfbbffa0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.706802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced78e43dd604b00bc99b64ebfbbffa0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.719146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced78e43dd604b00bc99b64ebfbbffa0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:22.730258 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1040/2079] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:22 2022] DELETE /identity/v3/users/ced78e43dd604b00bc99b64ebfbbffa0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:22.734974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:22.735471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:22.735904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:22.791811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:22.793147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.965688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:22.968660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:22.981916 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1040/2080] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:22.994111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3399-f692-480e-a567-d862c470b3e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:23.004159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:23.005881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:23.006197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:23.007231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:23.007355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:23.007760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] PATH_INFO: `/v3/projects/abaaac986cdd4340a571f5947ae2bc4b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:23.009770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abaaac986cdd4340a571f5947ae2bc4b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:23.012044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:23.100720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:23.125209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961089-2cd3-4bb7-95f0-1981b83dc40a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:23.139481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abaaac986cdd4340a571f5947ae2bc4b', 'request_id': 'req-c1361554-299d-47bc-a2f4-eed8eaf3d400'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.165665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abaaac986cdd4340a571f5947ae2bc4b', 'request_id': 'req-c1361554-299d-47bc-a2f4-eed8eaf3d400'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.175426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abaaac986cdd4340a571f5947ae2bc4b', 'request_id': 'req-c1361554-299d-47bc-a2f4-eed8eaf3d400'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.193208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] The token cache is being invalidate because project abaaac986cdd4340a571f5947ae2bc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:23.193507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.195154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.197118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1041/2081] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:22 2022] DELETE /identity/v3/projects/abaaac986cdd4340a571f5947ae2bc4b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:23.200838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:23.202232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:23.222483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:23.223177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:23.223468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:23.224261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:23.229472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:23.291061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:23.315250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:23.317496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459ab0-5a3e-42c6-bb04-d7711974eaf4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:23.330599 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1041/2082] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:23.343114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1361554-299d-47bc-a2f4-eed8eaf3d400 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:23.348065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:23.349046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:23.349727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:23.350044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] PATH_INFO: `/v3/users/27e7493af45e45ecb99d3f2d95bba258` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:23.351310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e7493af45e45ecb99d3f2d95bba258)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:23.354805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:23.481410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e7493af45e45ecb99d3f2d95bba258'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.482200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e7493af45e45ecb99d3f2d95bba258'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.499822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e7493af45e45ecb99d3f2d95bba258'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.537122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e7493af45e45ecb99d3f2d95bba258'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.549521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-baabf5b6-04ae-45c4-bf62-fb2d930cbdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e7493af45e45ecb99d3f2d95bba258'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:23.558465 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1042/2083] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:23 2022] DELETE /identity/v3/users/27e7493af45e45ecb99d3f2d95bba258 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:24.069570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:24.070088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:24.070181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:24.072053 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1042/2084] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:52:24.079352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:24.079912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:24.081163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:24.154788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:24.156327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:24.342021 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1043/2085] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:24.370919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:24.375383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:24.408037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c05d-22d8-40d9-9f38-b52bc55ece7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:24.414949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:24.415725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:24.416077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:24.416451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:24.436359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:24.441958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:24.473563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1043/2086] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:25.165928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:25.168656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:25.241046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:25.250886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:25.254403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:25.362032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e922c1-91f0-45ff-98ee-e93fa3cfbe9f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:25.376061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:25.377685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.377685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.377685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] PATH_INFO: `/v3/projects/463ce3f7f4264d358204b67a98e29516` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.388646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463ce3f7f4264d358204b67a98e29516)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:25.389143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f4f9-7610-4daf-ad00-384d01ab32a9 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:25.391447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:25.415636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:25.416950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.417452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.417908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] PATH_INFO: `/v3/projects/4cf1f66dab46465daf6c81a57afd7da5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.419523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf1f66dab46465daf6c81a57afd7da5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:25.435115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:25.505706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463ce3f7f4264d358204b67a98e29516', 'request_id': 'req-1be6f547-673c-4723-a2eb-a006b41b4588'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.523548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:25.531645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463ce3f7f4264d358204b67a98e29516', 'request_id': 'req-1be6f547-673c-4723-a2eb-a006b41b4588'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.531978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf1f66dab46465daf6c81a57afd7da5', 'request_id': 'req-d8f9994b-96a8-48c7-a35c-b193c8cced02'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.547747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf1f66dab46465daf6c81a57afd7da5', 'request_id': 'req-d8f9994b-96a8-48c7-a35c-b193c8cced02'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.550640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463ce3f7f4264d358204b67a98e29516', 'request_id': 'req-1be6f547-673c-4723-a2eb-a006b41b4588'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.571847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf1f66dab46465daf6c81a57afd7da5', 'request_id': 'req-d8f9994b-96a8-48c7-a35c-b193c8cced02'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.575251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] The token cache is being invalidate because project 463ce3f7f4264d358204b67a98e29516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:25.575826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.577123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1be6f547-673c-4723-a2eb-a006b41b4588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.586289 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1044/2087] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:25 2022] DELETE /identity/v3/projects/463ce3f7f4264d358204b67a98e29516 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:25.586626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] The token cache is being invalidate because project 4cf1f66dab46465daf6c81a57afd7da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:25.587050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.588210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.590924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878914d-e70c-458f-b7ca-a7fc70a4d511 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.591502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878914d-e70c-458f-b7ca-a7fc70a4d511 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.591612 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1044/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:25 2022] DELETE /identity/v3/projects/4cf1f66dab46465daf6c81a57afd7da5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:25.592165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878914d-e70c-458f-b7ca-a7fc70a4d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.596276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:25.597904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:25.655672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a878914d-e70c-458f-b7ca-a7fc70a4d511 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:25.657828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a878914d-e70c-458f-b7ca-a7fc70a4d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:25.816293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9994b-96a8-48c7-a35c-b193c8cced02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:25.827001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:25.828872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.829477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.830599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] PATH_INFO: `/v3/users/77f4ea9b80454b439c0fc86e192982f3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.833337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f4ea9b80454b439c0fc86e192982f3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:25.839141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:25.883160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1045/2089] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:25.896781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.905889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.908177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.938878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f4ea9b80454b439c0fc86e192982f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.960782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f4ea9b80454b439c0fc86e192982f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:25.981774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:25.983830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:26.004241 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1046/2090] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:26.004458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f4ea9b80454b439c0fc86e192982f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:26.008621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f4ea9b80454b439c0fc86e192982f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:26.008902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.011594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f4ea9b80454b439c0fc86e192982f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:26.025111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563875d-e48c-4204-8184-be38285ddad1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.031930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.032750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.033031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.033347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.034107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:26.034437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.037438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.063297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1047/2091] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:26.070790 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1045/2092] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:25 2022] DELETE /identity/v3/users/77f4ea9b80454b439c0fc86e192982f3 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:26.080920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.082894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:26.101218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13df8-eddf-4997-820a-c9bb89893c3f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.182600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:26.217591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.218270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.218582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.219004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.221434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.224042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.295223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1048/2093] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:26 2022] POST /identity/v3/projects => generated 409 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:26.299608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.336031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140d98-0a58-47d1-bb02-1c2558e86119 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.443358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:26.467891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.468640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.468851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.469196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.470627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.473028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.528609 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1046/2094] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:26 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:26.529265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.554022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98ccb0-ec9a-4d82-85dd-2346ce30d0e5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.566743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.567475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.567801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.568555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.569436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.574779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.631934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1049/2095] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:26.632991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.658625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aeca2-a235-4a29-95d2-fd88a58c4e5d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.675575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.676455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.676858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.677149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.678787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.684005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251f49-7fd2-4b74-adc4-7b50b2b2d479 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.706702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1047/2096] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:26.725311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:26.751647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673089-713d-4a3f-9758-c218f6d9d64a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:26.764412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:26.765232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.765515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.765794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] PATH_INFO: `/v3/projects/a58419b6128e455a829a0a8cab86ddf8/users/6bed8c3f822446a692d111b39e471467/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.792718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58419b6128e455a829a0a8cab86ddf8, user_id=6bed8c3f822446a692d111b39e471467, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:26.798010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:26.822464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1050/2097] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:26 2022] PUT /identity/v3/projects/a58419b6128e455a829a0a8cab86ddf8/users/6bed8c3f822446a692d111b39e471467/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:26.835103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5a95-1996-44c5-a848-62bcb7d66fc7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:26.835559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5a95-1996-44c5-a848-62bcb7d66fc7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:26.835846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5a95-1996-44c5-a848-62bcb7d66fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:26.973040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c3bf5a95-1996-44c5-a848-62bcb7d66fc7 None None] MFA Rules not processed for user `6bed8c3f822446a692d111b39e471467`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:26.974489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c3bf5a95-1996-44c5-a848-62bcb7d66fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:27.201722 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1048/2098] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:27.205999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:27.315803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:27.316379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:27.316486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:27.376580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] MFA Rules not processed for user `259e4c3f5ff24d5b955ec36009319598`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:27.378075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:27.474320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4679a-ee91-461e-bf3a-10019028bfe1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:27.498606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:27.500507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:27.500917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:27.502225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:27.504325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:27.515223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:27.560804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1049/2099] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:27.562020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:27.564740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:27.608138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1051/2100] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:27 2022] POST /identity/v3/projects => generated 409 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:27.608380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:27.610870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab906b2-b043-41d5-969a-862aab106685 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:27.614708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:27.740300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:27.741348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:27.742972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:27.743487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] PATH_INFO: `/v3/projects/674e8e36cac34029a6970552d1fbfb44` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:27.749302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674e8e36cac34029a6970552d1fbfb44)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:27.751586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:27.753090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299757f-c0e2-4f59-94a4-13e6e27bbf60 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:27.755733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:27.770475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:27.771151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:27.771435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:27.771711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:27.777372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:27.798737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:27.880453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674e8e36cac34029a6970552d1fbfb44', 'request_id': 'req-42270af9-feb2-42d0-85ea-bc6042299a95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:27.899233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674e8e36cac34029a6970552d1fbfb44', 'request_id': 'req-42270af9-feb2-42d0-85ea-bc6042299a95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:27.909018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674e8e36cac34029a6970552d1fbfb44', 'request_id': 'req-42270af9-feb2-42d0-85ea-bc6042299a95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:27.916035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:27.917747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:27.932227 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1052/2101] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:27.933801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] The token cache is being invalidate because project 674e8e36cac34029a6970552d1fbfb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:27.934786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:27.935217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:27.936190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-42270af9-feb2-42d0-85ea-bc6042299a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:27.939512 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1050/2102] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:27 2022] DELETE /identity/v3/projects/674e8e36cac34029a6970552d1fbfb44 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:27.948867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45fe9-021f-44c9-a242-ff24c8c6047e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:27.949031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45fe9-021f-44c9-a242-ff24c8c6047e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:27.949317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45fe9-021f-44c9-a242-ff24c8c6047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:27.978272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50baa3b-aec4-41af-bc89-2496f2102174 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:27.980398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bdd45fe9-021f-44c9-a242-ff24c8c6047e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:27.982142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bdd45fe9-021f-44c9-a242-ff24c8c6047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:28.110901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.111596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.111879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.112170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.112888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.115078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.146529 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1053/2103] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:27 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:28.147899 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1051/2104] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:28.148518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.155808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.156158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:28.156485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.156891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.177525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6807-2a43-4b6b-8dbc-b41650518c14 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.190698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:28.190931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.191753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.191926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.192200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.192994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.194040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:28.194841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.224081 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1052/2105] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:28.228706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1054/2106] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:52:28.229262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.235060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.244146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d6f0a-c1c6-4ff7-a411-a9073136ad63 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.251688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.252839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.253419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.254000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.254881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:28.255545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.257485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.258886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764cb14-dcd7-4139-a69d-ea8808ff8167 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.276679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.277712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.278264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.278651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] PATH_INFO: `/v3/projects/20b72923c2004abab66de9bb8726f7d6/users/24374d467bce4ffe916326d006c1d88e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.289428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1053/2107] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:28.301205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.325046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78242662-582f-4f3f-b836-7edb8e26c5ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.327284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b72923c2004abab66de9bb8726f7d6, user_id=24374d467bce4ffe916326d006c1d88e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.330198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.336182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.337070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.337461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.337844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.339112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.342594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.372013 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1055/2108] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:28 2022] PUT /identity/v3/projects/20b72923c2004abab66de9bb8726f7d6/users/24374d467bce4ffe916326d006c1d88e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:28.377440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.449697 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1054/2109] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:28 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:28.454672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.530349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ef46a-a0f9-4523-a390-72c0df913a7a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.564444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:28.604825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:28.649648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fce11-2f2f-493a-ad14-0ee488f0dfa8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.662241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.663029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.663313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.663587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.664291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.670574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.685909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.686918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.687382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.687982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.688954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.690740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.716020 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1055/2110] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:28 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:28.719638 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1056/2111] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:52:28.720751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.726859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.739231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1e58-f608-4508-8938-bd4906e925fa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.744674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cd9b0-e0ab-488a-9839-cefbdf6ea31f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.745601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.747119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.747568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.747953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] PATH_INFO: `/v3/projects/20b72923c2004abab66de9bb8726f7d6/users/24374d467bce4ffe916326d006c1d88e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.750162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b72923c2004abab66de9bb8726f7d6, user_id=24374d467bce4ffe916326d006c1d88e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.761011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0dc67-92c9-4a1d-841a-b71a4c7971da admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.769224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.770026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.770315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.770644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.773017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.776491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1057/2112] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:28 2022] PUT /identity/v3/projects/20b72923c2004abab66de9bb8726f7d6/users/24374d467bce4ffe916326d006c1d88e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:28.779345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:28.785719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.786315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.786819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.818333 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1056/2113] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:28.819311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:28.849238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beb42-e4f2-467c-aae9-7f87e6aba074 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:28.884670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] MFA Rules not processed for user `24374d467bce4ffe916326d006c1d88e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:28.886218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:28.986800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:28.987750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:28.987909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:28.988186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:28.990089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:28.992909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:29.023260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1057/2114] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:29.032819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:29.080733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09545a-77fd-4e4c-84bb-1c8311287137 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:29.098077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:29.098993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.099272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.115231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] PATH_INFO: `/v3/projects/4897232399d64121b7b31c749b09dd1f/users/9dcea2fb80f64978af9a32780752008e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:29.208758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1058/2115] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:29.217319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:29.248713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698718a4-b821-46b3-a75d-e1a2dd16f7c4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:29.262377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:29.263728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.264326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.269340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] PATH_INFO: `/v3/users/6bed8c3f822446a692d111b39e471467` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:29.271670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bed8c3f822446a692d111b39e471467)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:29.274472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:29.312899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4897232399d64121b7b31c749b09dd1f, user_id=9dcea2fb80f64978af9a32780752008e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:29.323527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1f57-cc80-47fe-a2db-627ad061f157 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:29.376625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1058/2116] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:29 2022] PUT /identity/v3/projects/4897232399d64121b7b31c749b09dd1f/users/9dcea2fb80f64978af9a32780752008e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:29.380774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.381149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.381466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:29.436172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bed8c3f822446a692d111b39e471467'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:29.437831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bed8c3f822446a692d111b39e471467'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:29.452691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:29.460727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:29.461421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bed8c3f822446a692d111b39e471467'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:29.514744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bed8c3f822446a692d111b39e471467'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:29.549424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:29.559478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d07bae9a-f683-47b1-87b4-1da78d1d97af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bed8c3f822446a692d111b39e471467'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:29.604747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1059/2117] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:29 2022] DELETE /identity/v3/users/6bed8c3f822446a692d111b39e471467 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:29.609815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.611049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.612157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:29.701444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1059/2118] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:29.701444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:29.709031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:29.718669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:29.720882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:29.758247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ecb08-65a2-49c7-80be-6d3563a64ded None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:29.918784 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1060/2119] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:29.919878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:29.923510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:29.941244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:29.992837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:29.994453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.994739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.995027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] PATH_INFO: `/v3/users/da4f361889f74aa5aa22873d9d33f98c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.000450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4f361889f74aa5aa22873d9d33f98c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:30.009511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:30.122948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c360a-6b3b-4beb-8f60-d73208b7e0b3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:30.136824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:30.137539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.137780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.138113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.150817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4f361889f74aa5aa22873d9d33f98c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.165580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:30.167282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:30.168234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4f361889f74aa5aa22873d9d33f98c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.210842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4f361889f74aa5aa22873d9d33f98c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.212155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4f361889f74aa5aa22873d9d33f98c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.212612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1061/2120] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:30.213011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4f361889f74aa5aa22873d9d33f98c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.216500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:30.241852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e18f-d3a7-4060-9f03-d283b5754912 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:30.249658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1060/2121] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:29 2022] DELETE /identity/v3/users/da4f361889f74aa5aa22873d9d33f98c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:30.256822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:30.257204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:30.259472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.260086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.261116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.261588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.266880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.323219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:30.330132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aa10b-30c0-4681-9bd4-efd70e199453 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:30.368954 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1062/2122] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:30.371167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.371469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.371752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.445812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:30.447234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.473930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1063/2123] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:30.477268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8e7dd-8b52-4d16-8e4f-f9b46513fc11 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:30.497793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:30.499799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.500090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.500367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] PATH_INFO: `/v3/users/de7f658e8ff74ef2bc3a90c74b0013eb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.501667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7f658e8ff74ef2bc3a90c74b0013eb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:30.503797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:30.528722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:30.530194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.695356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7f658e8ff74ef2bc3a90c74b0013eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.716876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7f658e8ff74ef2bc3a90c74b0013eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.731560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:30.772963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7f658e8ff74ef2bc3a90c74b0013eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.774805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7f658e8ff74ef2bc3a90c74b0013eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.775580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd61c45f-d41f-4c17-bdb8-9d430fc84f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7f658e8ff74ef2bc3a90c74b0013eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:30.782185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c0add-824a-42ea-aad6-b138f8615253 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:30.791506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:30.793708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.794325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.796039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.800346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.806268 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1061/2124] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:30 2022] DELETE /identity/v3/users/de7f658e8ff74ef2bc3a90c74b0013eb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:30.810683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:30.811243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:30.811991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:30.831946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:30.837637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:30.864169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:30.869020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:30.871206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1064/2125] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:31.029725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1062/2126] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:31.106066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:31.108265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:31.126242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1f2-5a6b-467b-b4a3-87b75b799684 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:31.197255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:31.322441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:31.324926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:31.325675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:31.326726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:31.350114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:31.353560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d86c1-b9d4-4a84-b72c-0792ebd5cb4e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:31.411441 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1065/2127] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:31.672909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:31.675199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:31.701397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1491-8a72-488b-ac13-f5490f9b1a8d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:31.731586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:31.732657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:31.736965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:31.739473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] PATH_INFO: `/v3/users/432e697b89654407ab9d5d4ed54a9d81` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:31.741208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=432e697b89654407ab9d5d4ed54a9d81)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:31.748378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:31.845859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432e697b89654407ab9d5d4ed54a9d81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:31.865073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432e697b89654407ab9d5d4ed54a9d81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:31.893252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432e697b89654407ab9d5d4ed54a9d81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:31.895087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432e697b89654407ab9d5d4ed54a9d81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:31.895831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432e697b89654407ab9d5d4ed54a9d81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:31.940595 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1063/2128] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:31 2022] DELETE /identity/v3/users/432e697b89654407ab9d5d4ed54a9d81 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:31.945419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e469d-8df7-4dbe-a3fa-af07b95bde7c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:31.946461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e469d-8df7-4dbe-a3fa-af07b95bde7c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:31.947333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e469d-8df7-4dbe-a3fa-af07b95bde7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:31.980235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7b9e469d-8df7-4dbe-a3fa-af07b95bde7c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:31.982137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7b9e469d-8df7-4dbe-a3fa-af07b95bde7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:32.132504 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1066/2129] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:32.158615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:32.168485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:32.287010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2ebc-61c9-4a56-9295-d222585db97f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:32.296352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:32.297125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:32.297510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:32.297791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:32.307171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:32.310160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:32.311839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:32.328160 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1064/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:32.596404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:32.597012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:32.597102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:32.679794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] MFA Rules not processed for user `7c9cc1eb5b0f4a618fefd91189a73c11`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:32.681299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:32.779689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:32.781213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:32.798522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8f08-aa03-473a-a870-3218a2b9a3b4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:32.816281 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1067/2131] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:32.833660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:32.839969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:32.841157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:32.842767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:32.843471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:32.844198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] PATH_INFO: `/v3/projects/83b590e72dc1455aa37da0d5bf462da8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:32.846868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b590e72dc1455aa37da0d5bf462da8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:32.850425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:32.869263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3e496-27cc-4c45-a18f-b12402981f3e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:32.890547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:32.892983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:32.894036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:32.895190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:32.898105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:32.901160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:32.978591 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1068/2132] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:32 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:32.980687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:32.984766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.009804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b590e72dc1455aa37da0d5bf462da8', 'request_id': 'req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.028309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b590e72dc1455aa37da0d5bf462da8', 'request_id': 'req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.040106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b590e72dc1455aa37da0d5bf462da8', 'request_id': 'req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.058511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] The token cache is being invalidate because project 83b590e72dc1455aa37da0d5bf462da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:33.060268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.062137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.068887 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1065/2133] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:32 2022] DELETE /identity/v3/projects/83b590e72dc1455aa37da0d5bf462da8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:33.070717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.073477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.092853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:33.196166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d301ce-3fc7-4149-9e7a-f4c36dd3a4e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.204965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.209287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.209615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.209903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] PATH_INFO: `/v3/projects/a58419b6128e455a829a0a8cab86ddf8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.211515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58419b6128e455a829a0a8cab86ddf8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.217675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.253257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be4a74-d1d7-4a9a-9749-d3b2aaabf373 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.268586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.269316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.269603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.269885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.270603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.277408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.331706 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1066/2134] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:33 2022] POST /identity/v3/users => generated 309 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:33.333413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.337819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.340686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58419b6128e455a829a0a8cab86ddf8', 'request_id': 'req-8a22c829-d630-445d-a177-cecfe28b477a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.359795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58419b6128e455a829a0a8cab86ddf8', 'request_id': 'req-8a22c829-d630-445d-a177-cecfe28b477a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.367798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f67f2-d9ed-4235-a635-cb7ffb51faa6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.370209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58419b6128e455a829a0a8cab86ddf8', 'request_id': 'req-8a22c829-d630-445d-a177-cecfe28b477a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.395134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] The token cache is being invalidate because project a58419b6128e455a829a0a8cab86ddf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:33.395513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.396396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.402566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1069/2135] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:32 2022] DELETE /identity/v3/projects/a58419b6128e455a829a0a8cab86ddf8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:33.405172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.409712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.502569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.503531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.503756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.505536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] PATH_INFO: `/v3/users/8ed19dea3e834d3badffd07782515894` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.507620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed19dea3e834d3badffd07782515894)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.510113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.521882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:33.553504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c829-d630-445d-a177-cecfe28b477a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.563845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.565521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.565866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.566152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] PATH_INFO: `/v3/projects/9b9e4621cb39462ba663e92f2e38a0b5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.567495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9e4621cb39462ba663e92f2e38a0b5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.574000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.614174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed19dea3e834d3badffd07782515894'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.630887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed19dea3e834d3badffd07782515894'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.656730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed19dea3e834d3badffd07782515894'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.656958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed19dea3e834d3badffd07782515894'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.662344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed19dea3e834d3badffd07782515894'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.696904 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1067/2136] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:33 2022] DELETE /identity/v3/users/8ed19dea3e834d3badffd07782515894 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:33.698888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9e4621cb39462ba663e92f2e38a0b5', 'request_id': 'req-038a8843-249e-4a64-8b9b-4afe98778933'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.699524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.703082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.718330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9e4621cb39462ba663e92f2e38a0b5', 'request_id': 'req-038a8843-249e-4a64-8b9b-4afe98778933'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.728222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:33.730911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9e4621cb39462ba663e92f2e38a0b5', 'request_id': 'req-038a8843-249e-4a64-8b9b-4afe98778933'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.757330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] The token cache is being invalidate because project 9b9e4621cb39462ba663e92f2e38a0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:33.758579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.760288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:33.764179 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1070/2137] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:33 2022] DELETE /identity/v3/projects/9b9e4621cb39462ba663e92f2e38a0b5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:33.765582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.769226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.869222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a27d-700e-49a2-86e8-e27c4360309f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.882273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.883428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.883722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.884003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.886625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.890093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.921898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1068/2138] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:33.923289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:33.927841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:33.935113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a8843-249e-4a64-8b9b-4afe98778933 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.949015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.953831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.954132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.956891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] PATH_INFO: `/v3/users/24374d467bce4ffe916326d006c1d88e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.959160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24374d467bce4ffe916326d006c1d88e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.964470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d74ef-ebb4-45e7-b465-de2f32e5f402 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:33.965285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:33.982742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:33.982742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:33.982742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:33.982742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] PATH_INFO: `/v3/users/d7abe5e437a9421682db3fb6f26cebfd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:33.983251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7abe5e437a9421682db3fb6f26cebfd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:33.986151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:34.073713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24374d467bce4ffe916326d006c1d88e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.076294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24374d467bce4ffe916326d006c1d88e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.104143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24374d467bce4ffe916326d006c1d88e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.118265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7abe5e437a9421682db3fb6f26cebfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.143764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7abe5e437a9421682db3fb6f26cebfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.153979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24374d467bce4ffe916326d006c1d88e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.168966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24374d467bce4ffe916326d006c1d88e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.172309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7abe5e437a9421682db3fb6f26cebfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.173331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7abe5e437a9421682db3fb6f26cebfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.174583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a55d2cd-e81b-4987-be42-f2cb84e49a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7abe5e437a9421682db3fb6f26cebfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:34.178975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1071/2139] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:33 2022] DELETE /identity/v3/users/24374d467bce4ffe916326d006c1d88e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:34.180319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:34.204857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:34.211401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:34.222126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1069/2140] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:33 2022] DELETE /identity/v3/users/d7abe5e437a9421682db3fb6f26cebfd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:34.223690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:34.223984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:34.224264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:34.300184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] MFA Rules not processed for user `39e82edaa30d418d96ea37f942d62755`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:34.301466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:34.390233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24db8a-0188-4cf5-9b04-07c3ddc61ed3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:34.428681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:34.569423 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1070/2141] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:34.578559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:34.581046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:34.624309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:34.625478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:34.628297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:34.628757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] PATH_INFO: `/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f/users/aa1810d7f2a04181be4f1a3a155823b3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:34.684837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a3ab8bc8c49ce88afc69e1245990f, user_id=aa1810d7f2a04181be4f1a3a155823b3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:34.687796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:34.734874 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1072/2142] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:34 2022] PUT /identity/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f/users/aa1810d7f2a04181be4f1a3a155823b3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:34.738164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:34.741596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:34.762599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5de1f-263b-4e05-9333-c8be70e141d7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:34.901723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d44-80c1-4c95-8833-9e381451f9c9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:34.915256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:34.915959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:34.916244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:34.916547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:34.917250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:34.919341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:34.976982 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1073/2143] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:34 2022] POST /identity/v3/projects => generated 397 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:34.976982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:34.979723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:35.038647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.040756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.041260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.042018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] PATH_INFO: `/v3/projects/c120d28e8dbc44b6a0fd1c411b828e35` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.044695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c120d28e8dbc44b6a0fd1c411b828e35)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.046999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.094147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314892cb-d4ab-428d-9312-67a539ca1d9d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.103684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.104389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.104781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.105019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.105720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.107374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.117753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:35.132113 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1074/2144] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:35.137620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c120d28e8dbc44b6a0fd1c411b828e35', 'request_id': 'req-4f1e8649-344e-4d88-82b0-c10b4b834ae0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.139498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:35.150500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c120d28e8dbc44b6a0fd1c411b828e35', 'request_id': 'req-4f1e8649-344e-4d88-82b0-c10b4b834ae0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.160943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae203-efed-4bad-b023-993bd0029260 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.162445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c120d28e8dbc44b6a0fd1c411b828e35', 'request_id': 'req-4f1e8649-344e-4d88-82b0-c10b4b834ae0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.184008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] The token cache is being invalidate because project c120d28e8dbc44b6a0fd1c411b828e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:35.184972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.186177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.189770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1071/2145] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:34 2022] DELETE /identity/v3/projects/c120d28e8dbc44b6a0fd1c411b828e35 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:35.191132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:35.195324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:35.199040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:35.388580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.388580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.388580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.396493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.398292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.405957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.460389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8649-344e-4d88-82b0-c10b4b834ae0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.470739 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1075/2146] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:35 2022] POST /identity/v3/users => generated 305 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:35.476923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.477435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:35.481138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.481488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:35.481918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.484585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] PATH_INFO: `/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f/users/aa1810d7f2a04181be4f1a3a155823b3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.491147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a3ab8bc8c49ce88afc69e1245990f, user_id=aa1810d7f2a04181be4f1a3a155823b3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.499784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.500042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845a54-b41d-43a3-8bb6-a85c25157acb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.506567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.511136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.511392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.511875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] PATH_INFO: `/v3/users/f92c71346ae3442e9343399bba81031a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.513195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92c71346ae3442e9343399bba81031a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.516663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.541674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1072/2147] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:35 2022] PUT /identity/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f/users/aa1810d7f2a04181be4f1a3a155823b3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:35.541674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:35.542802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:35.602090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92c71346ae3442e9343399bba81031a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.603065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92c71346ae3442e9343399bba81031a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.617518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92c71346ae3442e9343399bba81031a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.645828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92c71346ae3442e9343399bba81031a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.665786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92c71346ae3442e9343399bba81031a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.681578 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1076/2148] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:35 2022] DELETE /identity/v3/users/f92c71346ae3442e9343399bba81031a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:35.685437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:35.692753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:35.703046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02866-846d-404c-b66b-80d4dff3fd4d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.853018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12df17f-2ef5-4879-8edd-578149af4160 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:35.865855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.866763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.867048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.867327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] PATH_INFO: `/v3/projects/6df32fdb9d9d4277bd36a129adaddc20` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.868865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:35.869520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df32fdb9d9d4277bd36a129adaddc20)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.870469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:35.870918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:35.871349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] PATH_INFO: `/v3/projects/20b72923c2004abab66de9bb8726f7d6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:35.875381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.876569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b72923c2004abab66de9bb8726f7d6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:35.878312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:35.878942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:35.949394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:35.971296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df32fdb9d9d4277bd36a129adaddc20', 'request_id': 'req-e8a23429-a7bb-4427-b7b5-849464cef288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.982058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b72923c2004abab66de9bb8726f7d6', 'request_id': 'req-b06975b1-dbac-4c10-9f64-24fe47c2544f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:35.989667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df32fdb9d9d4277bd36a129adaddc20', 'request_id': 'req-e8a23429-a7bb-4427-b7b5-849464cef288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.000701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b72923c2004abab66de9bb8726f7d6', 'request_id': 'req-b06975b1-dbac-4c10-9f64-24fe47c2544f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.001160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df32fdb9d9d4277bd36a129adaddc20', 'request_id': 'req-e8a23429-a7bb-4427-b7b5-849464cef288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.011505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b72923c2004abab66de9bb8726f7d6', 'request_id': 'req-b06975b1-dbac-4c10-9f64-24fe47c2544f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.032472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] The token cache is being invalidate because project 6df32fdb9d9d4277bd36a129adaddc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:36.034763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.035396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] The token cache is being invalidate because project 20b72923c2004abab66de9bb8726f7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:36.036740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.036885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.037490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b06975b1-dbac-4c10-9f64-24fe47c2544f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:36.039459 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1073/2149] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:35 2022] DELETE /identity/v3/projects/6df32fdb9d9d4277bd36a129adaddc20 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:36.043106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.048595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1077/2150] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:35 2022] DELETE /identity/v3/projects/20b72923c2004abab66de9bb8726f7d6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:36.048595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a946f6-9d9f-4c0e-a8bd-bed1be843b34 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.048595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a946f6-9d9f-4c0e-a8bd-bed1be843b34 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.048595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a946f6-9d9f-4c0e-a8bd-bed1be843b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.051309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.086111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-73a946f6-9d9f-4c0e-a8bd-bed1be843b34 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:36.088898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73a946f6-9d9f-4c0e-a8bd-bed1be843b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.277731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1078/2151] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:36.279357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef563-cc24-412a-922d-4e83ee0d372b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.279480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef563-cc24-412a-922d-4e83ee0d372b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.279727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eef563-cc24-412a-922d-4e83ee0d372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.288776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a23429-a7bb-4427-b7b5-849464cef288 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.311630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.312580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.312934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.313281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.314837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.317049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763431a3-c04e-4d34-9114-b4f34ba4104e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.319455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-41eef563-cc24-412a-922d-4e83ee0d372b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:36.320763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41eef563-cc24-412a-922d-4e83ee0d372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.340674 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1079/2152] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:36.342200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.342490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.342773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.363923 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1074/2153] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:36.369761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.370047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.370438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.371726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:36.373045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.391167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1080/2154] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:36.392092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.395807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.416575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf6a1-ad9d-4052-b92e-32da963f7bd5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.428969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:36.431159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.432107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.432392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.432925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] PATH_INFO: `/v3/projects/7d99037fd2544f06bdf82a76531e35d3/users/51a5cf4eee334f3a968c1a9c0714fd5b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.433054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.458500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d99037fd2544f06bdf82a76531e35d3, user_id=51a5cf4eee334f3a968c1a9c0714fd5b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.461650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.477071 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1075/2155] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:36.483095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.486147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1081/2156] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:36 2022] PUT /identity/v3/projects/7d99037fd2544f06bdf82a76531e35d3/users/51a5cf4eee334f3a968c1a9c0714fd5b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:36.487134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.500189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33243ec-858e-41a3-98cf-fad8f6314daa None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.574064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242057df-21b9-44f8-88b6-b94a9302ca6c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.581522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.582668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.583108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.583534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.584702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:36.585641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.590591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.616999 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1082/2157] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:36.618431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.640889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.643809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.644205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.645622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.646493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:36.647377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.651505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.657297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea516f7e-03bb-440d-b15c-c86d017a935d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.664653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.665588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.666048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.666477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.667426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.669321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.676831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:36.680106 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1076/2158] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:36.683990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.688566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1083/2159] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:36.693087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.710685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f560ee1-9a55-4a9a-b1ad-56682edbe025 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.713382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aaba2-d2f2-47d4-946e-da2e99ce2d6a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.719198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.724938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.727079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.727539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.728011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.728760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.728961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.729298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.729572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.730304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.731840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.732464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.776825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:36.781189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1084/2160] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:36.782084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.809545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1077/2161] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:36 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:36.811527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:36.813626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:36.962915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b0f6-05a9-4e04-b93a-dae02cb473c1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.976481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79c0a-cb8c-4846-8b00-a476e73978d1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:36.977578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.978929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.979400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.979933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] PATH_INFO: `/v3/projects/7d99037fd2544f06bdf82a76531e35d3/users/51a5cf4eee334f3a968c1a9c0714fd5b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.985286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d99037fd2544f06bdf82a76531e35d3, user_id=51a5cf4eee334f3a968c1a9c0714fd5b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:36.988257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:36.995200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:36.996535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:36.996535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:36.996725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] PATH_INFO: `/v3/projects/8143b15a5abe446a99c9ea26783559d9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:36.997879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8143b15a5abe446a99c9ea26783559d9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.000077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.036643 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1085/2162] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:36 2022] PUT /identity/v3/projects/7d99037fd2544f06bdf82a76531e35d3/users/51a5cf4eee334f3a968c1a9c0714fd5b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:37.037845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.109445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8143b15a5abe446a99c9ea26783559d9', 'request_id': 'req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.129787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8143b15a5abe446a99c9ea26783559d9', 'request_id': 'req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.136614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8143b15a5abe446a99c9ea26783559d9', 'request_id': 'req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.163596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] The token cache is being invalidate because project 8143b15a5abe446a99c9ea26783559d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:37.164299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.166711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.170172 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1078/2163] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:36 2022] DELETE /identity/v3/projects/8143b15a5abe446a99c9ea26783559d9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:37.171049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.173963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.230007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf522-39da-42d6-ae3e-548288d6b8d5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:37.333338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f7fc-ffd5-4af5-ab1b-e64cb5572557 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:37.351045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:37.351766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.352055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.352336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.353093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.355256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.400950 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1079/2164] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:37 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:37.402719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.410204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.433001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd535d-55a7-4a2a-b413-4ed11918c9cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:37.447997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:37.448781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.449102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.449333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] PATH_INFO: `/v3/projects/5ccc26c557b14392ab352f289a191271` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.453118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccc26c557b14392ab352f289a191271)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.457388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.468840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:37.469549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.469832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.470107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.470804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.477737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:37.509364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1babe-7bc2-4aec-a7e5-b86568e2073c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.566338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccc26c557b14392ab352f289a191271', 'request_id': 'req-da97402a-e649-4401-8692-765f64ad21d7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.589290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccc26c557b14392ab352f289a191271', 'request_id': 'req-da97402a-e649-4401-8692-765f64ad21d7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.605510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccc26c557b14392ab352f289a191271', 'request_id': 'req-da97402a-e649-4401-8692-765f64ad21d7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.612694 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1086/2165] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:37 2022] POST /identity/v3/users => generated 301 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:37.614254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.614681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.615080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.638012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] The token cache is being invalidate because project 5ccc26c557b14392ab352f289a191271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:37.638313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.640993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:37.649539 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1080/2166] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:37 2022] DELETE /identity/v3/projects/5ccc26c557b14392ab352f289a191271 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:37.650547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.659302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.679801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:37.684958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.725785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:37.843742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97402a-e649-4401-8692-765f64ad21d7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:37.851952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:37.854819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.855524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.855978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.857781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.859609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb498c2-368f-411d-8fc7-7249112cccd6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.876125 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1081/2167] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:37.879704 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1087/2168] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:37.880571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.882077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.882191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.882690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.883135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.923966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8616-87a2-4a32-8056-b79b70ef912e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:37.928514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:37.930969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:37.950078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:37.950961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.951244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.951516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.952274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:37.954160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df248d-68ff-46b5-8922-6f96c3a07a1e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:37.962556 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1082/2169] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:37.963484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:37.975105 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1088/2170] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:37.976750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:37.976991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:37.977270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:37.994998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7981b69-adb7-40d1-a852-a3a271a096ed None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.001111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.002108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.002598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.006564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.007848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.010675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d23c7-ac6b-431e-b607-099cbc7ed41c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.021433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:38.022763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:38.026885 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1083/2171] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:38.051111 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1089/2172] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:38.051111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.052846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.054485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.056799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.074205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792139e0-6a84-4497-afd4-beae1aa439e9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.087619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:38.090237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:38.091896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.094621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.094934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.096352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.097157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.098795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.105602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1084/2173] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:38.109175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.132437 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1090/2174] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:38.133558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.136812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16011-8fd6-4e63-baff-1f84f6bc82bb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.142257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.143383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.143733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.144080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] PATH_INFO: `/v3/projects/16bcac6970c1483ab891f5d019ab5275/users/50a75def6fb349428da65572e0a55516/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.162218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7f2c-e50d-4faf-adc3-94e7533d9723 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.172998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.173252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.173398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.173820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.174628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:38.175008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.178031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.195034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bcac6970c1483ab891f5d019ab5275, user_id=50a75def6fb349428da65572e0a55516, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.199586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.204562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1091/2175] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:38.204562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.219888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddaaf2-0570-4dda-bf36-59f34076a3ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.228526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.229392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.229786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.230159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.231201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:38.231670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.232135 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1085/2176] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:38 2022] PUT /identity/v3/projects/16bcac6970c1483ab891f5d019ab5275/users/50a75def6fb349428da65572e0a55516/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:38.233253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.234906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.258804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1092/2177] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:38.262555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.299618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829466d-9d6c-406d-8711-0533efb502dc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.400014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:38.446610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd48d9-29a2-454d-9028-95b946cbbed5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.470918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.473544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.474582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.474965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] PATH_INFO: `/v3/projects/2ce47feeb3ff411a8511889a370e746e/users/33d0756150114bc7bd3f6f72b93cb56a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.531778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.533491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce47feeb3ff411a8511889a370e746e, user_id=33d0756150114bc7bd3f6f72b93cb56a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.534296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.534613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.534892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.535607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.537594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.540938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed8544-0b78-4cc5-b5fd-6ed9f7db1cc5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.572895 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1086/2178] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:38 2022] PUT /identity/v3/projects/2ce47feeb3ff411a8511889a370e746e/users/33d0756150114bc7bd3f6f72b93cb56a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:38.575221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bea73-56d7-4e80-8e0b-cbb7b06a6dfe None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.575578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bea73-56d7-4e80-8e0b-cbb7b06a6dfe None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.575857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bea73-56d7-4e80-8e0b-cbb7b06a6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.609347 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1093/2179] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/projects => generated 373 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:38.610151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.654077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-912bea73-56d7-4e80-8e0b-cbb7b06a6dfe None None] MFA Rules not processed for user `50a75def6fb349428da65572e0a55516`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:38.655451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-912bea73-56d7-4e80-8e0b-cbb7b06a6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:38.748559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:38.803828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad6aa-ac75-43da-9946-7b9ede4daffb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:38.815305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:38.817017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.817313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.817595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.819487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:38.823710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:38.871972 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1087/2180] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:38.873750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:38.874058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:38.874528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:38.902759 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1094/2181] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/projects => generated 393 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:38.903642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:38.912351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:38.913666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:39.015035 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1088/2182] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:39.016169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.029540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5b24-a0b6-432b-aa6d-439873d8b321 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.034682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.035670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.035954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.036252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.037001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.039047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.078904 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1089/2183] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:39 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:39.080174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.109832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59386-ea14-47ef-9d37-c694c5c6ea17 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.142985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:39.178332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9449-92d5-44e3-b2db-34fcd1e583b1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.185328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.186238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.186591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.187536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.188355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.191943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.231988 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1090/2184] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:39 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:39.233504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.235724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:39.308336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.309312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.309803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.310219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.311268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.313424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.363969 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1095/2185] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:38 2022] POST /identity/v3/users => generated 287 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:39.365757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.381436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57894-f1ce-4cb5-8043-67454411e22f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.388585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.390256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.390696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.391153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.395704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.398051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8becd8-b3b3-44be-bbba-86d109750e42 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.398403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.413722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.414576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.414865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.415286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.435917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1096/2186] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:39 2022] POST /identity/v3/users => generated 303 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:39.436472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.437344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.438112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.450423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200daf-b4dd-4d81-96f6-58c73ba358e6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.457671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.458640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.459082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.459509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.460492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.461600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1091/2187] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:39.462670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.463157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.476519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1097/2188] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.478936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.491297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de906a-24db-4bf5-8030-559fbcdad3d8 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.492015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95efc-46fb-4d2c-8512-35839fb9d3ec admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.497314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.500218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.500711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.501142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.502220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.503379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.504151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.504367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.504672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.505212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.506053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.510863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.522607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1098/2189] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.523783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.536319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991c4f-a43d-4bcd-9109-8b358574db29 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.540674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1092/2190] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.541883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.545053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.545942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.546363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.546785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.547762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.549733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.563918 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1099/2191] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.565445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.580611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0955-56fa-4993-b128-79d038fe7f8d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.582966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7ad3f-56f6-45f3-8526-48b7c9ae0cc0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.589645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.593249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.593773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.594242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.595595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.599498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.604310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.607180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.607991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.608314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] PATH_INFO: `/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef/users/312a1a7fb6ed410190f6e35af0e83a1c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.623134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:39.639904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1100/2192] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.640819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.645894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d93e0e76056414e8fb8dae54dc5d9ef, user_id=312a1a7fb6ed410190f6e35af0e83a1c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.651459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.664448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d14a-f642-4d0e-9b4f-c8d0d07773ab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.678608 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1093/2193] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:39 2022] PUT /identity/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef/users/312a1a7fb6ed410190f6e35af0e83a1c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:39.682168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.683096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.684224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.684891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.685191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] PATH_INFO: `/v3/projects/11a1d2900c7b471bba900b9e724d1706/users/ee9dd8f35dc14b58b367855e3402e2e1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.707851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a1d2900c7b471bba900b9e724d1706, user_id=ee9dd8f35dc14b58b367855e3402e2e1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.711003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.731090 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1101/2194] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:39 2022] PUT /identity/v3/projects/11a1d2900c7b471bba900b9e724d1706/users/ee9dd8f35dc14b58b367855e3402e2e1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:39.732225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:39.865253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423634-e41d-455b-8b5e-8e7242bcadab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.946325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6f5b-46e8-4801-afbb-4d78c481abb9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:39.955441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:39.957229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.958052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.964995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.965373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.966435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:39.968105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebc863-6dc3-4ec0-b408-6d791095f1b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:39.986325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:39.987599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.988701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.989158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] PATH_INFO: `/v3/projects/79b9a0679dc044f990e70b995acfff90/users/6761d5fb4ab54eee9d044b6a40fae387/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:39.994027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1102/2195] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:39.999358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a83a-25e5-47ed-86bb-13b6c5470a27 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:39.999659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a83a-25e5-47ed-86bb-13b6c5470a27 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:39.999938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a83a-25e5-47ed-86bb-13b6c5470a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.034283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b9a0679dc044f990e70b995acfff90, user_id=6761d5fb4ab54eee9d044b6a40fae387, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:40.042486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:40.068613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8fe9a83a-25e5-47ed-86bb-13b6c5470a27 None None] MFA Rules not processed for user `ee9dd8f35dc14b58b367855e3402e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:40.069870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8fe9a83a-25e5-47ed-86bb-13b6c5470a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:40.089949 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1094/2196] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:39 2022] PUT /identity/v3/projects/79b9a0679dc044f990e70b995acfff90/users/6761d5fb4ab54eee9d044b6a40fae387/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:40.090926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:40.278498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1103/2197] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:40.284729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86aa9-7135-4c96-b446-3fa2a217c790 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.285264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86aa9-7135-4c96-b446-3fa2a217c790 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.285701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f86aa9-7135-4c96-b446-3fa2a217c790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.299172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8b73-96f1-4630-94dc-f81ec7eec9ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:40.312236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:40.313262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.313593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.313873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] PATH_INFO: `/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef/users/312a1a7fb6ed410190f6e35af0e83a1c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.319457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d93e0e76056414e8fb8dae54dc5d9ef, user_id=312a1a7fb6ed410190f6e35af0e83a1c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:40.322574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:40.350392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1095/2198] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:40 2022] PUT /identity/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef/users/312a1a7fb6ed410190f6e35af0e83a1c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:40.352043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-08f86aa9-7135-4c96-b446-3fa2a217c790 None None] MFA Rules not processed for user `6761d5fb4ab54eee9d044b6a40fae387`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:40.353309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-08f86aa9-7135-4c96-b446-3fa2a217c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:40.355451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:40.472039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:40.512158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f309af-75f8-414e-a0d7-b4df8d833e19 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:40.525869 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1104/2199] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:40.526906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:40.529116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.529553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.529823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.530296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.530683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.531017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.531834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:40.536599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:40.601473 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1096/2200] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/projects => generated 391 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:40.603706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] MFA Rules not processed for user `312a1a7fb6ed410190f6e35af0e83a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:40.605297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:40.607118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:40.720783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:40.765243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136b1f-7635-4671-b40f-3311b3223b03 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:40.778265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:40.779694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.784668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.785203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.799084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:40.802678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71625f6c-2606-4724-80ee-9d4619f3d7f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:40.832570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1105/2201] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:40.833660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:40.846037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aeab67-7952-46a6-8338-e31a36e4880b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:40.852335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1097/2202] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:40.854071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.854367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.854706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.896709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] MFA Rules not processed for user `50a75def6fb349428da65572e0a55516`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:40.898108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:40.936997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:40.937704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:40.937999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:40.938273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:40.938989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:40.941003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:40.984573 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1106/2203] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/users => generated 302 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:40.984573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.001956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57b664-fa0d-421f-a780-1a7e410145fd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.004680 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1098/2204] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:41.008817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.010488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.011226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.012232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.012232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.013321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.017604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.046721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf208e-7ea6-418a-b59f-b1fb16a5afde None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.058361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1107/2205] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:40 2022] POST /identity/v3/users => generated 294 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:41.060716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.061259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.061426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.061699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.061969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.062704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.063389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:41.064371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.089168 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1099/2206] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:41.090118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.113992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552dd7-e52a-4d3c-a4c7-f79bf314cf50 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.126800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.127494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.127777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.128048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.128810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.130428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.148204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:41.155470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1100/2207] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:41.159218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.182984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5922-6fe3-4e7f-9374-002c70b8ca4e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.196620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38265a-24f9-4304-baed-1adff111ef75 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.200718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.201641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.201920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.202193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] PATH_INFO: `/v3/projects/cd66bce6e42142ca87e33a10462a9a0b/users/5547ef6e7224431eba4d33db8d21a66d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.203785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.205076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.205539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.206017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.220206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.222773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.238743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd66bce6e42142ca87e33a10462a9a0b, user_id=5547ef6e7224431eba4d33db8d21a66d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.239800 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1108/2208] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:41.241411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.252044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.263068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a824ba7-89ce-4ab9-b786-c2ce603202d8 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.271790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.273857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.274153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.275588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] PATH_INFO: `/v3/projects/e0c2777e049e4628a39456d2ee820d5a/users/f05c4e47542148aabd611d05b264426b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.304847 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1101/2209] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:41 2022] PUT /identity/v3/projects/cd66bce6e42142ca87e33a10462a9a0b/users/5547ef6e7224431eba4d33db8d21a66d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:41.309439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.356535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c2777e049e4628a39456d2ee820d5a, user_id=f05c4e47542148aabd611d05b264426b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.371243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.400664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1109/2210] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:41 2022] PUT /identity/v3/projects/e0c2777e049e4628a39456d2ee820d5a/users/f05c4e47542148aabd611d05b264426b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:41.406752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.488787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920a9b2-a0ed-4c39-bcab-0918a44bbe57 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.553898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3165f-5440-45db-9f61-2423c1bab3d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.559835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.561178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.561959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.561959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.562838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.564919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.577576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:41.580904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1110/2211] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:41.585737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.598346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e113b-d414-465d-8bde-84a2589aa9d2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.604180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.605335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.606135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.606135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] PATH_INFO: `/v3/projects/e0c2777e049e4628a39456d2ee820d5a/users/f05c4e47542148aabd611d05b264426b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.608513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c2777e049e4628a39456d2ee820d5a, user_id=f05c4e47542148aabd611d05b264426b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.613426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332857f-392a-429c-9af2-e7b4eead85e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.629867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1111/2212] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:41 2022] PUT /identity/v3/projects/e0c2777e049e4628a39456d2ee820d5a/users/f05c4e47542148aabd611d05b264426b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:41.646163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.646511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.646796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.663799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.664902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.665380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.665844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.666868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.669652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.684483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1102/2213] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:41.689617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.704934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785bfd8-7b32-462b-a333-97c010a4365c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.717437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] MFA Rules not processed for user `f05c4e47542148aabd611d05b264426b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:41.718700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:41.793897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.795999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.796540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.797026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] PATH_INFO: `/v3/projects/cd66bce6e42142ca87e33a10462a9a0b/users/5547ef6e7224431eba4d33db8d21a66d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.800662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd66bce6e42142ca87e33a10462a9a0b, user_id=5547ef6e7224431eba4d33db8d21a66d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.806319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae1df-2732-4892-a282-e477f15645e4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.844692 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1103/2214] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:41 2022] PUT /identity/v3/projects/cd66bce6e42142ca87e33a10462a9a0b/users/5547ef6e7224431eba4d33db8d21a66d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:41.854752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.855270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.856070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.867833 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1112/2215] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:41.879232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.881544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:41.898510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] MFA Rules not processed for user `5547ef6e7224431eba4d33db8d21a66d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:41.899782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:41.928895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:42.021394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9c15-89c9-41a6-9dee-70d7af26ab3c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:42.033849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1104/2216] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:42.100904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:42.101570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:42.101850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:42.102125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:42.175435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:42.177386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:42.192650 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1113/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:42.234877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:42.240701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:42.262344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313165c-9964-4be0-b40d-0acfb4b565d7 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:42.278732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:42.280959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:42.280959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:42.280959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:42.352100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:42.401578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9432de-e8b0-4972-983a-4ed97717fe1d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:42.416204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:42.417495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:42.420798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:42.421222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] PATH_INFO: `/v3/users/ee9dd8f35dc14b58b367855e3402e2e1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:42.427354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9dd8f35dc14b58b367855e3402e2e1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:42.431262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:42.439212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:42.481080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:42.486821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7127de-d5bb-4c28-bf6f-1168db481753 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:42.516729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1114/2218] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:42.563870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9dd8f35dc14b58b367855e3402e2e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:42.586231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9dd8f35dc14b58b367855e3402e2e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:42.609457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9dd8f35dc14b58b367855e3402e2e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:42.612544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9dd8f35dc14b58b367855e3402e2e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:42.613358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9dd8f35dc14b58b367855e3402e2e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:42.667028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1105/2219] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:42 2022] DELETE /identity/v3/users/ee9dd8f35dc14b58b367855e3402e2e1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:42.672349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:42.673024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:42.673472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:42.709513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:42.714320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:42.848495 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1115/2220] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:42.994027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:42.997034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:43.172256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824619a-b8c3-488e-aeeb-e2de3876c0bb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:43.177213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:43.177881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:43.178163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:43.178474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:43.192236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:43.194432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5268c-eaec-412d-9427-62d7229f0d71 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:43.208756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1106/2221] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:43.398516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:43.400289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:43.419963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c32675-b1df-455b-a96d-2b9ce658a86f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:43.435150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:43.447643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:43.448193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:43.449195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] PATH_INFO: `/v3/users/6761d5fb4ab54eee9d044b6a40fae387` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:43.453605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6761d5fb4ab54eee9d044b6a40fae387)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:43.457939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:43.574807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6761d5fb4ab54eee9d044b6a40fae387'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:43.576702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6761d5fb4ab54eee9d044b6a40fae387'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:43.590565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6761d5fb4ab54eee9d044b6a40fae387'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:43.623788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6761d5fb4ab54eee9d044b6a40fae387'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:43.640759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6761d5fb4ab54eee9d044b6a40fae387'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:43.659768 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1116/2222] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:43 2022] DELETE /identity/v3/users/6761d5fb4ab54eee9d044b6a40fae387 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:43.664270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:43.665176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:43.665600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:43.695671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:43.697124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:43.845855 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1107/2223] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:43.867506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:43.871256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:43.952041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebe9-e3df-46f3-b087-49330f3cc695 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:43.957342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:43.958910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:43.959206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:43.959487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:43.976583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:43.978227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:43.994019 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1117/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:46.273425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:46.278136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:46.317823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5e765-b9dc-43aa-9ed4-c62136cef8ef None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:46.337487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:46.338353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:46.338986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:46.339264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] PATH_INFO: `/v3/projects/11a1d2900c7b471bba900b9e724d1706` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:46.342981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a1d2900c7b471bba900b9e724d1706)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:46.345017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:46.355949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:46.479106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a1d2900c7b471bba900b9e724d1706', 'request_id': 'req-4dbfd40a-8f78-4b5a-b637-2016e93ca805'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.493331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a1d2900c7b471bba900b9e724d1706', 'request_id': 'req-4dbfd40a-8f78-4b5a-b637-2016e93ca805'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.515521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a1d2900c7b471bba900b9e724d1706', 'request_id': 'req-4dbfd40a-8f78-4b5a-b637-2016e93ca805'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.561974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] The token cache is being invalidate because project 11a1d2900c7b471bba900b9e724d1706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:46.562281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.563038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.564690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1108/2225] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:46 2022] DELETE /identity/v3/projects/11a1d2900c7b471bba900b9e724d1706 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:46.569037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:46.576281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:46.593464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459bea2-89cc-42d9-87ad-a468b6f51ebc service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:46.803406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:46.805401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:46.805924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:46.806579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] PATH_INFO: `/v3/users/5547ef6e7224431eba4d33db8d21a66d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:46.808585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5547ef6e7224431eba4d33db8d21a66d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:46.818217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:46.963960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5547ef6e7224431eba4d33db8d21a66d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.965487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5547ef6e7224431eba4d33db8d21a66d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:46.977014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:46.987059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:46.993153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5547ef6e7224431eba4d33db8d21a66d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.021232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd40a-8f78-4b5a-b637-2016e93ca805 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:47.021648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5547ef6e7224431eba4d33db8d21a66d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.036135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:47.039655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:47.039655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:47.039655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] PATH_INFO: `/v3/projects/79b9a0679dc044f990e70b995acfff90` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:47.041399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b9a0679dc044f990e70b995acfff90)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:47.042513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5547ef6e7224431eba4d33db8d21a66d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.045090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:47.060696 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1118/2226] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:46 2022] DELETE /identity/v3/users/5547ef6e7224431eba4d33db8d21a66d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:47.170979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b9a0679dc044f990e70b995acfff90', 'request_id': 'req-ec2405c0-3fb6-4ba5-b37b-499de45f7888'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.195352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b9a0679dc044f990e70b995acfff90', 'request_id': 'req-ec2405c0-3fb6-4ba5-b37b-499de45f7888'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.209242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b9a0679dc044f990e70b995acfff90', 'request_id': 'req-ec2405c0-3fb6-4ba5-b37b-499de45f7888'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.229935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] The token cache is being invalidate because project 79b9a0679dc044f990e70b995acfff90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:47.232397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.241315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec2405c0-3fb6-4ba5-b37b-499de45f7888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.241315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1109/2227] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:46 2022] DELETE /identity/v3/projects/79b9a0679dc044f990e70b995acfff90 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:47.243631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:47.245348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:47.395596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac53f-7d8f-4d59-8427-03732b73151f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:47.481215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:47.549249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:47.551075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:47.551498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:47.551909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] PATH_INFO: `/v3/users/f05c4e47542148aabd611d05b264426b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:47.554654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05c4e47542148aabd611d05b264426b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:47.569837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:47.723208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05c4e47542148aabd611d05b264426b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.725133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05c4e47542148aabd611d05b264426b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.781975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05c4e47542148aabd611d05b264426b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.812336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05c4e47542148aabd611d05b264426b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.821279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05c4e47542148aabd611d05b264426b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:47.836358 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1119/2228] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:47 2022] DELETE /identity/v3/users/f05c4e47542148aabd611d05b264426b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:49.384390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4075ecb-bab5-4c87-a779-7f17bf38e2b2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:49.385323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4075ecb-bab5-4c87-a779-7f17bf38e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:49.385767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4075ecb-bab5-4c87-a779-7f17bf38e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:49.483934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c4075ecb-bab5-4c87-a779-7f17bf38e2b2 None None] MFA Rules not processed for user `51a5cf4eee334f3a968c1a9c0714fd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:49.487186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4075ecb-bab5-4c87-a779-7f17bf38e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:49.519832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:49.521315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:49.682728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9019650-85ea-4335-8bbc-b31a9ba0de60 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:49.694593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:49.696221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:49.696543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:49.696825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] PATH_INFO: `/v3/projects/cd66bce6e42142ca87e33a10462a9a0b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:49.698235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd66bce6e42142ca87e33a10462a9a0b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:49.700296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:49.725248 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1110/2229] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:49.726934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:49.727334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:49.727706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:49.741683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:49.771230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] MFA Rules not processed for user `39e82edaa30d418d96ea37f942d62755`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:49.773390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:49.785106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd66bce6e42142ca87e33a10462a9a0b', 'request_id': 'req-fa095815-a000-495b-8735-1fa4425210f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:49.787163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:49.809256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd66bce6e42142ca87e33a10462a9a0b', 'request_id': 'req-fa095815-a000-495b-8735-1fa4425210f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:49.812148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd66bce6e42142ca87e33a10462a9a0b', 'request_id': 'req-fa095815-a000-495b-8735-1fa4425210f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:49.829604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] The token cache is being invalidate because project cd66bce6e42142ca87e33a10462a9a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:49.829977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:49.830704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa095815-a000-495b-8735-1fa4425210f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:49.838001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1120/2230] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:49 2022] DELETE /identity/v3/projects/cd66bce6e42142ca87e33a10462a9a0b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:52:49.841022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c37ff-5c0a-41b2-a241-18deedb72caa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:49.841429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c37ff-5c0a-41b2-a241-18deedb72caa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:49.841715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c37ff-5c0a-41b2-a241-18deedb72caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:49.888406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-539c37ff-5c0a-41b2-a241-18deedb72caa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:49.889766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-539c37ff-5c0a-41b2-a241-18deedb72caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:49.940698 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1111/2231] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:49.952391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:49.955181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.030226 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1121/2232] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:50.033537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.033830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.034107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.098544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:50.100380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.115892 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1122/2233] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:50.117177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:50.124501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.172211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab55edb-5454-42b1-a1c2-4a0980dcb2c6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:50.188017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70af2-80f3-4e89-bdd2-01c4ff1635b5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:50.190860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:50.191887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.192279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.193424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] PATH_INFO: `/v3/projects/e0c2777e049e4628a39456d2ee820d5a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.194845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c2777e049e4628a39456d2ee820d5a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:50.197986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:50.204211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:50.204921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.205204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.205482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.212824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.239966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:50.243713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:50.257324 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1112/2234] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:50.258298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:50.274225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42186bc-c5b6-460b-8c78-fed620f5cbfc service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:50.289992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:50.292367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.292367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.293671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.295106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:50.296553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:50.300096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:50.342428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c2777e049e4628a39456d2ee820d5a', 'request_id': 'req-d9a3fec3-4378-4f91-8a3a-0781ed914a92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:50.354244 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1113/2235] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:50.358353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:50.370669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c2777e049e4628a39456d2ee820d5a', 'request_id': 'req-d9a3fec3-4378-4f91-8a3a-0781ed914a92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:50.383147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c2777e049e4628a39456d2ee820d5a', 'request_id': 'req-d9a3fec3-4378-4f91-8a3a-0781ed914a92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:50.393544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da86445-4145-48ea-b8d9-f79814cdd117 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:50.443885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] The token cache is being invalidate because project e0c2777e049e4628a39456d2ee820d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:50.444290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:50.446909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d9a3fec3-4378-4f91-8a3a-0781ed914a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:50.454516 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1123/2236] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:50 2022] DELETE /identity/v3/projects/e0c2777e049e4628a39456d2ee820d5a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:50.467958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24940b-c293-43b6-81f0-d6469d343d9f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.468776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24940b-c293-43b6-81f0-d6469d343d9f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.469953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24940b-c293-43b6-81f0-d6469d343d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.521245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3a24940b-c293-43b6-81f0-d6469d343d9f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:50.523434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a24940b-c293-43b6-81f0-d6469d343d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.595349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:50.595982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.596268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.596870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.601046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:50.603127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:50.674456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:50.706789 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1114/2237] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:50 2022] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:50.708528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:50.714478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.716665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1124/2238] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:50.729823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:50.732800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.734727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.735829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.786819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:50.809835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:50.959697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457130-687d-48b2-bf7f-9aa3d527303a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:50.970554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:50.971403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:50.971959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:50.972608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:50.973413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:50.976709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:50.996827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1125/2239] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:50.998076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.017914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca1a5-ec5e-4c53-9a43-7515a17edcf3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.022212 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1115/2240] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:50 2022] POST /identity/v3/users => generated 287 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:51.026740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.028347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.030873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.031830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.032292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.034488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:52:51.036301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.040141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.048967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15623-ef1b-413a-a3ff-df32eea84230 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.060763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.061729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.062342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.062482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.063291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.065058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.075731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1126/2241] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:52:51.081303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.098418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9231b-24bf-42f1-a83e-8d2fd4138aa9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.102385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1116/2242] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:52:51.106618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.114635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.116631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.117105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.118635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.120065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.126375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.130389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a27e-3e89-4080-94be-d1533f93ad82 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.137743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.138437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.138721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.138999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.144711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.147938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.169921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1117/2243] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:51.174293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.198048 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1127/2244] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:51 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:51.202170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.202977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790600-16f1-4324-acf8-7340947408d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.373487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.375175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.375667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.376196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] PATH_INFO: `/v3/projects/6ce705c5cb094b62a7badf762c5696d6/users/afc85324a29d4e11bc980ed01dc9f341/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.376534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8b135-3964-4633-bf05-11455e08ed42 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.389955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.390661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.390948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.391228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.392038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.394056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.406899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce705c5cb094b62a7badf762c5696d6, user_id=afc85324a29d4e11bc980ed01dc9f341, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.416962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07ea36-ac5f-4bde-bf75-95713353502c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.446218 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1128/2245] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:51 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:51.447695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.462884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689d4fe-39b7-4ecd-a446-0ac05d540e4d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.496522 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1118/2246] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:51 2022] PUT /identity/v3/projects/6ce705c5cb094b62a7badf762c5696d6/users/afc85324a29d4e11bc980ed01dc9f341/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:51.499892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.507266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.507560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.595757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] MFA Rules not processed for user `afc85324a29d4e11bc980ed01dc9f341`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:51.605314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:51.670362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:51.709712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.710425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.710715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.710999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.711752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.713743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4f6cd-2154-4684-95b0-18b4f4a84745 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.749348 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1129/2247] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:52:51.750944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.751243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.751528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.771084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:51.846345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:51.847611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:51.891956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1119/2248] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:51.892930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.928868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086edb5f-c78a-46db-9fb9-6b59eb8f5a59 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:51.950885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:51.951598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:51.951947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:51.952231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:51.953014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:51.954714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:51.990445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1120/2249] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:51.991390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:51.993602 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1130/2250] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:51.994512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.020408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ea42-a38f-4ecf-843c-6efd923253b2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.030069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.030789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.031099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.031405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.032220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.034283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.038070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ab6c0-4229-4b36-b107-3d573098118c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.046540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.050357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.050729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.051493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] PATH_INFO: `/v3/projects/f83ac789f4d94dd1b4285443defab881/users/604fb9a67a10427ea0df0c3b41ef9193/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.102730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83ac789f4d94dd1b4285443defab881, user_id=604fb9a67a10427ea0df0c3b41ef9193, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.108337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.110640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1121/2251] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:52.112716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.117571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:52.165318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1131/2252] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:51 2022] PUT /identity/v3/projects/f83ac789f4d94dd1b4285443defab881/users/604fb9a67a10427ea0df0c3b41ef9193/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:52.166881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.258537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e9bb-d57a-4066-9ec9-b60dd047457e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.366126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371867ed-0248-4ec5-afc0-bdb94c741bbe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.377915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.379567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.382341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.382866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.384172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.390241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ea82e-96d9-406d-8d8d-18744661b6ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.451290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1132/2253] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:52 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:52.455623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.456298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.456862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.480802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.481563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.481779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.483295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.506982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.508599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.526411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1122/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:52.527239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.534789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] MFA Rules not processed for user `604fb9a67a10427ea0df0c3b41ef9193`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:52.544120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:52.576737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418506-3e39-40ab-a2be-6eac4dbdc681 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.599878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.600607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.600896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.601590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.602096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.604155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.636232 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1123/2255] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:52.640823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.651786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:52.665720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad8453-e885-4cc6-ad66-a282ae276f65 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.677789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1133/2256] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:52.682365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.682517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.683344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.683635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.683973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] PATH_INFO: `/v3/projects/a8302aeb67eb4771b9626fe5423465b2/users/e0805476769c435d9620e8b3da2170c5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.696687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3eed3-2cb2-448c-b1fd-9905e24da589 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.702606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.703439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.705315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.705705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.706614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.711522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.729099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8302aeb67eb4771b9626fe5423465b2, user_id=e0805476769c435d9620e8b3da2170c5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.731896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:52.778110 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1124/2257] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:52 2022] PUT /identity/v3/projects/a8302aeb67eb4771b9626fe5423465b2/users/e0805476769c435d9620e8b3da2170c5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:52.779107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.786941 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1134/2258] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:52:52 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:52:52.790355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:52.874558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:52.924161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484a819-98b6-4be0-bc2e-ee60e767d8fa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.971674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a129-f68f-4efb-9362-b7be1d1c55f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:52.983226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:52.983630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:52.984440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:52.984440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:52.984945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:52.987108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.072774 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1135/2259] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:52:52 2022] POST /identity/v3/users => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:52:53.075969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.094186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.094923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.095281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.095521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.096303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.101759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ed1f-cef3-49e4-a8ec-658fa80721b7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:53.104166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.130849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.131550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.131839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.132123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.132897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.134538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.140333 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1125/2260] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:53.145624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.169294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1c4d-1ebb-4e8c-b8ac-4dccd1205461 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:53.173724 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1136/2261] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:53.180560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.181326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.181607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.181882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] PATH_INFO: `/v3/projects/a8302aeb67eb4771b9626fe5423465b2/users/e0805476769c435d9620e8b3da2170c5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.183172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.186877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8302aeb67eb4771b9626fe5423465b2, user_id=e0805476769c435d9620e8b3da2170c5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.189654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961f6cc-004e-4196-b70f-79dd815c48c6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.209753 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1126/2262] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:53 2022] PUT /identity/v3/projects/a8302aeb67eb4771b9626fe5423465b2/users/e0805476769c435d9620e8b3da2170c5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:53.223140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5824-4b76-4d55-8d4e-f4187bae7da0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:53.228946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.229806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.229806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.334560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] MFA Rules not processed for user `e0805476769c435d9620e8b3da2170c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:53.336116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:53.399676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.400700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.400990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.401271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] PATH_INFO: `/v3/projects/5d350253901443f4b5f7cf70dd9edc4d/users/ce697dfa33564f178f2cbe5c1000ff9b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.516268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d350253901443f4b5f7cf70dd9edc4d, user_id=ce697dfa33564f178f2cbe5c1000ff9b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.519043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.546924 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1127/2263] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:53.585626 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1137/2264] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:53 2022] PUT /identity/v3/projects/5d350253901443f4b5f7cf70dd9edc4d/users/ce697dfa33564f178f2cbe5c1000ff9b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:53.587752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.619133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9afa95-2c8a-4b0b-9884-6e7f263e38b9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:53.697764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:53.713131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.714546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.714843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.715156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.715981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.723699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.741993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1128/2265] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:52:53.746772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.765504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa39-69e1-46b8-8172-fa3098d3d832 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:53.778053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:53.782136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.783770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.784368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] PATH_INFO: `/v3/projects/5d350253901443f4b5f7cf70dd9edc4d/users/ce697dfa33564f178f2cbe5c1000ff9b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.784764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:53.786941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:53.792120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d350253901443f4b5f7cf70dd9edc4d, user_id=ce697dfa33564f178f2cbe5c1000ff9b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:53.799326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e8cbb-63ab-4a32-b9ba-0c1763ff0778 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:53.865351 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1138/2266] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:52:53 2022] PUT /identity/v3/projects/5d350253901443f4b5f7cf70dd9edc4d/users/ce697dfa33564f178f2cbe5c1000ff9b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:53.869748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:53.870301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:53.870802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:53.926374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] MFA Rules not processed for user `ce697dfa33564f178f2cbe5c1000ff9b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:53.927609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:53.942011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:54.022913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f4fc-19eb-40cd-98bf-1bc718bd601f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:54.103520 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1139/2267] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:54.234900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:54.235755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:54.236126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:54.236502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:54.323357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:54.325312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:54.340935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1129/2268] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:54.580927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:54.582776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:54.609710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4537-293c-4ce8-a202-350275edc933 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:54.618712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:54.619715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:54.620310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:54.620870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:54.640561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:54.642947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128c71-2a38-4866-8da2-460f7c588761 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:54.692566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1140/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:54.886892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:54.911598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91e80-32f5-4264-bbc3-3036c7f3f7e0 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:54.938876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:54.939912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:54.940502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:54.940872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:54.980805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:55.080664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:55.082533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:55.126027 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1130/2270] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:55.584647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74703a4-eb93-43a9-94fd-9d6545e4d067 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:55.585122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74703a4-eb93-43a9-94fd-9d6545e4d067 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:55.586347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74703a4-eb93-43a9-94fd-9d6545e4d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:55.662218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b74703a4-eb93-43a9-94fd-9d6545e4d067 None None] MFA Rules not processed for user `9dcea2fb80f64978af9a32780752008e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:55.663753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b74703a4-eb93-43a9-94fd-9d6545e4d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:55.853784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:55.924172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1141/2271] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:55.987152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edae-fd17-43a7-9a64-b93c6b55d545 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:56.002670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:56.004128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:56.004596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:56.005024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] PATH_INFO: `/v3/users/afc85324a29d4e11bc980ed01dc9f341` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:56.007457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc85324a29d4e11bc980ed01dc9f341)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:56.011272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:56.133902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc85324a29d4e11bc980ed01dc9f341'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:56.154300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc85324a29d4e11bc980ed01dc9f341'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:56.205076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc85324a29d4e11bc980ed01dc9f341'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:56.209120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc85324a29d4e11bc980ed01dc9f341'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:56.209847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc85324a29d4e11bc980ed01dc9f341'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:56.252851 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1131/2272] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:55 2022] DELETE /identity/v3/users/afc85324a29d4e11bc980ed01dc9f341 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:56.257523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:56.258597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:56.258887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:56.298715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:56.300172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:56.409120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:56.410618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:56.506508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:56.518990 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1142/2273] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:56.584006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:56.585388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:56.589371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18438f3d-1e12-4080-a62a-2d44875a0628 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:56.599611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:56.600278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:56.600595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:56.600878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:56.602945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:56.639920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:56.709198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:56.713947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:56.726344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1132/2274] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:56.732186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8322b-04cc-495c-9372-79465e8ec7f2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:56.747685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:56.748445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:56.748729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:56.749005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:56.765953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:56.767258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8ee4-84ef-42b8-bbff-f6161dbe6b02 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:56.802061 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1143/2275] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:57.243435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:57.245473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:57.277778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491b3d-edc1-489b-8697-75b529426ba9 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:57.285577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:57.288524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.288830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.289090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] PATH_INFO: `/v3/users/604fb9a67a10427ea0df0c3b41ef9193` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.294852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=604fb9a67a10427ea0df0c3b41ef9193)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:57.303060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:57.397889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604fb9a67a10427ea0df0c3b41ef9193'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:57.411165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604fb9a67a10427ea0df0c3b41ef9193'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:57.434293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604fb9a67a10427ea0df0c3b41ef9193'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:57.435348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604fb9a67a10427ea0df0c3b41ef9193'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:57.436174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604fb9a67a10427ea0df0c3b41ef9193'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:57.460972 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1133/2276] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:57 2022] DELETE /identity/v3/users/604fb9a67a10427ea0df0c3b41ef9193 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:57.466752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50dbff-e570-47fe-801d-922da588bc17 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.466752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50dbff-e570-47fe-801d-922da588bc17 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.466752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50dbff-e570-47fe-801d-922da588bc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.509784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ed50dbff-e570-47fe-801d-922da588bc17 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:57.511050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ed50dbff-e570-47fe-801d-922da588bc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:57.622181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1144/2277] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:57.661021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:57.663020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:57.754808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.755100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.755385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.777389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:57.797330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d376-89d6-4568-9451-064ad350a63f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:57.810130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:57.812404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.812874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.813250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.838851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:57.839766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] MFA Rules not processed for user `aa1810d7f2a04181be4f1a3a155823b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:57.841218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:57.842192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:57.870222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1134/2278] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:57.964373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1145/2279] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:52:58.970017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:58.973799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:59.003318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b808b-2532-4a40-94ee-65e07857c98a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:59.017149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:59.018428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:59.018911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:59.019546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] PATH_INFO: `/v3/projects/6ce705c5cb094b62a7badf762c5696d6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:59.022593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce705c5cb094b62a7badf762c5696d6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:59.035782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:59.148342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce705c5cb094b62a7badf762c5696d6', 'request_id': 'req-a56ff380-e94b-48fd-8f21-a51fdbaa7260'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.164154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce705c5cb094b62a7badf762c5696d6', 'request_id': 'req-a56ff380-e94b-48fd-8f21-a51fdbaa7260'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.174307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce705c5cb094b62a7badf762c5696d6', 'request_id': 'req-a56ff380-e94b-48fd-8f21-a51fdbaa7260'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.205117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] The token cache is being invalidate because project 6ce705c5cb094b62a7badf762c5696d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:52:59.205550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.208310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.215633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1135/2280] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:52:58 2022] DELETE /identity/v3/projects/6ce705c5cb094b62a7badf762c5696d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:52:59.216494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:59.239495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f6db-04fb-4cd2-aeea-1973bd74209b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:59.383934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:59.412581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:59.413408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:59.413837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:59.414120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] PATH_INFO: `/v3/users/e0805476769c435d9620e8b3da2170c5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:59.419866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0805476769c435d9620e8b3da2170c5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:59.421961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:59.541626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0805476769c435d9620e8b3da2170c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.542209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0805476769c435d9620e8b3da2170c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.565357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0805476769c435d9620e8b3da2170c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.607754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0805476769c435d9620e8b3da2170c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.625753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0805476769c435d9620e8b3da2170c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:52:59.634485 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1146/2281] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:59 2022] DELETE /identity/v3/users/e0805476769c435d9620e8b3da2170c5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:00.493756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:00.495924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:00.526926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ff380-e94b-48fd-8f21-a51fdbaa7260 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:00.671349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:00.672877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:00.673394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:00.673888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] PATH_INFO: `/v3/projects/f83ac789f4d94dd1b4285443defab881` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:00.676991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83ac789f4d94dd1b4285443defab881)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:00.679607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:00.800892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83ac789f4d94dd1b4285443defab881', 'request_id': 'req-7f85446c-0569-47cd-8b0d-708ea901f7ce'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:00.831267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83ac789f4d94dd1b4285443defab881', 'request_id': 'req-7f85446c-0569-47cd-8b0d-708ea901f7ce'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:00.845247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83ac789f4d94dd1b4285443defab881', 'request_id': 'req-7f85446c-0569-47cd-8b0d-708ea901f7ce'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:00.875830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:00.880172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] The token cache is being invalidate because project f83ac789f4d94dd1b4285443defab881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:00.880554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:00.889016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:00.891588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1136/2282] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:00 2022] DELETE /identity/v3/projects/f83ac789f4d94dd1b4285443defab881 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:00.895118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:00.897221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:00.935525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda6bc-05ad-445b-a1f8-0679d15c5395 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:01.134964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:01.135954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:01.136397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:01.136966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] PATH_INFO: `/v3/users/ce697dfa33564f178f2cbe5c1000ff9b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:01.145598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce697dfa33564f178f2cbe5c1000ff9b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:01.147872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:01.292443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce697dfa33564f178f2cbe5c1000ff9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:01.297232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce697dfa33564f178f2cbe5c1000ff9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:01.319816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce697dfa33564f178f2cbe5c1000ff9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:01.388820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:01.391568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce697dfa33564f178f2cbe5c1000ff9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:01.408957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec7b5e96-2bcd-4d57-a744-9b0a81656562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce697dfa33564f178f2cbe5c1000ff9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:01.428373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1147/2283] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:00 2022] DELETE /identity/v3/users/ce697dfa33564f178f2cbe5c1000ff9b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:01.736151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:01.738350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:01.806209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85446c-0569-47cd-8b0d-708ea901f7ce admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.010088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.011261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.011813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.012288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] PATH_INFO: `/v3/projects/a8302aeb67eb4771b9626fe5423465b2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.017435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8302aeb67eb4771b9626fe5423465b2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.023463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.094720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8302aeb67eb4771b9626fe5423465b2', 'request_id': 'req-26b43ec4-a9be-4f6c-8811-587a25c7baf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:02.107354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8302aeb67eb4771b9626fe5423465b2', 'request_id': 'req-26b43ec4-a9be-4f6c-8811-587a25c7baf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:02.116004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8302aeb67eb4771b9626fe5423465b2', 'request_id': 'req-26b43ec4-a9be-4f6c-8811-587a25c7baf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:02.131866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] The token cache is being invalidate because project a8302aeb67eb4771b9626fe5423465b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:02.132182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:02.133138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-26b43ec4-a9be-4f6c-8811-587a25c7baf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:02.137162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1137/2284] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:01 2022] DELETE /identity/v3/projects/a8302aeb67eb4771b9626fe5423465b2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:02.142121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.142553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.142637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.181911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:02.191000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:02.316846 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1148/2285] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:02.324407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.324813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.325097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.370315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:02.371850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:02.381664 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1138/2286] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:02.386237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.407569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca9267-46c5-4506-b7d5-f180e50b4370 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.431460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.432273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.432581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.432884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.434274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:02.434609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.453869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.496088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.508596 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1149/2287] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:02.512527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08662585-a5ba-41e1-90ee-1b91933a34bf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.523553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.524240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.524552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.524847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.526237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.528260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.601271 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1139/2288] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:02 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:02.605805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.625878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebdd1b-f83b-4cd3-914d-6d4af9527ccd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.745489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.746195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.746479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.746756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.747505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.749596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.780278 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1150/2289] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:02 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:02.781584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.794185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cfeb5-76e3-49aa-8b8f-c3468e3b1f73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.800073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.801154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.801636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.802116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.810785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.812905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.836470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1140/2290] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:02.838473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.850422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2db1-119b-4f31-80a7-aa43075317e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.856912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.858091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.858371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.858644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.859459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.861286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fba92-1c70-4343-9387-1feb55145f86 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.877458 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1151/2291] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:02.878696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:02.892277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4df15-61f2-4505-bb40-3986b3bab185 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:02.900131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:02.901554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.902091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.902843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] PATH_INFO: `/v3/projects/eb6499ee6450404e8c1c4c5a35b4016c/users/a1134b041efc483fade32543de50ba26/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:02.923376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6499ee6450404e8c1c4c5a35b4016c, user_id=a1134b041efc483fade32543de50ba26, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:02.927836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:02.961056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1141/2292] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:02 2022] PUT /identity/v3/projects/eb6499ee6450404e8c1c4c5a35b4016c/users/a1134b041efc483fade32543de50ba26/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:02.963744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:02.964281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:02.964878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.007080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] MFA Rules not processed for user `a1134b041efc483fade32543de50ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:03.008575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:03.057942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:03.098366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1152/2293] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:03.098857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.138372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:03.187442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061a9ea-09bd-4bc2-8e16-a61ae1e7901f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.192909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.193639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.193924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.194347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.195045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.197531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a51ed-4308-4f11-8452-1ec96ac76fbf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.268983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1142/2294] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:03 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:03.270220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.290610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6e54c-866f-463e-9ddd-cebfd5e746aa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.409603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.410677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.411580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.412344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.413581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.416382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.454895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.455256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.455598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.468097 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1153/2295] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:03 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:03.472293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.487547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14d35-fb97-4677-9067-de56c4c82a55 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.494597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.496239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.496907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.497563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.502138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.504102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.520617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1154/2296] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:03.524480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.537394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] MFA Rules not processed for user `33d0756150114bc7bd3f6f72b93cb56a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:03.539517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:03.545039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab44ea-99a0-4a09-82f6-28fa582d7cef admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.552142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.553637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.554221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.554715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] PATH_INFO: `/v3/projects/93b4f2e0b07045258b5e52ba49afb39f/users/d73a087b73bc48bcbfca76250bce5c81/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.626035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b4f2e0b07045258b5e52ba49afb39f, user_id=d73a087b73bc48bcbfca76250bce5c81, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.629447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.657915 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1155/2297] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:03 2022] PUT /identity/v3/projects/93b4f2e0b07045258b5e52ba49afb39f/users/d73a087b73bc48bcbfca76250bce5c81/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:03.661639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.726877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1143/2298] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:03.732152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.733788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:03.775175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55d54-c041-496b-9b9a-2812f95e0e87 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.851073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece57890-173c-4325-8b4e-769e168fbfe4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.856387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.857104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.857392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.857719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.858486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.860124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.896962 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1156/2299] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:03.898345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:03.909883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ecfa7-6349-4349-8e14-1cc74e04c38e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:03.918055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.918966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.919251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.919525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] PATH_INFO: `/v3/projects/93b4f2e0b07045258b5e52ba49afb39f/users/d73a087b73bc48bcbfca76250bce5c81/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.927617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b4f2e0b07045258b5e52ba49afb39f, user_id=d73a087b73bc48bcbfca76250bce5c81, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.930659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf42bc-cd57-48a0-8b5c-ba7d9eb3bb88 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.949665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:03.950499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.950793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.951077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:03.959924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1157/2300] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:03 2022] PUT /identity/v3/projects/93b4f2e0b07045258b5e52ba49afb39f/users/d73a087b73bc48bcbfca76250bce5c81/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:03.960153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:03.960153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:03.964920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:03.965221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:03.965483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.047118 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1144/2301] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:03 2022] POST /identity/v3/projects => generated 403 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:04.048103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.051739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] MFA Rules not processed for user `d73a087b73bc48bcbfca76250bce5c81`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:04.053406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:04.065780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:04.079991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:04.146554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:04.284777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e59c-ccb8-4203-af3c-9112d635d7cc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:04.305826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:04.306591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.312028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.312363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] PATH_INFO: `/v3/projects/5d350253901443f4b5f7cf70dd9edc4d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.318277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d350253901443f4b5f7cf70dd9edc4d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:04.320255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:04.338672 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1158/2302] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:04.339591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.361735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285fabf-0006-4e47-9aa9-6d49f562acfc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:04.378599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:04.379345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.379598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.379827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.384113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:04.388202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:04.445773 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1159/2303] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:04 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:04.449259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.462593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446dfc5-5e71-4130-9941-76817f0e789b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:04.465524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d350253901443f4b5f7cf70dd9edc4d', 'request_id': 'req-16772037-a40c-4cbf-a952-5aca3dbcdb45'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:04.487548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d350253901443f4b5f7cf70dd9edc4d', 'request_id': 'req-16772037-a40c-4cbf-a952-5aca3dbcdb45'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:04.500956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d350253901443f4b5f7cf70dd9edc4d', 'request_id': 'req-16772037-a40c-4cbf-a952-5aca3dbcdb45'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:04.532043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] The token cache is being invalidate because project 5d350253901443f4b5f7cf70dd9edc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:04.532410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:04.534082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16772037-a40c-4cbf-a952-5aca3dbcdb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:04.541132 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1145/2304] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:04 2022] DELETE /identity/v3/projects/5d350253901443f4b5f7cf70dd9edc4d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:04.542726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463980e6-a89d-46c5-bdeb-bf77bb275668 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.543062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463980e6-a89d-46c5-bdeb-bf77bb275668 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.544377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463980e6-a89d-46c5-bdeb-bf77bb275668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.585571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-463980e6-a89d-46c5-bdeb-bf77bb275668 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:04.585571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-463980e6-a89d-46c5-bdeb-bf77bb275668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:04.661436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:04.663818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.664286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.665002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.666634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:04.670531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:04.711978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1160/2305] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:04.718788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.726130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:04.767887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337156-d1ae-4d5c-954c-61068ec6efc2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:04.780739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1146/2306] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:04.783104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:04.784268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.784933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.785431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] PATH_INFO: `/v3/projects/93b37eb8c15148799cec309889c357e1/users/cc0670c25dc5443db0107674ace9b3d5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.788832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:04.790283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:04.790591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:04.847698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:04.850082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:04.851721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b37eb8c15148799cec309889c357e1, user_id=cc0670c25dc5443db0107674ace9b3d5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:04.856033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:04.861861 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1147/2307] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:04.868906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.887157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1161/2308] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:04 2022] PUT /identity/v3/projects/93b37eb8c15148799cec309889c357e1/users/cc0670c25dc5443db0107674ace9b3d5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:04.891015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:04.892549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bb876-cd9c-47c5-b491-09ecdfcdc6de None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.012720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:05.036604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.037219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.037502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.037776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.038721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:05.038848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.040411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.069556 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1148/2309] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:05.074338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.080049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:05.083335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac23a-6134-46ee-a516-992075928793 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.097516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.098397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.098802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.099176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.100134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.103553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.110523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:05.128690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1162/2310] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:05.128690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.139887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00578c83-b022-463c-9337-ce3625ecdd57 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.145639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.147991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.148470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.148767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.149578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.151797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.190423 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1163/2311] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:05 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:05.191406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.272653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17662948-09d7-420e-beff-4e016123f651 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.377969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35ae9-ca3a-47cc-ba2f-b828aaf13f18 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.391485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.392757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.393049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.393423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] PATH_INFO: `/v3/projects/93b37eb8c15148799cec309889c357e1/users/cc0670c25dc5443db0107674ace9b3d5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.397487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b37eb8c15148799cec309889c357e1, user_id=cc0670c25dc5443db0107674ace9b3d5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.401454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.417956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1164/2312] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:05 2022] PUT /identity/v3/projects/93b37eb8c15148799cec309889c357e1/users/cc0670c25dc5443db0107674ace9b3d5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:05.419179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.429677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.430359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.430644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.430952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.442979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:05.528115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aaa9d-31d1-49aa-8b16-3682999b8f25 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.537669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.538601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.539206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.539552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.540458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.543297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.574724 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1165/2313] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:05 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:05.580188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.594838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.596604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.607746 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1149/2314] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:05.609111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c87f-c73d-475d-a9ae-649ec482ea2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.621474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.622203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.622486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.622762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.637317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.641814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.689210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1166/2315] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:05.693077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.727302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860659-de8b-41ef-a9d3-bc4bf19e0dfe service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.746301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.747023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.750195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.750529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.751350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.755292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d2e0c-9804-4c5e-abef-dea687f559cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.807529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1150/2316] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:05.812954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:05.827776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210d9d-1e44-45f0-986e-7badd1db5d22 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:05.848483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:05.849387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.849779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.850010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] PATH_INFO: `/v3/projects/c8850e182ca148cb99d4eb414eb7c08d/users/e9c6e12528ea4760bed65f994df57783/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.897828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8850e182ca148cb99d4eb414eb7c08d, user_id=e9c6e12528ea4760bed65f994df57783, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:05.900957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:05.931916 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1167/2317] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:05 2022] PUT /identity/v3/projects/c8850e182ca148cb99d4eb414eb7c08d/users/e9c6e12528ea4760bed65f994df57783/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:05.938514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:05.938809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:05.939084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:05.948017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:05.978727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:05.983776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:06.158812 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1151/2318] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:06.199631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:06.201652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:06.273157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:06.346098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63abd-4980-4895-b579-c4a3539dd068 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:06.359060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:06.359890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:06.360146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:06.360486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:06.390219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:06.391760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782cf69-3dd6-4b25-a2b0-ffe56d39820d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:06.422343 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1168/2319] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:06.973407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:06.974853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:07.006127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4318-1eb2-466e-892c-8d8ce9233f5a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:07.026238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:07.027836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:07.028122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:07.028400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] PATH_INFO: `/v3/users/a1134b041efc483fade32543de50ba26` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:07.029692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1134b041efc483fade32543de50ba26)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:07.031661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:07.154828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1134b041efc483fade32543de50ba26'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:07.171263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1134b041efc483fade32543de50ba26'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:07.209111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1134b041efc483fade32543de50ba26'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:07.210697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1134b041efc483fade32543de50ba26'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:07.211716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1134b041efc483fade32543de50ba26'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:07.239992 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1152/2320] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:06 2022] DELETE /identity/v3/users/a1134b041efc483fade32543de50ba26 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:07.245194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:07.245786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:07.246273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:07.280993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:07.289265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:07.428960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1169/2321] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:07.499265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:07.501422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:07.594401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d9c3-a386-4e98-9c41-a491fcdce8be admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:07.609562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:07.610409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:07.610734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:07.611030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:07.628460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:07.630564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:07.650116 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1153/2322] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:09.779839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:09.781921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:09.799894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a4c5-0667-404a-8b4c-41341cb9c762 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:09.806396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:09.807952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:09.808568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:09.809415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] PATH_INFO: `/v3/projects/eb6499ee6450404e8c1c4c5a35b4016c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:09.811622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6499ee6450404e8c1c4c5a35b4016c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:09.815921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:09.957433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6499ee6450404e8c1c4c5a35b4016c', 'request_id': 'req-84a8b1b4-ad82-4593-a352-81639354ed55'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:09.974426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6499ee6450404e8c1c4c5a35b4016c', 'request_id': 'req-84a8b1b4-ad82-4593-a352-81639354ed55'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:09.991722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6499ee6450404e8c1c4c5a35b4016c', 'request_id': 'req-84a8b1b4-ad82-4593-a352-81639354ed55'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.019100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] The token cache is being invalidate because project eb6499ee6450404e8c1c4c5a35b4016c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:10.019719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.020875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.024285 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1170/2323] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:09 2022] DELETE /identity/v3/projects/eb6499ee6450404e8c1c4c5a35b4016c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:10.028692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:10.047546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f1a6-42ff-466d-9132-2e93d3f839c0 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:10.092525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:10.194457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:10.195373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:10.195656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:10.195934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] PATH_INFO: `/v3/users/d73a087b73bc48bcbfca76250bce5c81` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:10.198200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73a087b73bc48bcbfca76250bce5c81)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:10.200441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:10.305388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:10.307498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73a087b73bc48bcbfca76250bce5c81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.307625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:10.320286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73a087b73bc48bcbfca76250bce5c81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.332957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8b1b4-ad82-4593-a352-81639354ed55 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:10.337368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73a087b73bc48bcbfca76250bce5c81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.339396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73a087b73bc48bcbfca76250bce5c81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.340350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b07540f-1205-4580-acc1-e01a8759984f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73a087b73bc48bcbfca76250bce5c81'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.341008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:10.342482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:10.342841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:10.343168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] PATH_INFO: `/v3/users/259e4c3f5ff24d5b955ec36009319598` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:10.344581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=259e4c3f5ff24d5b955ec36009319598)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:10.346731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:10.360834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1154/2324] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:10 2022] DELETE /identity/v3/users/d73a087b73bc48bcbfca76250bce5c81 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:10.413368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:10.415526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259e4c3f5ff24d5b955ec36009319598'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.416304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259e4c3f5ff24d5b955ec36009319598'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.428612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259e4c3f5ff24d5b955ec36009319598'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.474258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259e4c3f5ff24d5b955ec36009319598'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.484524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259e4c3f5ff24d5b955ec36009319598'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:10.505906 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1171/2325] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:10 2022] DELETE /identity/v3/users/259e4c3f5ff24d5b955ec36009319598 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:10.510069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:10.510360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:10.510966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:10.544134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:10.546758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:10.659953 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1155/2326] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:10.686993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:10.688552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:10.815373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74ee61-52d1-4a97-b3c1-dc288bfcf2cb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:10.829559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:10.830225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:10.830537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:10.830847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:10.846301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:10.847909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:10.862490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1172/2327] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:11.356550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:11.359788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:11.398656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eafee-dc76-499a-bc43-f2a1d97e10fa None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:11.414719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:11.415657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:11.415938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:11.416466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] PATH_INFO: `/v3/projects/fb34595547bf4acc9abbb87c043554ca` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:11.419267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb34595547bf4acc9abbb87c043554ca)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:11.421627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:11.539099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:11.565328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb34595547bf4acc9abbb87c043554ca', 'request_id': 'req-41b7e1b6-f08f-4465-8f99-db330f8b908c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.579052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb34595547bf4acc9abbb87c043554ca', 'request_id': 'req-41b7e1b6-f08f-4465-8f99-db330f8b908c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.587770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb34595547bf4acc9abbb87c043554ca', 'request_id': 'req-41b7e1b6-f08f-4465-8f99-db330f8b908c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.601172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] The token cache is being invalidate because project fb34595547bf4acc9abbb87c043554ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:11.601592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.602381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.607827 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1156/2328] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:11 2022] DELETE /identity/v3/projects/fb34595547bf4acc9abbb87c043554ca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:11.609871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:11.718007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4fd15-3624-434c-89fd-aea2d38ee2b8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:11.891269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:11.893258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:11.893556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:11.893984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] PATH_INFO: `/v3/users/d6bfa817f7b14b84a07bd6652fe0466d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:11.896715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bfa817f7b14b84a07bd6652fe0466d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:11.899626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:11.973574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bfa817f7b14b84a07bd6652fe0466d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.975559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bfa817f7b14b84a07bd6652fe0466d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:11.990271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bfa817f7b14b84a07bd6652fe0466d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.019661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:12.021591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:12.025713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:12.034550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bfa817f7b14b84a07bd6652fe0466d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.052049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7e1b6-f08f-4465-8f99-db330f8b908c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:12.093473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:12.094640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.095104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.095529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] PATH_INFO: `/v3/projects/93b4f2e0b07045258b5e52ba49afb39f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.095756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f17c37bc-9877-4fe9-aed5-3692077482d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bfa817f7b14b84a07bd6652fe0466d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.099907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b4f2e0b07045258b5e52ba49afb39f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:12.102057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:12.126076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1173/2329] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:11 2022] DELETE /identity/v3/users/d6bfa817f7b14b84a07bd6652fe0466d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:12.267968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b4f2e0b07045258b5e52ba49afb39f', 'request_id': 'req-3214bf80-2db0-44d8-9869-2191d30964d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.284156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b4f2e0b07045258b5e52ba49afb39f', 'request_id': 'req-3214bf80-2db0-44d8-9869-2191d30964d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.298336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b4f2e0b07045258b5e52ba49afb39f', 'request_id': 'req-3214bf80-2db0-44d8-9869-2191d30964d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.335464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] The token cache is being invalidate because project 93b4f2e0b07045258b5e52ba49afb39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:12.335464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.335464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3214bf80-2db0-44d8-9869-2191d30964d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:12.347135 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1157/2330] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:12 2022] DELETE /identity/v3/projects/93b4f2e0b07045258b5e52ba49afb39f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:12.349269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.349563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.349847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.390239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:12.393981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:12.578060 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1174/2331] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:12.587406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.588616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.588616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.640167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:12.646911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:12.678757 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1158/2332] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:12.683643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:12.711320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b44c-455c-409d-9e1d-bdfc9b3a65f0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:12.727780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:12.728542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.728832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.729118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.729946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:12.730281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:12.732022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7b72f-f7c4-4c6b-98cb-cf4d82a1e9d4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:12.759221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1175/2333] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:12.764284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:12.774907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8464eb-87fa-4620-a8f3-a994720f41af None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:12.777670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2654-3085-4e71-a9cc-d567ae069695 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.778081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2654-3085-4e71-a9cc-d567ae069695 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.778563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2654-3085-4e71-a9cc-d567ae069695 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.783681 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1176/2334] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:53:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:12.799759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:12.803078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.804232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.804753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.805674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:12.808385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:12.892273 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1159/2335] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:12 2022] POST /identity/v3/projects => generated 397 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:12.897182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:12.903469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:12.904019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:12.904131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:12.956112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:12.962058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.035247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56087d-0493-4892-97d7-faad612ff59a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.042264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.044144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.044819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.045562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.047139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.049820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.093305 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1160/2336] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:12 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:13.097165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.132715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d622-8284-413f-92eb-8c41c949ba6f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.140900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.142147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1177/2337] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:13.142511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.143441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.144748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.145790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.148645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.150916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=12,keystone:SELECT=82,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:13.194903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1161/2338] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:13.197723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.239686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6afcb2-61f6-42bc-8007-330d04110d5b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.251322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.252958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.254111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.254584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.255641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.258771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.263310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.269000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.310342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1178/2339] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:13.320561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11501cc5-ad7c-4490-a1af-228324a2fc98 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.331621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.332264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.332405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.332590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.332872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.357702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.359348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.360669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5885020-4e89-4508-b1d9-086ff6d070a9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.378042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.378965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.379244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.379518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] PATH_INFO: `/v3/projects/2ea2dec6873942569910686295de2392/users/6addf702bb774eef8b543482b6ea1908/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.379754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1162/2340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:13.395464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.396704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.429017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea2dec6873942569910686295de2392, user_id=6addf702bb774eef8b543482b6ea1908, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.432685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8691b9-dcb0-4318-bcda-41b29c327795 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.433066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c4079-accd-4ce9-8901-000de982ecd4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.445627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:13.446580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.446840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.447115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] PATH_INFO: `/v3/users/50a75def6fb349428da65572e0a55516` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.449311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a75def6fb349428da65572e0a55516)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:13.451322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:13.473793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1179/2341] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:13 2022] PUT /identity/v3/projects/2ea2dec6873942569910686295de2392/users/6addf702bb774eef8b543482b6ea1908/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:13.477877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.478178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.478498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.568314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] MFA Rules not processed for user `6addf702bb774eef8b543482b6ea1908`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:13.570175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.603218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a75def6fb349428da65572e0a55516'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:13.616896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:13.622754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a75def6fb349428da65572e0a55516'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:13.645493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a75def6fb349428da65572e0a55516'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:13.646973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a75def6fb349428da65572e0a55516'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:13.647911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a0c424d-acae-43e8-ad30-95fcb5aff256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a75def6fb349428da65572e0a55516'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:13.683977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1163/2342] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:13 2022] DELETE /identity/v3/users/50a75def6fb349428da65572e0a55516 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:13.688659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:13.689707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:13.689707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:13.742311 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1180/2343] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:13.746601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.748452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.752029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:13.761026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:13.943834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d452-dff0-41c1-bfe7-25fae6674e6b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:13.973192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1164/2344] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:13.974367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:13.977586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.002267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d30a0-ee1c-4b27-b1a8-db5d4b3a0e68 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.017408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.018327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.018599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.018888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] PATH_INFO: `/v3/projects/8619324782ff425faf4367cfa4e5d7ef` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.021469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8619324782ff425faf4367cfa4e5d7ef)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.027219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.112377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.113457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.114154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.114693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.115589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.121422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.160320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8619324782ff425faf4367cfa4e5d7ef', 'request_id': 'req-042d6f3c-f3b5-44ec-a513-7c6251845d60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:14.162230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:14.177657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8619324782ff425faf4367cfa4e5d7ef', 'request_id': 'req-042d6f3c-f3b5-44ec-a513-7c6251845d60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:14.196230 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1181/2345] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:13 2022] POST /identity/v3/projects => generated 397 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:14.197203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.200043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8619324782ff425faf4367cfa4e5d7ef', 'request_id': 'req-042d6f3c-f3b5-44ec-a513-7c6251845d60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:14.204443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.236332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] The token cache is being invalidate because project 8619324782ff425faf4367cfa4e5d7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:14.237131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:14.238149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:14.245292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1165/2346] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:13 2022] DELETE /identity/v3/projects/8619324782ff425faf4367cfa4e5d7ef => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:14.245292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.252072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.360008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d6fa-236a-47da-9c08-a3885acb896c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.366997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.368628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.370976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.371464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.384702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.396531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d6f3c-f3b5-44ec-a513-7c6251845d60 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.399188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:14.566369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.567477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.567765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.568065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.569791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.572896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.580384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.580384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee15e8-7e1f-4725-bbab-20d0ceaf8ea3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.605283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1182/2347] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:14.606825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f90f-7ae9-4adb-9014-5884a42e7881 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.607122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f90f-7ae9-4adb-9014-5884a42e7881 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.607407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419f90f-7ae9-4adb-9014-5884a42e7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.635247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1166/2348] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:14 2022] POST /identity/v3/users => generated 305 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:14.638455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7419f90f-7ae9-4adb-9014-5884a42e7881 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:14.639606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7419f90f-7ae9-4adb-9014-5884a42e7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.640331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.655844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b397-0815-4af6-9cb9-29d91ea79d98 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.669805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.670265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.670558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.670852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.671575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.675325 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1183/2349] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:14.683531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.683828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.684112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.688259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.722168 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1167/2350] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:14.727144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.739810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:14.742129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:14.758967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10374c-558c-4a7c-8bb7-770919ad7b29 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.776393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.787992 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1184/2351] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:14.789047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.793666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.794057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.794352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] PATH_INFO: `/v3/projects/31d62422053d49e1af356e08f5c2a0b7/users/22e5a738cf984400ad27b506b025e218/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.845702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7bb3-00dd-4d8b-a2bc-77da289431b5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.860498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d62422053d49e1af356e08f5c2a0b7, user_id=22e5a738cf984400ad27b506b025e218, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.861248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:14.862071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:14.862259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:14.862483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:14.863231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:14.864929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:14.866615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.867191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:14.894949 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1185/2352] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:14.904582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1168/2353] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:14 2022] PUT /identity/v3/projects/31d62422053d49e1af356e08f5c2a0b7/users/22e5a738cf984400ad27b506b025e218/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:14.905494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.908457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:14.931766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635ac9-0d5e-4996-8a0e-01eb0a8f6c0f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:14.985036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:15.015194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028ab6-4c57-4ada-be6a-081d468acae2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.017949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.018649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.018940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.019222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.019941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.020930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.021738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.021986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.022191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.022583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.023913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.026006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.041554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1169/2354] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:15.042806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.060531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc393b-4e68-4f97-b553-a401ebff526f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.066812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.067782 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1186/2355] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:14 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:15.071631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.072004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.072365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] PATH_INFO: `/v3/projects/31d62422053d49e1af356e08f5c2a0b7/users/22e5a738cf984400ad27b506b025e218/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.073347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.075358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d62422053d49e1af356e08f5c2a0b7, user_id=22e5a738cf984400ad27b506b025e218, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.078370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13ca7c-757f-4c12-935e-6b0aa36d7e71 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.100413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1170/2356] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:15 2022] PUT /identity/v3/projects/31d62422053d49e1af356e08f5c2a0b7/users/22e5a738cf984400ad27b506b025e218/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:15.103086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.104499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.105010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.163222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] MFA Rules not processed for user `22e5a738cf984400ad27b506b025e218`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:15.165857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:15.203292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4d54-8a6e-4477-afa5-0b5d31cfd89d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.209477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:15.322093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.322994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.323452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.324314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.326991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.329605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.344132 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1171/2357] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:15.355263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.357292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:15.382570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1187/2358] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:15 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:15.383726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.403949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a29576-51ec-4e6d-b06f-840157091594 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.420288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.421191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.421614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.421987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.422835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.429548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.454400 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1188/2359] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:15.462667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.484892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de744-f1cb-43b7-8126-d6caf014a91e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.498698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.500622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.501012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.501391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.503862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.509456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.515224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e6304-70b2-42ad-9e1e-649e1e1ee7d0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.530672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.531395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.531679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.531956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.535514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:15.539181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1189/2360] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:15.540440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.564883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d9e65-5f51-4e8c-9151-a74506cbb7eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.582441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.586749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.587143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.587524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] PATH_INFO: `/v3/projects/b520b7f3bb474c65be467a38d457a033/users/38af0fbf13e245428bd1e2953e3df701/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.606378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:15.635136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b520b7f3bb474c65be467a38d457a033, user_id=38af0fbf13e245428bd1e2953e3df701, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.638100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835561e-1d57-42ee-8c2c-220fe00e3593 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.660115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.662348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.670075 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1190/2361] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:15 2022] PUT /identity/v3/projects/b520b7f3bb474c65be467a38d457a033/users/38af0fbf13e245428bd1e2953e3df701/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:15.679543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1172/2362] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:15.681814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.682199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.682651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.711996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.714674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:15.742756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5b28c-7052-453f-9776-3e2e82436677 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.765842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] MFA Rules not processed for user `38af0fbf13e245428bd1e2953e3df701`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:15.767363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:15.869165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.870988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.871296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.871576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] PATH_INFO: `/v3/projects/16bcac6970c1483ab891f5d019ab5275` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.874301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bcac6970c1483ab891f5d019ab5275)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.878590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.957881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bcac6970c1483ab891f5d019ab5275', 'request_id': 'req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:15.969913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bcac6970c1483ab891f5d019ab5275', 'request_id': 'req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:15.991555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bcac6970c1483ab891f5d019ab5275', 'request_id': 'req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:15.999772 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1191/2363] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:16.005989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.024124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025423a9-57f4-47c7-8147-d39433cff488 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.027103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] The token cache is being invalidate because project 16bcac6970c1483ab891f5d019ab5275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:16.027401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.029824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.037515 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1173/2364] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:15 2022] DELETE /identity/v3/projects/16bcac6970c1483ab891f5d019ab5275 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:16.045467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.047051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:16.080190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.105110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.106027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.106439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.106795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.108066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.110482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.156461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1192/2365] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:16 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:16.160271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.163906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:16.177785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46bd6-a3f8-4d27-a69d-f86d8ebbbe4e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.226746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.289463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d549e-9645-415b-93a2-59683f91ef54 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.290884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.292590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.292892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.293175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] PATH_INFO: `/v3/users/312a1a7fb6ed410190f6e35af0e83a1c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.294932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=312a1a7fb6ed410190f6e35af0e83a1c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.297560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.305637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.306362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.306658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.306930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.307638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.309686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.350742 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1193/2366] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:16 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:16.351666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.356674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:16.415232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312a1a7fb6ed410190f6e35af0e83a1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.429950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312a1a7fb6ed410190f6e35af0e83a1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.451146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312a1a7fb6ed410190f6e35af0e83a1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.453478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312a1a7fb6ed410190f6e35af0e83a1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.455155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312a1a7fb6ed410190f6e35af0e83a1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:16.492368 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1174/2367] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:16 2022] DELETE /identity/v3/users/312a1a7fb6ed410190f6e35af0e83a1c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:16.493525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.495180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:16.539210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53aa5-9be3-4ee7-947b-74dfba5445d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.667279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698c0c-b678-453d-bc90-220264c08dfe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.680876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.683871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.683871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.683871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.688266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.691093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.695297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.721310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1175/2368] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:16.725134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.732925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.733822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.734215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.735192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.739825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:16.750796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978a58e-8e62-4a33-8bfe-e6d461fc3c33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:16.765223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:16.766324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:16.768028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:16.768790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] PATH_INFO: `/v3/projects/91d4439535954b90b4f530e19ff44af3/users/b209ad1939f4403bbdc3a5d7c33e3c00/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:16.833816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d4439535954b90b4f530e19ff44af3, user_id=b209ad1939f4403bbdc3a5d7c33e3c00, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.841580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.875527 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1176/2369] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:16 2022] PUT /identity/v3/projects/91d4439535954b90b4f530e19ff44af3/users/b209ad1939f4403bbdc3a5d7c33e3c00/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:16.876665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:16.906195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.942422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:16.944145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:16.976261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1194/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:17.056839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ec12b-a2ff-41db-a892-78f3f6d679f2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:17.067410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:17.068268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:17.068688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:17.069081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:17.069913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:17.071681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951c7c5-329c-4277-9021-6893a36f00c0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:17.101796 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1177/2371] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:17.103020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:17.116923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f953-6fa1-4af7-89e7-8b4e82aa522c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:17.121947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:17.123459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:17.123809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:17.124099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] PATH_INFO: `/v3/projects/91d4439535954b90b4f530e19ff44af3/users/b209ad1939f4403bbdc3a5d7c33e3c00/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:17.126419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d4439535954b90b4f530e19ff44af3, user_id=b209ad1939f4403bbdc3a5d7c33e3c00, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:17.129316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:17.144467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1195/2372] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:17 2022] PUT /identity/v3/projects/91d4439535954b90b4f530e19ff44af3/users/b209ad1939f4403bbdc3a5d7c33e3c00/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:17.160512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:17.161830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:17.162213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:17.199637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] MFA Rules not processed for user `b209ad1939f4403bbdc3a5d7c33e3c00`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:17.201150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:17.311717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1178/2373] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:17.519641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:17.521731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:17.565555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:17.571928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:17.802685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea02fe-0c7b-43bb-b618-ac5697d4bcf9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:17.825740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5530f2-2bc3-402c-b461-edbb0cfc9f93 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:17.829635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:17.830564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:17.831622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:17.832616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:17.844040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:17.846152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:17.847186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:17.848188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:17.848826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] PATH_INFO: `/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:17.853656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d93e0e76056414e8fb8dae54dc5d9ef)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:17.858104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.043193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:18.077680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d93e0e76056414e8fb8dae54dc5d9ef', 'request_id': 'req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:18.085333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.089315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37472d-64f4-4371-840f-6b453cd71c78 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.103131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d93e0e76056414e8fb8dae54dc5d9ef', 'request_id': 'req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:18.114686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1196/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:18.115874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d93e0e76056414e8fb8dae54dc5d9ef', 'request_id': 'req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:18.134510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfca4b-3cfa-4516-8bed-94cf59922002 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.135125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfca4b-3cfa-4516-8bed-94cf59922002 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.135580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfca4b-3cfa-4516-8bed-94cf59922002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.151781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] The token cache is being invalidate because project 9d93e0e76056414e8fb8dae54dc5d9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:18.152862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:18.154170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f8a2488-ff5f-497e-a7c0-696aeadea7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:18.164009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1179/2375] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:17 2022] DELETE /identity/v3/projects/9d93e0e76056414e8fb8dae54dc5d9ef => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:18.167475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.168126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.168411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.175436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:18.223495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:18.225983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.227516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-19dfca4b-3cfa-4516-8bed-94cf59922002 None None] MFA Rules not processed for user `e9c6e12528ea4760bed65f994df57783`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:18.229295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-19dfca4b-3cfa-4516-8bed-94cf59922002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.303672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1180/2376] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:18.304619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.309468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.354132 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1197/2377] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:18.355576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.355864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.356141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.394961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:18.396125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.414002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1198/2378] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:18.415036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.416491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.433156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79616-78cd-400c-bdd5-3e00701abccb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.435846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb1142-c451-4a58-9e63-0d8592f576ab None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.442801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.443488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.443770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.444179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.444940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.445048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.445616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.445897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.446173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.447067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.450396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:18.497143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1199/2379] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:18.498609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.571413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.574013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.578404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:18.589237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1181/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:18.590326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.602850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0252-e673-42f1-8351-b161c9483239 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.608817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.609713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.610833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.611192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.612474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.614773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.616789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e7eb1-1693-4cb7-9d4c-af39d2ecb28a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.636295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.638065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.639421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.640859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.641783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:18.645267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.647716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.658633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1182/2381] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:18.660000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.676447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a729a4-d039-46d8-97cc-7af45c7f007d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.686991 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1200/2382] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:18.689349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.690802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.691826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.692256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.693110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.694241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.696342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.710387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5eeb-0910-4fb6-b744-c5ed0cf4d84f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.712052 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1183/2383] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:18.717628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.727294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.728788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.729252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.729716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.730831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.733718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.741779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84753-4f11-45cb-befc-03f709011aca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:18.757004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:18.758125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:18.758749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:18.759001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] PATH_INFO: `/v3/projects/a6d83afa5cc64025a9815a30ea1456a4/users/a9f3260e3ee44ff49fdde7cb320e1b89/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:18.772512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1201/2384] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:18.776444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.801165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d83afa5cc64025a9815a30ea1456a4, user_id=a9f3260e3ee44ff49fdde7cb320e1b89, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:18.812975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:18.846514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:18.850679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1184/2385] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:18 2022] PUT /identity/v3/projects/a6d83afa5cc64025a9815a30ea1456a4/users/a9f3260e3ee44ff49fdde7cb320e1b89/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:18.855045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:18.896053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf3bce-4d51-4d88-91b9-21d064703dac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.036326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84680-aa67-4c90-8305-041a97a6fae6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.036817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.037795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.038836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.039344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.040202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.042548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.047587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.048290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.049478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.049772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.050508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.056289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.076789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1202/2386] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:18 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:19.079579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.082238 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1185/2387] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:19.086990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.101329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019535-c0f2-48cb-8609-a08345b245ee admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.102918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74256ca-cf6a-489b-875f-4fa27a6ebe2b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.115840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.116105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.117251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.117759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.117912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.118665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.120361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.120547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.121005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] PATH_INFO: `/v3/projects/a6d83afa5cc64025a9815a30ea1456a4/users/a9f3260e3ee44ff49fdde7cb320e1b89/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.121823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.123701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d83afa5cc64025a9815a30ea1456a4, user_id=a9f3260e3ee44ff49fdde7cb320e1b89, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.129549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.136479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1203/2388] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:19.140693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.151032 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1186/2389] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:19 2022] PUT /identity/v3/projects/a6d83afa5cc64025a9815a30ea1456a4/users/a9f3260e3ee44ff49fdde7cb320e1b89/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:19.153368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce7c1-bd95-4417-9de2-97f13c4fe226 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.289988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.290865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.291154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.291488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.293364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.296364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839b650-cc3b-4da5-945c-1ed383c0623d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.322110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1204/2390] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:19.326066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.362706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c08a-85d6-457a-b079-c92216c7b959 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.377919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.379073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.381031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.381586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] PATH_INFO: `/v3/projects/29037675b33a4f318e1fcafc33b6bed5/users/c6773441662d41b2aecf9e43100633d3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.429338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=29037675b33a4f318e1fcafc33b6bed5, user_id=c6773441662d41b2aecf9e43100633d3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.432347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3856-f9e9-4c5d-a12d-29c90b1b4c9b None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.432934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3856-f9e9-4c5d-a12d-29c90b1b4c9b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.433220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3856-f9e9-4c5d-a12d-29c90b1b4c9b None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.434875 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1205/2391] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:19.435023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a589b-9921-4ea8-b491-61b79923deeb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.443132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.443569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.443972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.474691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1187/2392] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:19 2022] PUT /identity/v3/projects/29037675b33a4f318e1fcafc33b6bed5/users/c6773441662d41b2aecf9e43100633d3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:19.479409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.480844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.482154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.485530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:19.488031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:19.553863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:19.555396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:19.639019 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1206/2393] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:19.664388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:19.689304 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1188/2394] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:19.694625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.711500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.714747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:19.727405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:19.762290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b95a51-6d14-4796-b220-21ad9ae816a5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.778630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.779625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.780011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.780382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.810166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.812030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.832684 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1189/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:19.883190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e69d1d-6b88-4589-8363-dece7cd8b4a4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:19.904133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:19.906514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:19.906914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:19.907201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:19.911107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:19.914966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:19.970611 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1207/2396] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:19.974256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:19.993584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b20f5-a3f3-4a3d-ace5-68d032027dbe service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.169111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.169731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.169993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.170268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.170971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.172991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.202695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1190/2397] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:19 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:20.206408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:20.221613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b353c-49df-4036-bdd2-484d5dac448b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.234676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.236036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.236660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.237001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.238317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.246109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.263601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1208/2398] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:20.267639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:20.280038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982382b-404b-4482-9ad2-ba60b655391e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.287418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.288053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.288344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.288963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] PATH_INFO: `/v3/projects/7550b26198664271bfe44282f57c903e/users/9b6a41873bb54260900f520278dafe13/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.308408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7550b26198664271bfe44282f57c903e, user_id=9b6a41873bb54260900f520278dafe13, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.317314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24daf13-b91f-433d-aeb9-0b38d6477247 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.343155 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1191/2399] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:20 2022] PUT /identity/v3/projects/7550b26198664271bfe44282f57c903e/users/9b6a41873bb54260900f520278dafe13/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:20.347745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:20.369522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b83f5-3d6d-4733-a488-70db3011aff5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.387837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7482-e311-43d4-acca-bff364fe604a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.388168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7482-e311-43d4-acca-bff364fe604a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.388453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7482-e311-43d4-acca-bff364fe604a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.390309 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1192/2400] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:53:20.397953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924b1c-f738-420b-bc3b-015073db6c45 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.398335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924b1c-f738-420b-bc3b-015073db6c45 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.398620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924b1c-f738-420b-bc3b-015073db6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.427458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ef924b1c-f738-420b-bc3b-015073db6c45 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:20.428982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef924b1c-f738-420b-bc3b-015073db6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:20.486804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.487559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.487872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.488394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.489402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.491050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.541666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1209/2401] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:20.542991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:20.555014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdbd97-f93c-4b6f-a15c-1d2296272e26 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.580293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.585026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.587322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.588217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] PATH_INFO: `/v3/projects/7550b26198664271bfe44282f57c903e/users/9b6a41873bb54260900f520278dafe13/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.592191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7550b26198664271bfe44282f57c903e, user_id=9b6a41873bb54260900f520278dafe13, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.595875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.596967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1193/2402] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:20.620112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1210/2403] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:20 2022] PUT /identity/v3/projects/7550b26198664271bfe44282f57c903e/users/9b6a41873bb54260900f520278dafe13/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:20.630547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9569c-02af-4066-9500-35c693d07e86 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.630909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9569c-02af-4066-9500-35c693d07e86 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.631838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9569c-02af-4066-9500-35c693d07e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.635148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:20.646773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:20.718066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e3e9569c-02af-4066-9500-35c693d07e86 None None] MFA Rules not processed for user `9b6a41873bb54260900f520278dafe13`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:20.719543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3e9569c-02af-4066-9500-35c693d07e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:20.780335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:20.834774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793d09-f71e-47b3-abaa-c3cecba566d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:20.845436 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1194/2404] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:20.856130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.856535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.856962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.857347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:20.858086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:20.858434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:20.858776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:20.870642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:20.872569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:20.878536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:20.897112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1211/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:20.903990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:20.907256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.049126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:21.055853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.090833 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1195/2406] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:21.142013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:21.143713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.258300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e23c-59ed-4aaf-b805-ecac51cf0946 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:21.277192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:21.278202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:21.278440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:21.278712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] PATH_INFO: `/v3/users/6addf702bb774eef8b543482b6ea1908` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:21.280479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6addf702bb774eef8b543482b6ea1908)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:21.282674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:21.299891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80080-1e95-47e2-bee3-017711f39a22 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:21.317916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:21.318735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:21.319094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:21.320050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:21.335283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:21.343849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:21.366506 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1196/2407] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:21.367454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:21.386892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6addf702bb774eef8b543482b6ea1908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:21.389055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6addf702bb774eef8b543482b6ea1908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:21.409516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac0f72-7f7b-43c7-9ca7-53c17325dbcc service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:21.414309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6addf702bb774eef8b543482b6ea1908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:21.433479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:21.434238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:21.434522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:21.434795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:21.444477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.459268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6addf702bb774eef8b543482b6ea1908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:21.477814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:21.480613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b439fd9c-49c9-4240-9991-a64741af83f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6addf702bb774eef8b543482b6ea1908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:21.482003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:21.499145 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1212/2408] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:21 2022] DELETE /identity/v3/users/6addf702bb774eef8b543482b6ea1908 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:21.501376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a726b-1fe0-47b0-9f39-d2f3a8cd6f3e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:21.502747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a726b-1fe0-47b0-9f39-d2f3a8cd6f3e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:21.503035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a726b-1fe0-47b0-9f39-d2f3a8cd6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:21.516702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1197/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:21.586178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f16a726b-1fe0-47b0-9f39-d2f3a8cd6f3e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:21.589611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f16a726b-1fe0-47b0-9f39-d2f3a8cd6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.753717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1213/2410] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:21.780558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:21.782032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:21.892407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:21.917749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092761fc-62fe-43ec-bf63-c88719c6cf8b service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:22.032265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:22.032541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.032683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.032950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:22.059750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:22.061032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d602d-94e4-4089-a60c-1533e3723dea service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:22.084602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1198/2411] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:22.122105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.122397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.122678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:22.124245 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1214/2412] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:22.134792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358f8a-ddff-48c9-b807-c1edd6acd2cd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.135285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358f8a-ddff-48c9-b807-c1edd6acd2cd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.135381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358f8a-ddff-48c9-b807-c1edd6acd2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:22.166219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-58358f8a-ddff-48c9-b807-c1edd6acd2cd None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:22.171053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-58358f8a-ddff-48c9-b807-c1edd6acd2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:22.340126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1199/2413] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:22.560572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:22.563438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:22.591075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398dbec-02c2-4805-9037-89c2772d8135 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:22.600764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:22.601453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.601734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.601997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:22.629248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:22.633199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:22.658491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1215/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:22.726121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.726973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.727737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:22.783918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:22.785957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:22.808542 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1200/2415] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:22.931906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:22.948007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:22.962970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08a99b-b79a-4a3a-a2b1-ecb0ff8efe57 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:22.990742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:22.993420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:22.993739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:22.994024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:23.022995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:23.024509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:23.051169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1216/2416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:23.413675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:23.415510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:23.461441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35d671-7b67-4375-8415-4f2665ced94b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:23.478357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:23.479106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:23.479491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:23.480011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:23.487017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:23.637839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:23.639639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:23.668744 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1201/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:24.778693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:24.781487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:24.817447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf2870-c54f-4aa4-bbf2-dcf5da962847 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:24.834055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:24.854023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:24.854528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:24.855504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] PATH_INFO: `/v3/projects/2ea2dec6873942569910686295de2392` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:24.857567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea2dec6873942569910686295de2392)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:24.861400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:25.127482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea2dec6873942569910686295de2392', 'request_id': 'req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.164347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea2dec6873942569910686295de2392', 'request_id': 'req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.180853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea2dec6873942569910686295de2392', 'request_id': 'req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.216336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] The token cache is being invalidate because project 2ea2dec6873942569910686295de2392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:25.219114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.220304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.223506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1217/2418] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:24 2022] DELETE /identity/v3/projects/2ea2dec6873942569910686295de2392 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:25.227759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:25.247376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbefd8-3ed8-4905-b66e-8da295b24165 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:25.324721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:25.400619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:25.402722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:25.403841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:25.404393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] PATH_INFO: `/v3/users/22e5a738cf984400ad27b506b025e218` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:25.406509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e5a738cf984400ad27b506b025e218)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:25.409491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:25.552728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e5a738cf984400ad27b506b025e218'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.567907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e5a738cf984400ad27b506b025e218'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.600187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e5a738cf984400ad27b506b025e218'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.602097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e5a738cf984400ad27b506b025e218'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.603111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ef1d4c1-5e37-44c8-83e3-d24b48d4a7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e5a738cf984400ad27b506b025e218'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:25.627690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1202/2419] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:25 2022] DELETE /identity/v3/users/22e5a738cf984400ad27b506b025e218 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:26.745949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:26.749933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:26.773496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32c4e4-91b8-4fff-99a2-7c35cda680ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:26.930362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:26.931368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:26.932110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:26.932401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] PATH_INFO: `/v3/users/38af0fbf13e245428bd1e2953e3df701` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:26.936079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38af0fbf13e245428bd1e2953e3df701)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:26.938379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:27.043515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38af0fbf13e245428bd1e2953e3df701'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:27.044219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38af0fbf13e245428bd1e2953e3df701'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:27.062513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38af0fbf13e245428bd1e2953e3df701'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:27.087498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38af0fbf13e245428bd1e2953e3df701'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:27.106881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:27.113808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38af0fbf13e245428bd1e2953e3df701'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:27.130441 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1218/2420] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:26 2022] DELETE /identity/v3/users/38af0fbf13e245428bd1e2953e3df701 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:27.134836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46d1c-9cb7-4f7b-8b25-e00f649f5a7c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:27.135353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46d1c-9cb7-4f7b-8b25-e00f649f5a7c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:27.135647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46d1c-9cb7-4f7b-8b25-e00f649f5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:27.169217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ad46d1c-9cb7-4f7b-8b25-e00f649f5a7c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:27.173182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ad46d1c-9cb7-4f7b-8b25-e00f649f5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:27.315057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1203/2421] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:27.349137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:27.350904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:27.477965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76dca-576e-4be4-88ad-d22ef9f40220 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:27.482261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c465776-e68a-4687-990c-454253426928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:27.482943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c465776-e68a-4687-990c-454253426928 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:27.485517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c465776-e68a-4687-990c-454253426928 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:27.485816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c465776-e68a-4687-990c-454253426928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:27.500583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:27.500873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:27.501147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:27.505544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c465776-e68a-4687-990c-454253426928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:27.507192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c465776-e68a-4687-990c-454253426928 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:27.523329 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1219/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:27.572453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] MFA Rules not processed for user `cc0670c25dc5443db0107674ace9b3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:27.576084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:27.665123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:27.715198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1204/2423] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:27.726099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c465776-e68a-4687-990c-454253426928 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:27.728452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0c465776-e68a-4687-990c-454253426928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:27.877547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c465776-e68a-4687-990c-454253426928 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:27.888004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:27.890079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:27.890694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:27.891133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:27.893289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:27.998140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.000379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.016786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1220/2424] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:28.049350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:28.051901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.069816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:28.071649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.077254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaf2ca-e43b-4d6b-801e-7faa893e456e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:28.084537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:28.085520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.085997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.086285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.096741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.098996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e73fc-2fcd-4299-8fb8-08fb081d1613 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.104247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3ea81-de48-454a-987e-02b8cafdb7cc service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:28.117326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:28.118229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.118559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.118835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] PATH_INFO: `/v3/projects/31d62422053d49e1af356e08f5c2a0b7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.120281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d62422053d49e1af356e08f5c2a0b7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.122517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.146258 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1205/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:28.192885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:28.228545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d62422053d49e1af356e08f5c2a0b7', 'request_id': 'req-d3309a91-1b63-4e33-a86b-2c2a3469ec84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.243490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d62422053d49e1af356e08f5c2a0b7', 'request_id': 'req-d3309a91-1b63-4e33-a86b-2c2a3469ec84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.253400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d62422053d49e1af356e08f5c2a0b7', 'request_id': 'req-d3309a91-1b63-4e33-a86b-2c2a3469ec84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.305216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] The token cache is being invalidate because project 31d62422053d49e1af356e08f5c2a0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:28.305804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.306785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.310478 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1221/2426] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:28 2022] DELETE /identity/v3/projects/31d62422053d49e1af356e08f5c2a0b7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:28.316948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04362d8-6728-4668-b406-501004ea9792 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.317309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04362d8-6728-4668-b406-501004ea9792 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.317781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04362d8-6728-4668-b406-501004ea9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.351489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:28.353030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.355416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f04362d8-6728-4668-b406-501004ea9792 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:28.359907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f04362d8-6728-4668-b406-501004ea9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.499020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a91-1b63-4e33-a86b-2c2a3469ec84 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:28.517645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:28.518575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.518862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.519146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] PATH_INFO: `/v3/projects/b520b7f3bb474c65be467a38d457a033` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.520400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b520b7f3bb474c65be467a38d457a033)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.522466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.591574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1206/2427] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:28.594783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.595078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.595360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.638199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b520b7f3bb474c65be467a38d457a033', 'request_id': 'req-0aab992b-342f-4427-b26f-d7ec81254699'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.654473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b520b7f3bb474c65be467a38d457a033', 'request_id': 'req-0aab992b-342f-4427-b26f-d7ec81254699'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.661767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b520b7f3bb474c65be467a38d457a033', 'request_id': 'req-0aab992b-342f-4427-b26f-d7ec81254699'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.663349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:28.664894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.692293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] The token cache is being invalidate because project b520b7f3bb474c65be467a38d457a033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:28.692921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.694343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:28.709699 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1222/2428] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:28 2022] DELETE /identity/v3/projects/b520b7f3bb474c65be467a38d457a033 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:28.713996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:28.717982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:28.879738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:28.920798 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1207/2429] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:28.923488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:28.928293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab992b-342f-4427-b26f-d7ec81254699 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:28.945101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573f3fe-e603-4867-9c37-ef51dc26c158 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:28.946065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:28.948365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.948365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.948365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] PATH_INFO: `/v3/users/b209ad1939f4403bbdc3a5d7c33e3c00` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.949491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b209ad1939f4403bbdc3a5d7c33e3c00)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.954217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.968742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:28.969771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:28.970217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:28.970635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:28.971720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:28.972183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:28.974125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:28.989743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1208/2430] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:28.994461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:29.034002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08d6-0d91-4b91-83e8-a82ab9852e3b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:29.055123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:29.056103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.057797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.058086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.059996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:29.065517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:29.102308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b209ad1939f4403bbdc3a5d7c33e3c00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:29.107157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b209ad1939f4403bbdc3a5d7c33e3c00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:29.122977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1209/2431] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:28 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:29.124159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b209ad1939f4403bbdc3a5d7c33e3c00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:29.124441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:29.126332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:29.165279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b209ad1939f4403bbdc3a5d7c33e3c00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:29.189645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:29.192411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b209ad1939f4403bbdc3a5d7c33e3c00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:29.218728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1223/2432] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:28 2022] DELETE /identity/v3/users/b209ad1939f4403bbdc3a5d7c33e3c00 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:29.242007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda484f-8555-4cff-a8cf-fe431e082b17 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:29.367359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:29.368543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.368543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.368991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.369974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:29.372947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:29.407441 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1210/2433] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:29 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:29.408208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:29.430847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35c478-2eee-4c8d-9820-6e09e0c57739 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:29.441583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:29.442937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.443464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.444680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.446838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:29.451732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:29.483931 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1224/2434] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:29.490914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:29.509719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0bd8-119f-4ffb-ba37-3f602cb62124 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:29.527423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:29.528334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.528677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.529217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.529983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:29.533150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b218d1a-79ab-4353-a829-9de5eeb54182 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:29.553184 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1211/2435] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:29.553886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:29.567021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbea01-57f6-4ac8-89e4-f0b3f0c8f585 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:29.582089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:29.583798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.585130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.585426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] PATH_INFO: `/v3/projects/962e754e8e974d05b5e96340651842e5/users/ffe4dabb7447429182e985431ff616d9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.643308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962e754e8e974d05b5e96340651842e5, user_id=ffe4dabb7447429182e985431ff616d9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:29.646047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:29.678379 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1225/2436] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:29 2022] PUT /identity/v3/projects/962e754e8e974d05b5e96340651842e5/users/ffe4dabb7447429182e985431ff616d9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:29.692071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:29.692453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:29.692821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:29.737685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] MFA Rules not processed for user `ffe4dabb7447429182e985431ff616d9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:29.740012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:29.896063 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1212/2437] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:29.896255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.086899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ac606-682e-4135-bb95-863d7202d204 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.105058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.106536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.107200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.107708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.108766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.111236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.169766 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1226/2438] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:29 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:30.173704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.190813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ee48-2b98-40ae-8f96-9391e53eb72b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.278422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:30.324101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.324955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.326189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.327266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.328185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.338772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.414186 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1213/2439] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:30 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:30.419265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.447195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460ed9-0d57-41e2-8b4b-22063a1f12a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.453214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.454457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.454646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.454901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.455733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.466551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.491128 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1227/2440] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:30.496625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.506841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ed95-f761-4b25-ad7c-7819bcd513f0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.524800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.525933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.526500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.526500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] PATH_INFO: `/v3/projects/80876312770441c88fb6df3da674e5a4/users/9405a876b0124b62b58db6a42018ad6b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.559335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80876312770441c88fb6df3da674e5a4, user_id=9405a876b0124b62b58db6a42018ad6b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.562162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.593589 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1214/2441] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:30 2022] PUT /identity/v3/projects/80876312770441c88fb6df3da674e5a4/users/9405a876b0124b62b58db6a42018ad6b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:30.598964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.610013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:30.618622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6852a9-21ba-4af7-828a-92e1cbd717c3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.643223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.645809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:30.788517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.789421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.789930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.790319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.791245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.799713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.823268 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1228/2442] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:30.827558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:30.846104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122131b6-199d-4b31-8149-a6201a9e1eb8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.854557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.856232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.856552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.856839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] PATH_INFO: `/v3/projects/80876312770441c88fb6df3da674e5a4/users/9405a876b0124b62b58db6a42018ad6b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.879068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525d07c-4fe8-4e2b-8295-0f1950a67961 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:30.882304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80876312770441c88fb6df3da674e5a4, user_id=9405a876b0124b62b58db6a42018ad6b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.888759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dab512-2534-4989-b015-d49c4210c3b8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.901698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:30.902634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.902917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.903187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] PATH_INFO: `/v3/projects/91d4439535954b90b4f530e19ff44af3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:30.904542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d4439535954b90b4f530e19ff44af3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:30.906702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:30.936452 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1229/2443] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:30 2022] PUT /identity/v3/projects/80876312770441c88fb6df3da674e5a4/users/9405a876b0124b62b58db6a42018ad6b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:53:30.939339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:30.941856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:30.942384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.010770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] MFA Rules not processed for user `9405a876b0124b62b58db6a42018ad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:31.019713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:31.037945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d4439535954b90b4f530e19ff44af3', 'request_id': 'req-ce357711-5f21-46bb-b979-e7bf1091e9f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:31.057764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d4439535954b90b4f530e19ff44af3', 'request_id': 'req-ce357711-5f21-46bb-b979-e7bf1091e9f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:31.064842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d4439535954b90b4f530e19ff44af3', 'request_id': 'req-ce357711-5f21-46bb-b979-e7bf1091e9f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:31.095342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] The token cache is being invalidate because project 91d4439535954b90b4f530e19ff44af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:31.095640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:31.097461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce357711-5f21-46bb-b979-e7bf1091e9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:31.101621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1215/2444] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:30 2022] DELETE /identity/v3/projects/91d4439535954b90b4f530e19ff44af3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:31.107394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2cfd-e6d0-4292-901c-f88bc070eed3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.107394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2cfd-e6d0-4292-901c-f88bc070eed3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.107708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2cfd-e6d0-4292-901c-f88bc070eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.148440 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1230/2445] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:31.149612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.159892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb240de-6daf-4f01-b6c8-bccc9b6a5345 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.165300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.166007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.166292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.166583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.167391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:31.167538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-beed2cfd-e6d0-4292-901c-f88bc070eed3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:31.167696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.168735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-beed2cfd-e6d0-4292-901c-f88bc070eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:31.169490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.202580 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1231/2446] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:31.207828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.232310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601718-48b0-432f-a0c8-41286be745f1 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.237195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:31.243648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.246130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.246412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.246701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.247413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.256663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.313598 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1216/2447] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:31.321182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0656-2729-4d20-ae54-e68d99b56476 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.323170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0656-2729-4d20-ae54-e68d99b56476 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.325730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0656-2729-4d20-ae54-e68d99b56476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.341144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1232/2448] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:31.342142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.384053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-325a0656-2729-4d20-ae54-e68d99b56476 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:31.385408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-325a0656-2729-4d20-ae54-e68d99b56476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:31.463833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:31.506685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1217/2449] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:31.508565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8128cfa-c15c-4c5f-8fa5-cf31dc29304a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.509192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8128cfa-c15c-4c5f-8fa5-cf31dc29304a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.509648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8128cfa-c15c-4c5f-8fa5-cf31dc29304a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.511960 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1218/2450] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:31.513301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8128cfa-c15c-4c5f-8fa5-cf31dc29304a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.526669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2ea47-b282-4539-9078-52b1dd2356a7 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.538106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.542189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.543913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.544812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.547067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8128cfa-c15c-4c5f-8fa5-cf31dc29304a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.547476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:31.548535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.556651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d02883-d949-4267-bf1d-dc330c01d253 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.565671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.566859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.568191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.571390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.572744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:31.573176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.578364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.592873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1233/2451] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:31.594458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.594756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.595056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.614978 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1219/2452] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:31.617255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.629016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:31.630469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:31.642116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92028f-4f13-4952-a608-c64a60bc6770 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.653712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.654568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.654865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.655134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.655852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.665017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.739179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1220/2453] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:31.739725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1234/2454] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:31.743369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.793594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.796235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:31.897270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1426c86-edf5-4204-b84f-e0037fcd2d60 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.903164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.903969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.904330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.904927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.905722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.908026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.933051 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1221/2455] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:31 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:31.937522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.950219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792766-cc07-4cc2-b4fa-c4b83969b02a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.956011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.956867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.957221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.957574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:31.958380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:31.960978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:31.973826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1222/2456] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:31.978081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:31.989588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bccc4-9c85-4b4c-acf2-f601eceb4570 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:31.997449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:31.998604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:31.998604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:31.999133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.000391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.005832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c2a9-84d3-4a81-ae51-1153fa78ba40 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:32.006961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.034019 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1223/2457] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:32.039112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:32.056700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9d28-3a1f-4439-a72f-3b68a18a8503 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:32.068096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:32.069947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.070236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.070750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] PATH_INFO: `/v3/projects/83ab91b7a0a54a8ea03877946368702a/users/b9cb5b3f100948329ea88492ddc9da82/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.084594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.106838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ab91b7a0a54a8ea03877946368702a, user_id=b9cb5b3f100948329ea88492ddc9da82, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.111018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.124987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.140793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:32.141488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.141775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.142053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.144485 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1224/2458] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:32 2022] PUT /identity/v3/projects/83ab91b7a0a54a8ea03877946368702a/users/b9cb5b3f100948329ea88492ddc9da82/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:32.148408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:32.155969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:32.346821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.348884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb3ed-5dbc-4352-9fea-272cc7830803 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.388586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1235/2459] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:32.391740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cdf13-8052-4fa1-b6cd-6f29a5bcf0ed None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.394614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cdf13-8052-4fa1-b6cd-6f29a5bcf0ed None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.395069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cdf13-8052-4fa1-b6cd-6f29a5bcf0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.398326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8272-1363-46e4-b9da-baab8f54a71a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:32.414572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:32.415457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.415884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.416679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.435912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.438137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.459818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6a3cdf13-8052-4fa1-b6cd-6f29a5bcf0ed None None] MFA Rules not processed for user `b9cb5b3f100948329ea88492ddc9da82`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:32.461261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a3cdf13-8052-4fa1-b6cd-6f29a5bcf0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:32.465179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1225/2460] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:32.470545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:32.472278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:32.623306 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1236/2461] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:32.625455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d0f11-6b86-4f97-a60c-e920bff81f5e None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.626155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d0f11-6b86-4f97-a60c-e920bff81f5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.626634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d0f11-6b86-4f97-a60c-e920bff81f5e None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.628555 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1237/2462] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:32.629922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d0f11-6b86-4f97-a60c-e920bff81f5e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:32.684780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85608-336c-4275-9b61-52758a99e511 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:32.699232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:32.701598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.701907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.702208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] PATH_INFO: `/v3/users/7c9cc1eb5b0f4a618fefd91189a73c11` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.705060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9cc1eb5b0f4a618fefd91189a73c11)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.709182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.757134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d0f11-6b86-4f97-a60c-e920bff81f5e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:32.773479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:32.775142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:32.781952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:32.782874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:32.784047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:32.786504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:32.854621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1238/2463] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:32 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:32.856015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:53:32.876759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9cc1eb5b0f4a618fefd91189a73c11'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:32.889225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.891986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9cc1eb5b0f4a618fefd91189a73c11'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:32.933564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9cc1eb5b0f4a618fefd91189a73c11'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:32.934367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9cc1eb5b0f4a618fefd91189a73c11'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:32.937128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9cc1eb5b0f4a618fefd91189a73c11'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:32.948172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.971256 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1226/2464] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:32 2022] DELETE /identity/v3/users/7c9cc1eb5b0f4a618fefd91189a73c11 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:32.971256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:32.971851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:33.031955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:33.162985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312191-3b37-47e0-a53a-0ee4f1129b07 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.169809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.171040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.171488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.171916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.175938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.178306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.233868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efc88b-17e6-4802-b541-cb907d8b1b4a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.239377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1227/2465] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:32 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:33.243990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:33.268522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a77f6-0724-4c34-bf9c-b3e235a6c665 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.284329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.285363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.285508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.285868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.287561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.289456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.320935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1228/2466] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:33.322214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:33.346994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f550-fa1a-438f-b80a-5cf5477012d8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.360481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.362068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.362473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.362854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] PATH_INFO: `/v3/projects/f383730074954042a94131d360de379c/users/e2b94596dcf843e88201f2b0020f5a5c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.378425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.379363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.379653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.379935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects/13c0954c08a74ff58527e21d9ef5b00a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.386579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f383730074954042a94131d360de379c, user_id=e2b94596dcf843e88201f2b0020f5a5c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.386872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:get_project(project_id=13c0954c08a74ff58527e21d9ef5b00a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.389797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.391071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.391213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1239/2467] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:53:32 2022] GET /identity/v3/projects/13c0954c08a74ff58527e21d9ef5b00a => generated 367 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:33.434444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1229/2468] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:33 2022] PUT /identity/v3/projects/f383730074954042a94131d360de379c/users/e2b94596dcf843e88201f2b0020f5a5c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:33.435756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:33.464734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984d3e-0cde-4bef-aa4e-d6fae90a1064 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.547733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:33.562502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.563595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.564151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.564707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.565741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.567809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa187153-ead6-4309-82ee-bb8bf1f3ef11 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.587905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1240/2469] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:33.589897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:33.602319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9adce-1179-4f7f-8454-087f8f44e8a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:33.613373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:33.614459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.614758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.615048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] PATH_INFO: `/v3/projects/f383730074954042a94131d360de379c/users/e2b94596dcf843e88201f2b0020f5a5c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.626879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f383730074954042a94131d360de379c, user_id=e2b94596dcf843e88201f2b0020f5a5c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:33.639703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858f37b-8057-4bba-af16-c51a37bcef4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:33.672659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1230/2470] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:33 2022] PUT /identity/v3/projects/f383730074954042a94131d360de379c/users/e2b94596dcf843e88201f2b0020f5a5c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:33.675157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:33.675648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:33.676024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:33.711305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] MFA Rules not processed for user `e2b94596dcf843e88201f2b0020f5a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:33.713028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:33.909697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1241/2471] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:34.072039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:34.072849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:34.073357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:34.075344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1231/2472] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:34.082584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:53:34.084734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:34.157086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:34.160201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:34.256220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:34.260361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:34.396487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b0c5-b402-4de5-9b2a-228fdad3d58a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:34.410198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:34.410957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:34.411314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:34.411923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:34.434705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:34.436276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:34.461086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793528-1296-49b9-a0f0-fca80c5c308b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:34.464586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1232/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:34.497460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:34.498377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:34.498658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:34.498935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects/13c0954c08a74ff58527e21d9ef5b00a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:34.502176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:get_project(project_id=13c0954c08a74ff58527e21d9ef5b00a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:34.508724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:34.512702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:34.515180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:34.520586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1242/2474] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:53:34 2022] GET /identity/v3/projects/13c0954c08a74ff58527e21d9ef5b00a => generated 367 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:34.578326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:34.589397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:34.610710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cb679-df10-4578-a218-fd9dd05a65a8 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:34.631174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:34.632268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:34.632268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:34.632530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:34.638751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:34.698252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:34.705806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ee02-eee9-4165-a1bd-631c3f5e182c service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:34.715000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:34.716936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:34.717381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:34.717818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] PATH_INFO: `/v3/projects/0cada0f9d2ac4114b58afc2eb10f5f74` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:34.722284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cada0f9d2ac4114b58afc2eb10f5f74)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:34.725936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:34.829201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:34.832587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:34.863228 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1243/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:34.864193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:34.890416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cada0f9d2ac4114b58afc2eb10f5f74', 'request_id': 'req-1bc20944-72fb-451d-ab20-c41790fb3874'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:34.893891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcccf3d-9131-49b8-a026-fc205092ccf1 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:34.904112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cada0f9d2ac4114b58afc2eb10f5f74', 'request_id': 'req-1bc20944-72fb-451d-ab20-c41790fb3874'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:34.931266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cada0f9d2ac4114b58afc2eb10f5f74', 'request_id': 'req-1bc20944-72fb-451d-ab20-c41790fb3874'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:34.996953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] The token cache is being invalidate because project 0cada0f9d2ac4114b58afc2eb10f5f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:34.997258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:34.999924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.008712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1233/2476] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:34 2022] DELETE /identity/v3/projects/0cada0f9d2ac4114b58afc2eb10f5f74 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:35.009955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:35.016001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:35.078599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:35.088385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:35.094969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:35.095696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:35.104789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:35.105233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:35.110605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:35.156115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1244/2477] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:35.160873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:35.166324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:35.197217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ebad3-5b2e-4531-971e-8c29e1ef1b43 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:35.209473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:35.210482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:35.210911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:35.211355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:35.212278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:35.215049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:35.263718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1245/2478] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:35 2022] POST /identity/v3/users => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:35.267708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:35.279179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20944-72fb-451d-ab20-c41790fb3874 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:35.287510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde647-4c6a-4113-879a-10d3996756fd tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:35.291030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:35.292166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:35.292613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:35.293021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] PATH_INFO: `/v3/users/aa1810d7f2a04181be4f1a3a155823b3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:35.294721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1810d7f2a04181be4f1a3a155823b3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:35.298780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:35.300029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:35.300795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:35.301096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:35.301365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:35.302134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:35.302474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:35.304198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764dc27-b500-415c-9188-df69f8cf4c7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:35.328718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1246/2479] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:35.399330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1810d7f2a04181be4f1a3a155823b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.406232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:35.430938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1810d7f2a04181be4f1a3a155823b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.451974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1810d7f2a04181be4f1a3a155823b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.453401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1810d7f2a04181be4f1a3a155823b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.454272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1810d7f2a04181be4f1a3a155823b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:35.489804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1234/2480] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:35 2022] DELETE /identity/v3/users/aa1810d7f2a04181be4f1a3a155823b3 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:35.856902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:35.857546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:35.859632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:35.861821 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1247/2481] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:53:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:35.868199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:53:35.869756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:35.975286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:35.977111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.086078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b54f-1f42-4472-a91c-b87e09fe3aa9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:36.101448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:36.102521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.102918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.103514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects/13c0954c08a74ff58527e21d9ef5b00a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.105142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:get_project(project_id=13c0954c08a74ff58527e21d9ef5b00a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:36.107376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:36.109537 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1235/2482] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:53:35 2022] GET /identity/v3/projects/13c0954c08a74ff58527e21d9ef5b00a => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:36.127379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:36.129641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.196951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:36.201177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.409191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296bf1-7fb3-4b45-ad96-00d4676a74d9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:36.419157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:36.420057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.420338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.420664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] PATH_INFO: `/v3/users/b9cb5b3f100948329ea88492ddc9da82` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.422125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cb5b3f100948329ea88492ddc9da82)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:36.432668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:36.457428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb244e-a437-4343-a8d3-b8176b81d5ed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:36.466524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:36.471325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.471612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.471884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] PATH_INFO: `/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.483765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28a3ab8bc8c49ce88afc69e1245990f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:36.486509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:36.488013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:36.518461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:36.535549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cb5b3f100948329ea88492ddc9da82'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.536246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cb5b3f100948329ea88492ddc9da82'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.553893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cb5b3f100948329ea88492ddc9da82'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.582224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cb5b3f100948329ea88492ddc9da82'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.610132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe285231-80ce-4586-87bb-11c13a704977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cb5b3f100948329ea88492ddc9da82'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.631971 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1248/2483] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:36 2022] DELETE /identity/v3/users/b9cb5b3f100948329ea88492ddc9da82 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:36.633735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815c70-fbdd-4a82-a01b-092809320a83 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.633735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815c70-fbdd-4a82-a01b-092809320a83 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.633735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815c70-fbdd-4a82-a01b-092809320a83 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.642046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1249/2484] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:53:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:53:36.644162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b03998-fc6d-407e-b9da-5074dcfb5073 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.644499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b03998-fc6d-407e-b9da-5074dcfb5073 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.644781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b03998-fc6d-407e-b9da-5074dcfb5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.659813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28a3ab8bc8c49ce88afc69e1245990f', 'request_id': 'req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.688568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-54b03998-fc6d-407e-b9da-5074dcfb5073 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:36.690234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-54b03998-fc6d-407e-b9da-5074dcfb5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.691377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28a3ab8bc8c49ce88afc69e1245990f', 'request_id': 'req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.711200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28a3ab8bc8c49ce88afc69e1245990f', 'request_id': 'req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.742720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] The token cache is being invalidate because project b28a3ab8bc8c49ce88afc69e1245990f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:36.745970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.751176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:36.766165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1236/2485] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:36 2022] DELETE /identity/v3/projects/b28a3ab8bc8c49ce88afc69e1245990f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:36.769261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:53:36.772543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.825798 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1250/2486] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:36.827080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:36.827468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:36.827844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:36.871262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:36.876039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:36.906680 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1251/2487] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:36.906680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:36.906680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.048623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:37.054707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.150732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7070d-ca6b-4923-9b9f-690f3d8e45e8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.159320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.168704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.169438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.169934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.195153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.198072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3391f-d9d1-40ed-9b6f-15ca86c63a7a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:37.214716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb2d72-eb0c-4061-bbcf-053ba46413c3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.222803 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1252/2488] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:37.224228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396031-a87d-4a67-ab26-91aff029355a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.224547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396031-a87d-4a67-ab26-91aff029355a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.232137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396031-a87d-4a67-ab26-91aff029355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.275972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:37.276673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fe396031-a87d-4a67-ab26-91aff029355a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:37.277942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe396031-a87d-4a67-ab26-91aff029355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.294177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1253/2489] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:37.301679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.301959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.302238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.335588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] MFA Rules not processed for user `a9f3260e3ee44ff49fdde7cb320e1b89`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:37.335714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.336639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.336793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.337199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.337795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects/13c0954c08a74ff58527e21d9ef5b00a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.339206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:get_project(project_id=13c0954c08a74ff58527e21d9ef5b00a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.341377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:37.343249 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1237/2490] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:53:36 2022] GET /identity/v3/projects/13c0954c08a74ff58527e21d9ef5b00a => generated 367 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:37.344090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:37.370621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a27e9-b2c7-479c-9b56-922ed0d32abc tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.381648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.382354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.382635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.382906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.383704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:37.384024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.386745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:37.390349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:37.425282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1238/2491] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:37.426258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:37.454947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19115-be14-433c-b365-5967bc0061eb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.480077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.484640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.485099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.485556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/users/5b6a4c5d5a9b42b08da76565c9f09128` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.537060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b6a4c5d5a9b42b08da76565c9f09128)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.540996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:37.542781 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1254/2492] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:37.543894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:37.558033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411e833-98cf-4352-a279-0e1004bb93f1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.563563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.564459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.564753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.565080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.565791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.568008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef492-2818-45b7-ad05-4d494121d150 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:37.649586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1255/2493] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:37.653642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b80c4-753a-4b6e-a1d3-d03156e7bb96 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.655355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b80c4-753a-4b6e-a1d3-d03156e7bb96 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.655833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b80c4-753a-4b6e-a1d3-d03156e7bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.664175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6a4c5d5a9b42b08da76565c9f09128'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:37.683076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6a4c5d5a9b42b08da76565c9f09128'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:37.705946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d65b80c4-753a-4b6e-a1d3-d03156e7bb96 None None] MFA Rules not processed for user `e9c6e12528ea4760bed65f994df57783`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:37.708804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d65b80c4-753a-4b6e-a1d3-d03156e7bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.714747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6a4c5d5a9b42b08da76565c9f09128'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:37.716460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6a4c5d5a9b42b08da76565c9f09128'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:37.719049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6a4c5d5a9b42b08da76565c9f09128'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:37.750225 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1239/2494] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:37 2022] DELETE /identity/v3/users/5b6a4c5d5a9b42b08da76565c9f09128 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:37.751314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:37.753828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.887523 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1256/2495] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:37.894349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.894734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.895101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.920255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484f4-c086-4169-bbda-275aeb99d7b2 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:37.926219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] MFA Rules not processed for user `33d0756150114bc7bd3f6f72b93cb56a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:37.933991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:37.934877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:37.935941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:37.936237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:37.936614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:37.937823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:37.940248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.002587 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1240/2496] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:38.003734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.008903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.083539 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1257/2497] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:38.089231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:38.092266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.141793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f28f3-f66b-4dd4-93f5-8114b515c605 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.161073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.165045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.166507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.168597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.169470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.173721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.224091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33e34a-5042-4e51-a43c-0195551ce88e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.233038 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1258/2498] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:38.234356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.236150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9405a876b0124b62b58db6a42018ad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80876312770441c88fb6df3da674e5a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.238375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.239044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.239578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] PATH_INFO: `/v3/projects/13c0954c08a74ff58527e21d9ef5b00a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.242967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13c0954c08a74ff58527e21d9ef5b00a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.246382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.246981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.347272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c0954c08a74ff58527e21d9ef5b00a', 'request_id': 'req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.359439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:38.367579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c0954c08a74ff58527e21d9ef5b00a', 'request_id': 'req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.382598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c0954c08a74ff58527e21d9ef5b00a', 'request_id': 'req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.411531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] The token cache is being invalidate because project 13c0954c08a74ff58527e21d9ef5b00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:38.413798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.414769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.420514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1241/2499] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:38 2022] DELETE /identity/v3/projects/13c0954c08a74ff58527e21d9ef5b00a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:38.421730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.445002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.492941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3ce30-6c1d-4264-bedd-ab052c9c0057 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.600652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec50c6-3dcf-4262-9ea1-6347ef7e6408 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.616602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.617265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.617589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.617932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.620103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.620549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.621750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.622245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.622720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.642303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.646229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.674504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1242/2500] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:38.675726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.677828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.695738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a37a-6f19-442a-8df5-c1db19fa54b1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.701054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.702747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.706980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.708365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.708940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.709638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] PATH_INFO: `/v3/users/9dcea2fb80f64978af9a32780752008e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.711275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcea2fb80f64978af9a32780752008e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.715761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.716579 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1259/2501] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:38.717635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.719268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.742992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf92220-8617-4992-b5c7-5061d21c4d61 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:38.749617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:38.751221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:38.751718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:38.758015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] PATH_INFO: `/v3/users/ffe4dabb7447429182e985431ff616d9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:38.760069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe4dabb7447429182e985431ff616d9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:38.762637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:38.809446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:38.829998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcea2fb80f64978af9a32780752008e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.855494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe4dabb7447429182e985431ff616d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.856704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe4dabb7447429182e985431ff616d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.858841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcea2fb80f64978af9a32780752008e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.883464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe4dabb7447429182e985431ff616d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.893108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:38.908266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcea2fb80f64978af9a32780752008e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.912921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcea2fb80f64978af9a32780752008e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.914327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcea2fb80f64978af9a32780752008e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.915369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe4dabb7447429182e985431ff616d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.933914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe4dabb7447429182e985431ff616d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:38.952186 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1260/2502] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:38 2022] DELETE /identity/v3/users/ffe4dabb7447429182e985431ff616d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:38.953317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1243/2503] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:38 2022] DELETE /identity/v3/users/9dcea2fb80f64978af9a32780752008e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:38.954184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.956996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:38.959902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:38.961464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.124630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e638-9a78-433a-8b11-08561a40ad39 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.124920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb9f-548e-42d8-b428-a5b3c70c4877 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.136711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.137037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.137896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.138024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.138263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.138531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] PATH_INFO: `/v3/projects/26b3a9ffdd5b4cf5b483c2a770e54a85/users/7001fd3982074ec9ac00f5acd8efd71d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.139421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.139725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] PATH_INFO: `/v3/projects/83ab91b7a0a54a8ea03877946368702a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.141786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ab91b7a0a54a8ea03877946368702a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.143817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.180861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b3a9ffdd5b4cf5b483c2a770e54a85, user_id=7001fd3982074ec9ac00f5acd8efd71d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.184286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b165cbc-fddc-42d0-9f81-663352d7f6e0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.215506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1261/2504] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:38 2022] PUT /identity/v3/projects/26b3a9ffdd5b4cf5b483c2a770e54a85/users/7001fd3982074ec9ac00f5acd8efd71d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:39.216909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.217204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.217548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.253321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ab91b7a0a54a8ea03877946368702a', 'request_id': 'req-9e23f66a-81d5-4fa9-905e-edf30ea4585c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.269818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ab91b7a0a54a8ea03877946368702a', 'request_id': 'req-9e23f66a-81d5-4fa9-905e-edf30ea4585c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.272578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:39.280300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.282906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ab91b7a0a54a8ea03877946368702a', 'request_id': 'req-9e23f66a-81d5-4fa9-905e-edf30ea4585c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.309083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] The token cache is being invalidate because project 83ab91b7a0a54a8ea03877946368702a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:39.309406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.311939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9e23f66a-81d5-4fa9-905e-edf30ea4585c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.317499 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1244/2505] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:38 2022] DELETE /identity/v3/projects/83ab91b7a0a54a8ea03877946368702a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:39.319329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.321609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.321955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.391551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] MFA Rules not processed for user `7001fd3982074ec9ac00f5acd8efd71d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:39.394982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.433621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1262/2506] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:39.434563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:39.436047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.460993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819f2b-dcd6-41ae-8af4-2d0e9adc88df None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.467949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.469292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.469688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.470072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] PATH_INFO: `/v3/projects/4897232399d64121b7b31c749b09dd1f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.471659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4897232399d64121b7b31c749b09dd1f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.474173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.475294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:39.541668 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1245/2507] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:39.547315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:39.551563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.562581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4897232399d64121b7b31c749b09dd1f', 'request_id': 'req-25d90ece-89e7-4e65-8419-6afa8516caf8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.572143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:39.576821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c446-24fd-47f2-a730-1c8f729b264f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.578628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4897232399d64121b7b31c749b09dd1f', 'request_id': 'req-25d90ece-89e7-4e65-8419-6afa8516caf8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.591151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4897232399d64121b7b31c749b09dd1f', 'request_id': 'req-25d90ece-89e7-4e65-8419-6afa8516caf8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.615802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] The token cache is being invalidate because project 4897232399d64121b7b31c749b09dd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:39.616297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.619118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.621616 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1263/2508] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:39 2022] DELETE /identity/v3/projects/4897232399d64121b7b31c749b09dd1f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:39.626032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:39.627576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.723652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.724724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.725309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.725799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] PATH_INFO: `/v3/users/e2b94596dcf843e88201f2b0020f5a5c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.730715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b94596dcf843e88201f2b0020f5a5c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.750200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.754505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90ece-89e7-4e65-8419-6afa8516caf8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.763604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.764330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.766455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.767437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.776748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.813684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.815369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.828841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b94596dcf843e88201f2b0020f5a5c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.839193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b94596dcf843e88201f2b0020f5a5c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.840133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1264/2509] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:39.843426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:39.847149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.860066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b94596dcf843e88201f2b0020f5a5c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.862340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b94596dcf843e88201f2b0020f5a5c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.863381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8e10dcd-fd89-4673-9c27-2dd424b1d74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b94596dcf843e88201f2b0020f5a5c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:39.872215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed350-f964-41bc-ba9e-4db1961c9c50 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:39.885245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:39.886072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.886954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.887338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.888153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:39.890256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:39.899074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1246/2510] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:39 2022] DELETE /identity/v3/users/e2b94596dcf843e88201f2b0020f5a5c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:39.901158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759348c-1c98-4bed-b724-0214db90f350 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:39.901393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759348c-1c98-4bed-b724-0214db90f350 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:39.905046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759348c-1c98-4bed-b724-0214db90f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:39.941064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1265/2511] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:39 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:39.942612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:39.945329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:39.977996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7759348c-1c98-4bed-b724-0214db90f350 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:39.982215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7759348c-1c98-4bed-b724-0214db90f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:40.102906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:40.140241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1247/2512] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:40.148021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.148476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.148877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.195005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e697-a5df-427d-b340-362abd552ba7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.196202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:40.197881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:40.206191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.207172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.207455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.207732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.208457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.211110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.212086 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1248/2513] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:40.220623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.234501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1a13-ab41-468b-9f6a-031c097a2ada None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.241087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.241769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.242849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.243139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.243952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:40.245685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.246138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1266/2514] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:39 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:40.250512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.251465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.268765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffdf3b-547d-46ef-b6b1-209695fdfb99 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.277207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.279707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.280580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.281045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.282255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.284043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1249/2515] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:40.286212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.288251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.313568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a89fd-fab5-49ab-91c2-9faca2160fbd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.322698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1267/2516] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:40.326836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.339960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.340786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.342764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.343146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.343980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.349724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.356908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31d18-17b6-4aea-8e85-66e0b9d7b237 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.368269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.370688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.370898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.371187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] PATH_INFO: `/v3/projects/dc160f0e61d84bb4b64a816716d61a23/users/de698ef9f4be4f82b38b9ae7062f88c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.413829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1250/2517] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:40 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:40.416070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc160f0e61d84bb4b64a816716d61a23, user_id=de698ef9f4be4f82b38b9ae7062f88c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.421720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.424099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.476708 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1268/2518] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:40 2022] PUT /identity/v3/projects/dc160f0e61d84bb4b64a816716d61a23/users/de698ef9f4be4f82b38b9ae7062f88c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:40.484086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.551612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:40.699748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627914-deea-4e4d-95cc-84fa41e8a618 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.776069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8717-1330-4758-8d00-0478ae8ea6b8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.804452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.805223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.805525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.805806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.806613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.808362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.870119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1269/2519] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:40.871029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.919441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.927761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.929036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.929524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.930482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.933062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:40.938752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac72564-1ea7-4498-9add-056d98fdd0bb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:40.957564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:40.958758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:40.959044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:40.959391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] PATH_INFO: `/v3/projects/dc160f0e61d84bb4b64a816716d61a23/users/de698ef9f4be4f82b38b9ae7062f88c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:40.967493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc160f0e61d84bb4b64a816716d61a23, user_id=de698ef9f4be4f82b38b9ae7062f88c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:40.972604 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1251/2520] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:40 2022] POST /identity/v3/users => generated 290 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:40.978070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:40.980738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c2a9-aac6-4856-90c0-e2c6602a24e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:41.004140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164b0be-6922-45e8-ac48-6584cc45316d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:41.044306 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1270/2521] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:40 2022] PUT /identity/v3/projects/dc160f0e61d84bb4b64a816716d61a23/users/de698ef9f4be4f82b38b9ae7062f88c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:41.055857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c10-0577-4bed-9232-51c870213e80 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.056453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c10-0577-4bed-9232-51c870213e80 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.056453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c10-0577-4bed-9232-51c870213e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.121951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:41.129662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f1822c10-0577-4bed-9232-51c870213e80 None None] MFA Rules not processed for user `de698ef9f4be4f82b38b9ae7062f88c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:41.131931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f1822c10-0577-4bed-9232-51c870213e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:41.146540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:41.149173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.149514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.150481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.153512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:41.157770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:41.220761 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1252/2522] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:41.222248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:41.260868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015106fa-afb5-4a29-8fb0-f131ab7c2fd0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:41.280568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:41.283387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.283725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.284065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.286362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:41.292287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:41.327959 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1253/2523] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:41.332392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:41.359610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5016d83-fcbc-4f6a-9f63-f8e50741be33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:41.366888 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1271/2524] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:41.370400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.370701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.370980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.373967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:41.374970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.375315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.375696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] PATH_INFO: `/v3/projects/b11caf5e3a4a40d5a26b778cbf12cadc/users/18fe789426554a8990a42b8aee814346/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.418120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11caf5e3a4a40d5a26b778cbf12cadc, user_id=18fe789426554a8990a42b8aee814346, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:41.418470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] MFA Rules not processed for user `7001fd3982074ec9ac00f5acd8efd71d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:41.420863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f827d5-e027-446c-ae79-1bfc9abc7bfb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:41.422549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:41.460024 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1254/2525] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:41 2022] PUT /identity/v3/projects/b11caf5e3a4a40d5a26b778cbf12cadc/users/18fe789426554a8990a42b8aee814346/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:41.463075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:41.463510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:41.463835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:41.523034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] MFA Rules not processed for user `18fe789426554a8990a42b8aee814346`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:41.525028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:41.660623 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1272/2526] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:41.689054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1255/2527] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:41.776047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:41.778061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:41.892029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:42.010402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c362f-26fd-4b9d-a7c6-d397b5691e6b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:42.123564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:42.125160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:42.184535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:42.185472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.185758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.186090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.188982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:42.284594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:42.286325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:42.297783 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1273/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:42.298676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:42.300202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:42.335739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831e78f-7b26-45e1-8ed0-bbac1486927c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:42.367153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:42.367836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.368117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.368392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.414715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:42.416462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:42.424145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e170674-775a-4d1b-bdc0-7ca1b696f74a service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:42.432138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:42.433121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.433415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.433691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] PATH_INFO: `/v3/projects/f383730074954042a94131d360de379c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.435055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f383730074954042a94131d360de379c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:42.437005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:42.448544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:42.473287 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1256/2529] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:42.474129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:42.477279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:42.504415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916a1a9-f2de-4e43-9c95-d69046ad4f31 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:42.528240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f383730074954042a94131d360de379c', 'request_id': 'req-732a61f8-6c38-4a80-8106-cc46b143c917'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.550302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f383730074954042a94131d360de379c', 'request_id': 'req-732a61f8-6c38-4a80-8106-cc46b143c917'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.577547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f383730074954042a94131d360de379c', 'request_id': 'req-732a61f8-6c38-4a80-8106-cc46b143c917'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.596925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:42.610693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] The token cache is being invalidate because project f383730074954042a94131d360de379c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:42.610992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.611997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.617106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1274/2530] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:42 2022] DELETE /identity/v3/projects/f383730074954042a94131d360de379c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:42.618028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:42.623742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:42.711650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:42.713581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.714059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.714340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] PATH_INFO: `/v3/projects/962e754e8e974d05b5e96340651842e5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.717197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a61f8-6c38-4a80-8106-cc46b143c917 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:42.719065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962e754e8e974d05b5e96340651842e5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:42.723910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:42.725326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.725776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.726214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] PATH_INFO: `/v3/users/18fe789426554a8990a42b8aee814346` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.728653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:42.729030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fe789426554a8990a42b8aee814346)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:42.732025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:42.874341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fe789426554a8990a42b8aee814346'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.877002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fe789426554a8990a42b8aee814346'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.892966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962e754e8e974d05b5e96340651842e5', 'request_id': 'req-83e029ff-81d6-497c-a72b-f608d1ee76d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.908214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fe789426554a8990a42b8aee814346'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.919777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962e754e8e974d05b5e96340651842e5', 'request_id': 'req-83e029ff-81d6-497c-a72b-f608d1ee76d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.939037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962e754e8e974d05b5e96340651842e5', 'request_id': 'req-83e029ff-81d6-497c-a72b-f608d1ee76d9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.954501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fe789426554a8990a42b8aee814346'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.969867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] The token cache is being invalidate because project 962e754e8e974d05b5e96340651842e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:42.970421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.971616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fe789426554a8990a42b8aee814346'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.972070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-83e029ff-81d6-497c-a72b-f608d1ee76d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:42.975242 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1257/2531] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:42 2022] DELETE /identity/v3/projects/962e754e8e974d05b5e96340651842e5 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:42.976828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec35ae-a37b-46ae-b850-1f4b332c4164 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:42.980873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec35ae-a37b-46ae-b850-1f4b332c4164 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:42.984284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec35ae-a37b-46ae-b850-1f4b332c4164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:42.989143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1275/2532] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:42 2022] DELETE /identity/v3/users/18fe789426554a8990a42b8aee814346 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:42.995700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:42.998938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:43.054164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:43.078182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-feec35ae-a37b-46ae-b850-1f4b332c4164 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:43.080783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-feec35ae-a37b-46ae-b850-1f4b332c4164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:43.131779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b038e-0aac-4268-9da5-259c1b284e61 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:43.140034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:43.141979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.142324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.142671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] PATH_INFO: `/v3/users/9405a876b0124b62b58db6a42018ad6b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.144742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9405a876b0124b62b58db6a42018ad6b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:43.148393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:43.239867 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1258/2533] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:43.242130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3f8a-39c0-4e7b-b0e7-0ce1d486da5a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.242655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3f8a-39c0-4e7b-b0e7-0ce1d486da5a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.243164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3f8a-39c0-4e7b-b0e7-0ce1d486da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.282037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9405a876b0124b62b58db6a42018ad6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:43.282884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9405a876b0124b62b58db6a42018ad6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:43.299265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a0fe3f8a-39c0-4e7b-b0e7-0ce1d486da5a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:43.301320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9405a876b0124b62b58db6a42018ad6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:43.309692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a0fe3f8a-39c0-4e7b-b0e7-0ce1d486da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:43.343149 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1259/2534] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:43.344072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9405a876b0124b62b58db6a42018ad6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:43.346936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.353207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.353739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.369577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9405a876b0124b62b58db6a42018ad6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:43.383766 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1276/2535] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:42 2022] DELETE /identity/v3/users/9405a876b0124b62b58db6a42018ad6b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:43.385159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:43.388759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:43.397555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:43.401018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:43.536943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68219739-dc41-44f5-875a-1751ac8812a1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:43.541322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:43.542881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.543203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.543509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.572276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:43.616594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:43.643679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1260/2536] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:43.649415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:43.659416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:43.662311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:43.689409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098021d-bf66-4889-9cf6-397a3890887a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:43.691244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1277/2537] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:43.700988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:43.701651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.701941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.702307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.703003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:43.703311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:43.705097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:43.728191 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1261/2538] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:43.732533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:43.756614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075117bd-49a5-4665-beb5-14b56d93c842 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:43.771290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:43.772392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.773036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.773465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.774318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:43.778462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:43.831910 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1278/2539] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:43 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:43.834369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:43.851368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277f87-8b77-4b64-bda8-c9fbd6e63a03 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:43.956888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:43.957618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:43.958076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:43.958357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:43.959456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:43.962970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.004505 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1262/2540] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:43 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:44.006721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.034836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f65e-7bd9-414d-9880-d01fab6c038e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.048681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.049942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.051071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.051675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.052601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.060581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.077788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1279/2541] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:44.078630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.096901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c2fa-2e3b-407a-b4d5-c684e7bfd208 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.105510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.106207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.106551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.106967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.107760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.110748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758404-496f-4892-a234-1d2a99323197 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.130238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.132500 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1263/2542] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:53:44.145314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d97db-5bb4-4ad8-ad1f-274c1969230a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.153518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.154326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.154612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.154919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] PATH_INFO: `/v3/projects/7ef8759c864144ea81fa1b29ed227d21/users/45a84bb3b8564199aff5ea461e526bf6/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.182318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef8759c864144ea81fa1b29ed227d21, user_id=45a84bb3b8564199aff5ea461e526bf6, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.185780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.220375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1280/2543] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:44 2022] PUT /identity/v3/projects/7ef8759c864144ea81fa1b29ed227d21/users/45a84bb3b8564199aff5ea461e526bf6/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:44.232461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.232973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.233428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.299925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] MFA Rules not processed for user `45a84bb3b8564199aff5ea461e526bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:44.304167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:44.413482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1264/2544] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:44.418046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.529328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.531362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:44.629410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4572-a18b-471d-8bca-2352ae43ffe1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.646461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.648994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.649290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.650512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:44.651865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.654106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.662957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.685529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cac28a-75e1-4db8-a61a-d1b670d43a6d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.693930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.696453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.696453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.696453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] PATH_INFO: `/v3/projects/b11caf5e3a4a40d5a26b778cbf12cadc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.698551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11caf5e3a4a40d5a26b778cbf12cadc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.701158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.713623 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1281/2545] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:44 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:44.717386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:44.809760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11caf5e3a4a40d5a26b778cbf12cadc', 'request_id': 'req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:44.822661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11caf5e3a4a40d5a26b778cbf12cadc', 'request_id': 'req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:44.836968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11caf5e3a4a40d5a26b778cbf12cadc', 'request_id': 'req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:44.862253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] The token cache is being invalidate because project b11caf5e3a4a40d5a26b778cbf12cadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:44.862778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:44.863713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0dae1b31-1bf5-45e6-ae9e-3dda76f3907a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:44.866358 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1265/2546] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:44 2022] DELETE /identity/v3/projects/b11caf5e3a4a40d5a26b778cbf12cadc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:44.873649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.874563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.876296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.878912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7238d-29b1-41f3-a29a-bbd892b4ce1a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:44.902550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:44.941482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:44.945279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:44.961525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:44.962623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:44.963038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:44.963407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:44.964246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:44.966259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:44.995366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1282/2547] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:44 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:44.999972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.002217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.021163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5462e-47d7-4630-91d2-a6c478f9c098 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.030526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.032246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.032571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.033323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.035009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.039578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.059988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1283/2548] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:45.062336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.078872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1266/2549] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:45.079697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.081063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.084154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92bc0-e7ce-43b7-b2b0-be399415d874 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.095711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0fd34-c996-4757-b90c-2baaeba90b8d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.096328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.098830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.099191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.100395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] PATH_INFO: `/v3/projects/145cf95833a14db488e4c37412031bf0/users/cd15269462f748f082201bfc6ca00edf/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.100952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.102055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.102424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.102767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] PATH_INFO: `/v3/projects/80876312770441c88fb6df3da674e5a4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.104081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80876312770441c88fb6df3da674e5a4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.106278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.135934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145cf95833a14db488e4c37412031bf0, user_id=cd15269462f748f082201bfc6ca00edf, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.141033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b0cdb-cfec-4b06-ab86-1b3ac93867e5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.172909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1284/2550] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:45 2022] PUT /identity/v3/projects/145cf95833a14db488e4c37412031bf0/users/cd15269462f748f082201bfc6ca00edf/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:45.174972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7d0-2928-48e7-a5d3-d16a90907e21 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.174972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7d0-2928-48e7-a5d3-d16a90907e21 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.174972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab7d0-2928-48e7-a5d3-d16a90907e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.200908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-629ab7d0-2928-48e7-a5d3-d16a90907e21 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:45.203379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80876312770441c88fb6df3da674e5a4', 'request_id': 'req-2357cb02-ed7b-4f6b-a346-43aa7790913f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:45.203519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-629ab7d0-2928-48e7-a5d3-d16a90907e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.215980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80876312770441c88fb6df3da674e5a4', 'request_id': 'req-2357cb02-ed7b-4f6b-a346-43aa7790913f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:45.225053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80876312770441c88fb6df3da674e5a4', 'request_id': 'req-2357cb02-ed7b-4f6b-a346-43aa7790913f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:45.236776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:45.245853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] The token cache is being invalidate because project 80876312770441c88fb6df3da674e5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:45.246455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:45.248251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:45.253374 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1267/2551] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:45 2022] DELETE /identity/v3/projects/80876312770441c88fb6df3da674e5a4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:45.254478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.256331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.319530 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1285/2552] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:45.321287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.322305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.322653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.346159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:45.347367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.356056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb02-ed7b-4f6b-a346-43aa7790913f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.357424 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1286/2553] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:45.358318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.360045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.368857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.369620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.369895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.370177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.370962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.372613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.384861 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1268/2554] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:45.385777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.396200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46fd4-0fab-4c1d-896b-ab8a3e6c7ab1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.401619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.402287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.402569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.402846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.403574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:45.403972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.405658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a789d3-adc3-43c5-9840-dba94e36cfbf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.422406 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1269/2555] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:45.422406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.422406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.422406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.444161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:45.445773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.454403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b98b3-6b33-4ac6-aa81-dfbac9593c72 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.460008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1270/2556] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:45.460008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.462044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.464392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.464801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.465087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.469630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6908a-215b-4609-8e81-6b0da53f9cf3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.474117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.480823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.481742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.482026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.482648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] PATH_INFO: `/v3/projects/145cf95833a14db488e4c37412031bf0/users/cd15269462f748f082201bfc6ca00edf/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.482978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:45.484598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145cf95833a14db488e4c37412031bf0, user_id=cd15269462f748f082201bfc6ca00edf, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.487572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.512930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1271/2557] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:45 2022] PUT /identity/v3/projects/145cf95833a14db488e4c37412031bf0/users/cd15269462f748f082201bfc6ca00edf/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:45.514468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.557324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.559873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.578928 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1287/2558] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:45.580694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.594206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36ceda-9399-42ac-b558-d69f5123f4ee service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.628724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558754-5829-4d38-b8c1-bbf72b2832a1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.635754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.636675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.637288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.638475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.639681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.646568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.688883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.689650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.690451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.690763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.691539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:45.691844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.696017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b1a28-6789-42e1-9bba-9b564541cd7d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.713882 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1288/2559] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:45.715057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1272/2560] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:45.715626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e75c0-2e08-4268-83da-53a88c8a37dc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.715918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e75c0-2e08-4268-83da-53a88c8a37dc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.716192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e75c0-2e08-4268-83da-53a88c8a37dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.721154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.777655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-671e75c0-2e08-4268-83da-53a88c8a37dc None None] MFA Rules not processed for user `cd15269462f748f082201bfc6ca00edf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:45.782281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-671e75c0-2e08-4268-83da-53a88c8a37dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:45.833936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:45.867228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e653-f4c4-4ca6-8c64-2ee2921901c5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:45.880957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:45.884994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.885481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.887277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.889965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:45.899833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:45.961561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1273/2561] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:45.964254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:45.978394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1289/2562] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:45.978394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:45.979637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:45.979948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:45.989626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107810e-1e68-4666-ab82-8db5d97eb20a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.001287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.001988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.002269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.002565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.003242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.005233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.022146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] MFA Rules not processed for user `39e82edaa30d418d96ea37f942d62755`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:46.025034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:46.068809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:46.089650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1274/2563] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:46.090668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.134470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1290/2564] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:46.136153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.205670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94584b-1c2d-41f7-b00e-8766bb23b6dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.211810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.216362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.216670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.217280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.218042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.220568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.234495 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1275/2565] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:46.235674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.248385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377c449-6c41-46d7-8fd0-509e69a26e18 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.252898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844a07e-f085-4fdc-b15e-838fc5b40c70 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.261172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.261871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.262152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.262423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.263172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.265327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.300686 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1276/2566] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:46 2022] POST /identity/v3/users => generated 296 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:46.306385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.321795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4bff3-f013-4893-a668-ad6300e8ef3f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.327923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.328648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.328945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.329224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.330075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.331698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.344829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1277/2567] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:46.345954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.357483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.357647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be100b3-5ef5-4148-a367-84038165ca7a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.358212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.358582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.358933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.363042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.363711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.363998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.364276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.365053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.368623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.386185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1278/2568] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:46.387105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.423688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b40a-9aae-445b-8438-608142970fad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.432566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.433909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.434351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.434776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] PATH_INFO: `/v3/projects/ecaaba0e553049e6a4da58c2c5081305/users/67284d616ad14540b8e798ce389b10a7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.439538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:46.443472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.445482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.464790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecaaba0e553049e6a4da58c2c5081305, user_id=67284d616ad14540b8e798ce389b10a7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.466381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1291/2569] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:46.467506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.467777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33f83-fd24-495d-8f99-ed82f49079e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.480206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5600-ee34-459a-abf4-077c99124565 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.502222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1279/2570] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:46 2022] PUT /identity/v3/projects/ecaaba0e553049e6a4da58c2c5081305/users/67284d616ad14540b8e798ce389b10a7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:46.506707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.507003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.507286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.543479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:46.554313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:46.633974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.634981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.635485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.635950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.636936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.641831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8870f-52ff-45b9-8a8d-235713e9ba72 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.651619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:46.669674 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1292/2571] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:46.671395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bba83-0edc-45f4-ba61-eee8c3861d9d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.673567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bba83-0edc-45f4-ba61-eee8c3861d9d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.674222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bba83-0edc-45f4-ba61-eee8c3861d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.722270 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1280/2572] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:46.727076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.751579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-392bba83-0edc-45f4-ba61-eee8c3861d9d None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:46.758428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-392bba83-0edc-45f4-ba61-eee8c3861d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:46.774292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3ecd-5201-4dbc-bd88-1cd6251c598a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:46.794189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:46.794777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.795065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.795339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] PATH_INFO: `/v3/projects/ea50e527346c47a2b3c0f7362ff5449b/users/af65f7ab19604ee1841ce4ae7e65a994/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.838383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea50e527346c47a2b3c0f7362ff5449b, user_id=af65f7ab19604ee1841ce4ae7e65a994, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:46.843130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:46.864706 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1281/2573] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:46 2022] PUT /identity/v3/projects/ea50e527346c47a2b3c0f7362ff5449b/users/af65f7ab19604ee1841ce4ae7e65a994/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:46.867262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:46.885122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1293/2574] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:46.886553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:46.886916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:46.887405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:46.887784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:46.924639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] MFA Rules not processed for user `af65f7ab19604ee1841ce4ae7e65a994`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:46.925921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:47.010957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d41ca-a15d-49f3-bf1c-a13f683c5584 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.017344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.019315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.019682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.020908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.080148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1294/2575] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:47.081379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.117794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.119485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.135539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:47.136738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1282/2576] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:47.182272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ef61-a75a-4388-915d-a6b7baaa9722 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.188234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.188991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.189280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.189555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.190275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.192326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.227227 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1295/2577] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:47 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:47.233418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.245925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c9d48-2d6c-4a2f-ae54-94fbb5ab531d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.338387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.339073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.339372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.339655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.340531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.342701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.380068 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1283/2578] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:47 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:47.383947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.396537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507dc5-a1a6-4fdc-996d-69767bf13c7f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.406173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.407560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.408057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.408589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.409658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.418582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.444515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1296/2579] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:47.445253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.459807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:47.467349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef60a-e504-4409-a3e9-555cb9e2a418 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.481068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.482160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.482449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.482734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] PATH_INFO: `/v3/projects/20751ea751214751af64f3f053198949/users/026230b7926140c1859a630ebe633242/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.523194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20751ea751214751af64f3f053198949, user_id=026230b7926140c1859a630ebe633242, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.528163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.565244 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1284/2580] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:47 2022] PUT /identity/v3/projects/20751ea751214751af64f3f053198949/users/026230b7926140c1859a630ebe633242/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:47.569071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.584844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499344b1-61a2-4ee0-a1f9-5705007045b5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.675429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.676495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.676865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.677222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.678326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.683149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47bf0c-416e-4eac-a9a2-5ab7bd6c7cdc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.697058 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1297/2581] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:47.701954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:47.715678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee6294-98bd-42ab-ad5d-885a598a4d08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:47.726666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:47.729316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.729700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.730034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] PATH_INFO: `/v3/projects/20751ea751214751af64f3f053198949/users/026230b7926140c1859a630ebe633242/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.735885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20751ea751214751af64f3f053198949, user_id=026230b7926140c1859a630ebe633242, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:47.742101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33090e-f044-4ad3-81c8-c3f4ad7f0e5e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:47.768583 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1285/2582] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:47 2022] PUT /identity/v3/projects/20751ea751214751af64f3f053198949/users/026230b7926140c1859a630ebe633242/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:47.774547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:47.775081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:47.775081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:47.849709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] MFA Rules not processed for user `026230b7926140c1859a630ebe633242`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:47.861214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:48.016758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1298/2583] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:48.029401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:48.029976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:48.030592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:48.057495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] MFA Rules not processed for user `af65f7ab19604ee1841ce4ae7e65a994`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:48.059210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:48.151164 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1286/2584] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:48.246329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:48.287578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:48.387111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f43ea-2833-4fc7-9774-74e367ff925a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:48.396039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:48.396841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:48.397154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:48.397429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:48.406599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:48.408237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cedd1-aff1-42dc-b11d-9a97be413973 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:48.418681 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1299/2585] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:51.299702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:51.518283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51fd96-bb55-4039-8ffc-81fd5ea911e2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:51.524182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:51.525331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:51.525612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:51.526025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] PATH_INFO: `/v3/users/45a84bb3b8564199aff5ea461e526bf6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:51.527404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a84bb3b8564199aff5ea461e526bf6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:51.529562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:51.627972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a84bb3b8564199aff5ea461e526bf6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:51.640525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a84bb3b8564199aff5ea461e526bf6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:51.669210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a84bb3b8564199aff5ea461e526bf6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:51.670320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a84bb3b8564199aff5ea461e526bf6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:51.671113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a84bb3b8564199aff5ea461e526bf6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:51.674209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:51.690282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1287/2586] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:51 2022] DELETE /identity/v3/users/45a84bb3b8564199aff5ea461e526bf6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:51.694610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:51.695163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:51.695163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:51.717394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:51.718680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:51.831413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1300/2587] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:51.866040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:51.868539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:51.947698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2715b0f-38ef-44ac-a75f-3c0376714775 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:51.951728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:51.952673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:51.953073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:51.953420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:51.965167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:51.966925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:51.982643 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1288/2588] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:54.075377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:54.077831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:54.108753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a22166-f679-4b05-986e-a0f757413dfd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:54.123215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:54.124660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:54.126901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:54.127449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] PATH_INFO: `/v3/projects/7ef8759c864144ea81fa1b29ed227d21` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:54.131059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef8759c864144ea81fa1b29ed227d21)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:54.153080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:54.291147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef8759c864144ea81fa1b29ed227d21', 'request_id': 'req-e9fc7dc3-2294-4350-b4cb-b616259dcd90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.308740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef8759c864144ea81fa1b29ed227d21', 'request_id': 'req-e9fc7dc3-2294-4350-b4cb-b616259dcd90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.356475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef8759c864144ea81fa1b29ed227d21', 'request_id': 'req-e9fc7dc3-2294-4350-b4cb-b616259dcd90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.385044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] The token cache is being invalidate because project 7ef8759c864144ea81fa1b29ed227d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:54.385389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.389432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.394868 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1301/2589] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:54 2022] DELETE /identity/v3/projects/7ef8759c864144ea81fa1b29ed227d21 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:54.401661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:54.414343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6c47-7eef-4318-8b8e-6e5a531702c2 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:54.610504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:54.611461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:54.611922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:54.612208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] PATH_INFO: `/v3/users/cd15269462f748f082201bfc6ca00edf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:54.616456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd15269462f748f082201bfc6ca00edf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:54.618731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:54.731420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd15269462f748f082201bfc6ca00edf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.754887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd15269462f748f082201bfc6ca00edf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.784339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd15269462f748f082201bfc6ca00edf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.786391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd15269462f748f082201bfc6ca00edf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.786584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4e7aae5-8b19-4628-b95f-975d501d2c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd15269462f748f082201bfc6ca00edf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:54.813716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1289/2590] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:53:54 2022] DELETE /identity/v3/users/cd15269462f748f082201bfc6ca00edf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:57.413864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:57.418786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:57.443197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7dc3-2294-4350-b4cb-b616259dcd90 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:57.526204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:57.607913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:57.608920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:57.609287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:57.609557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] PATH_INFO: `/v3/projects/145cf95833a14db488e4c37412031bf0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:57.620022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=145cf95833a14db488e4c37412031bf0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:57.622162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:57.722127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145cf95833a14db488e4c37412031bf0', 'request_id': 'req-2bb63639-5767-4349-93ec-36c4ba76fc9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:57.733996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145cf95833a14db488e4c37412031bf0', 'request_id': 'req-2bb63639-5767-4349-93ec-36c4ba76fc9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:57.741564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145cf95833a14db488e4c37412031bf0', 'request_id': 'req-2bb63639-5767-4349-93ec-36c4ba76fc9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:57.765677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] The token cache is being invalidate because project 145cf95833a14db488e4c37412031bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:53:57.765677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:57.766349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2bb63639-5767-4349-93ec-36c4ba76fc9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:53:57.769215 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1302/2591] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:53:57 2022] DELETE /identity/v3/projects/145cf95833a14db488e4c37412031bf0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:57.776566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:57.777104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:57.777104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:57.811869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:57.814516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:57.864785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:58.015068 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1290/2592] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:58.023795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.024764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.025685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.054483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:58.057059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:58.066705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1303/2593] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:53:58.072221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.090148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e87f0-304e-48df-a369-dd0043ae5eee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.102584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.104978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.106423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.108477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.109479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:53:58.117180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.119148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.144227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1291/2594] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:53:58.145343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.155730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0821d16-448e-4239-887f-810dcd263b6b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.162143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.162838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.163121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.163396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.164117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.166177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.226291 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1304/2595] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:58 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:58.230616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.246817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9569c-742c-45df-bc77-86ab41e5ba27 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.410774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.411693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.412086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.412596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.413427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.416569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.450530 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1292/2596] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:58 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:53:58.452639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.464414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666282f-e740-4f93-9e90-557e78db929e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.471435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.472330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.472805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.473734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.474639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.476752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.489896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1305/2597] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:58.496257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.510084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3072b-194f-4a54-8a40-58742bb0d5c4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.522098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.525359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.525882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.526162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.527687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.529519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f24aa-24e2-4ced-af86-81d9c5372f74 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.574580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1293/2598] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:58.576480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:58.590175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806039-b7e0-4452-9046-ede9868ad40a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:58.599826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:58.601748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.602586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.603225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] PATH_INFO: `/v3/projects/ffc79bc6b4044f1f84aee87e120e9400/users/22ea2bdfd5f049339883a0f612a94bb6/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.620649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc79bc6b4044f1f84aee87e120e9400, user_id=22ea2bdfd5f049339883a0f612a94bb6, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:58.638271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:58.706431 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1306/2599] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:58 2022] PUT /identity/v3/projects/ffc79bc6b4044f1f84aee87e120e9400/users/22ea2bdfd5f049339883a0f612a94bb6/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:58.720312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4660-a9a5-4030-babe-11415649bef4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:58.720569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4660-a9a5-4030-babe-11415649bef4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:58.720853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4660-a9a5-4030-babe-11415649bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:58.821837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c33e4660-a9a5-4030-babe-11415649bef4 None None] MFA Rules not processed for user `22ea2bdfd5f049339883a0f612a94bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:58.825755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c33e4660-a9a5-4030-babe-11415649bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:59.020261 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1294/2600] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:59.021543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.125337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:59.156580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e4e5-8e4d-481a-aaec-2228716dd80b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.168484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.169104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.170496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.170776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.171500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.173503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:59.193458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.193750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.194026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.228604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:59.253984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] MFA Rules not processed for user `67284d616ad14540b8e798ce389b10a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:59.255525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:59.266614 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1307/2601] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:53:59 2022] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:59.271904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.442286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fcb44-97e3-4a3e-ad51-dca751be5d81 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.454244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.455726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.459714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.460647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.464379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.474810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03330c1c-4b00-499d-b2ab-a2f4d49129f6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:59.514977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1295/2602] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:59.521512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1308/2603] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:53:59 2022] POST /identity/v3/users => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:53:59.525978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.528610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.529107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.529557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.566491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e22db-3155-4d16-b0d8-359457cc617e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.578995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.579685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.580060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.580251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.581038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.583193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:59.584490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] MFA Rules not processed for user `67284d616ad14540b8e798ce389b10a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:53:59.586034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:53:59.609723 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1296/2604] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:59.610684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.611044 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1309/2605] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:53:59.642631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845e2e-c987-4698-a81d-59b5d3669300 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.655675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.656688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.656970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.657606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] PATH_INFO: `/v3/projects/2d3cfd1a019e4d589adfc828f67276c0/users/1514d7044df24d0e9b8e68fce9fe30f7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.691959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3cfd1a019e4d589adfc828f67276c0, user_id=1514d7044df24d0e9b8e68fce9fe30f7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.696549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:59.723951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.725313 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1297/2606] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:59 2022] PUT /identity/v3/projects/2d3cfd1a019e4d589adfc828f67276c0/users/1514d7044df24d0e9b8e68fce9fe30f7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:53:59.745789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412614-0ab2-4bcc-951b-806ce59efa7c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.889203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.889925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.890210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.890488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.891354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.893151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f999f9-a422-4bc9-8141-7ab06620fead admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:59.918710 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1310/2607] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:53:59.920725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:59.940685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2716-3f40-4285-8e3e-51598ca575ab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:59.961371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:59.962781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:59.963069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:59.963352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] PATH_INFO: `/v3/projects/2d3cfd1a019e4d589adfc828f67276c0/users/1514d7044df24d0e9b8e68fce9fe30f7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:59.977466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3cfd1a019e4d589adfc828f67276c0, user_id=1514d7044df24d0e9b8e68fce9fe30f7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:59.985467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:00.025930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1298/2608] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:53:59 2022] PUT /identity/v3/projects/2d3cfd1a019e4d589adfc828f67276c0/users/1514d7044df24d0e9b8e68fce9fe30f7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:00.035934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:00.036156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:00.036569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:00.082152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] MFA Rules not processed for user `1514d7044df24d0e9b8e68fce9fe30f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:00.083688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:00.172991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:00.196612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:00.199154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:00.256924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1311/2609] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:00.365506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8980-b846-4962-87c1-c1745c08885d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:00.382216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:00.388320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:00.388787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:00.389178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:00.476855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:00.503058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:00.505163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:00.527438 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1299/2610] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:01.175049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:01.176530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:01.207671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd4edb-6ac5-4ca4-af74-6ac712576248 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:01.213734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:01.215816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:01.216103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:01.216387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:01.389427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:01.391679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:01.407504 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1312/2611] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:03.301380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:03.314402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f714fa-3d96-411d-9236-f5855841753a service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:03.320323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:03.321126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:03.321582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:03.321951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:03.332865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:03.334548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a61734-6cc9-459c-813e-f8a3aa0bd5ba service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:03.348892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1300/2612] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:07.525244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:07.540887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5822e25-ede2-443b-bdc2-cad9cec901a9 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:07.548290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:07.549274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:07.549683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:07.550029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:07.551946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:07.658427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:07.660181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde670d-9fb6-4fad-afd7-d8c4563a8cbc service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:07.688668 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1313/2613] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:09.526096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:09.526604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:09.526710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:09.528024 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1301/2614] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:54:09.533810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:09.534282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:09.534629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:09.554413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:09.555973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:09.641423 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1314/2615] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:09.665555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:09.667546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:09.685154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0ed4-b321-4396-8676-3dbcbdf27a03 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:09.691454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:09.692233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:09.692551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:09.692832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:09.703185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:09.704884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49251-b2ff-47c3-8107-6462b69d1a86 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:09.716204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1302/2616] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:11.598921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:11.622675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:11.688076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14abd-bdab-447d-8ffc-821f1349488a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:11.699061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:11.700065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:11.700347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:11.700738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] PATH_INFO: `/v3/users/22ea2bdfd5f049339883a0f612a94bb6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:11.705518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ea2bdfd5f049339883a0f612a94bb6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:11.708141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:11.783269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ea2bdfd5f049339883a0f612a94bb6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:11.784087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ea2bdfd5f049339883a0f612a94bb6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:11.795910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ea2bdfd5f049339883a0f612a94bb6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:11.811791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ea2bdfd5f049339883a0f612a94bb6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:11.819969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ea2bdfd5f049339883a0f612a94bb6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:11.826662 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1315/2617] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:11 2022] DELETE /identity/v3/users/22ea2bdfd5f049339883a0f612a94bb6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:11.831481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439052-9cc5-4bba-9d65-dac6db3a70a9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:11.831977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439052-9cc5-4bba-9d65-dac6db3a70a9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:11.832081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439052-9cc5-4bba-9d65-dac6db3a70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:11.859891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-75439052-9cc5-4bba-9d65-dac6db3a70a9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:11.861560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-75439052-9cc5-4bba-9d65-dac6db3a70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:11.932740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1303/2618] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:11.951278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:11.953003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.017187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2d7-1238-4c48-9b4a-55a0bc5a2da9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.021091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.024949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.026190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.026190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.035770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.037397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c5bf7-ffdf-45bc-a1be-9c142fbde42f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:12.049728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1316/2619] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:12.064759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.065244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.065624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.067253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1304/2620] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:54:12.073881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.074176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.074457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.095315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:12.096575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.148928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:12.149146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:12.149146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.187361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1317/2621] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:12.212614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:12.214216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.228223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769cb5-3951-4a57-906f-9da2692ddb51 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.236230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.236933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.237218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.237494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.250158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.251917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:12.253153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d230-180c-45d2-8923-04a8a943fa6c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.263346 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1318/2622] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:54:12.264188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:12.265519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.267734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.268710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.269259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.270431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.274027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.279722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb50c1-d3b7-4dfb-8f79-509079524306 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.287504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.289033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.289317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.289591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] PATH_INFO: `/v3/projects/ffc79bc6b4044f1f84aee87e120e9400` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.290891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc79bc6b4044f1f84aee87e120e9400)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.292887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:12.362739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:12.364892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc79bc6b4044f1f84aee87e120e9400', 'request_id': 'req-e91b98d6-b937-49e3-946c-c6d86a5d143d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.368285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.369986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:12.373503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc79bc6b4044f1f84aee87e120e9400', 'request_id': 'req-e91b98d6-b937-49e3-946c-c6d86a5d143d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.380577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc79bc6b4044f1f84aee87e120e9400', 'request_id': 'req-e91b98d6-b937-49e3-946c-c6d86a5d143d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.383144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1305/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:54:12.397703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] The token cache is being invalidate because project ffc79bc6b4044f1f84aee87e120e9400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:12.398019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.399153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e91b98d6-b937-49e3-946c-c6d86a5d143d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.403349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1319/2624] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:12 2022] DELETE /identity/v3/projects/ffc79bc6b4044f1f84aee87e120e9400 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:12.417847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:12.419943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.420230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.420542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.433232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f00f-b68a-47b6-8848-643ce6fa29bb service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.454660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] MFA Rules not processed for user `af65f7ab19604ee1841ce4ae7e65a994`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:12.456982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.513540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.514416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.514701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.514975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] PATH_INFO: `/v3/users/1514d7044df24d0e9b8e68fce9fe30f7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.516325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1514d7044df24d0e9b8e68fce9fe30f7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.519747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:12.556955 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1320/2625] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:12.586122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1514d7044df24d0e9b8e68fce9fe30f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.602216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1514d7044df24d0e9b8e68fce9fe30f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.621273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1514d7044df24d0e9b8e68fce9fe30f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.622854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1514d7044df24d0e9b8e68fce9fe30f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.623466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d1195dd-41de-4953-9d7b-8fc1c5497df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1514d7044df24d0e9b8e68fce9fe30f7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:12.638564 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1306/2626] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:12 2022] DELETE /identity/v3/users/1514d7044df24d0e9b8e68fce9fe30f7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:12.857291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:12.859119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:12.889594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c5e1d-bd06-4cd5-b3ed-d541653f01c1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:12.969443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:12.989838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:12.991622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:12.991622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:12.991622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] PATH_INFO: `/v3/projects/2d3cfd1a019e4d589adfc828f67276c0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:12.993554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3cfd1a019e4d589adfc828f67276c0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:12.996732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.068719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3cfd1a019e4d589adfc828f67276c0', 'request_id': 'req-15455e05-5fe4-46c7-a38e-c58965b92821'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:13.083253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3cfd1a019e4d589adfc828f67276c0', 'request_id': 'req-15455e05-5fe4-46c7-a38e-c58965b92821'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:13.093955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3cfd1a019e4d589adfc828f67276c0', 'request_id': 'req-15455e05-5fe4-46c7-a38e-c58965b92821'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:13.111971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] The token cache is being invalidate because project 2d3cfd1a019e4d589adfc828f67276c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:13.112305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:13.113403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15455e05-5fe4-46c7-a38e-c58965b92821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:13.115362 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1321/2627] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:12 2022] DELETE /identity/v3/projects/2d3cfd1a019e4d589adfc828f67276c0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:13.120330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04312-56e4-4d7f-973b-d64c17d589d3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.121249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04312-56e4-4d7f-973b-d64c17d589d3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.121732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04312-56e4-4d7f-973b-d64c17d589d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.130314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff0bb-0278-4c24-9dc6-33821c741ab3 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.130647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff0bb-0278-4c24-9dc6-33821c741ab3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.131069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff0bb-0278-4c24-9dc6-33821c741ab3 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.133656 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1322/2628] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:54:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:54:13.150648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.151802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.152238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.154669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d1b04312-56e4-4d7f-973b-d64c17d589d3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:13.156254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d1b04312-56e4-4d7f-973b-d64c17d589d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.183716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:13.184984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.229998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1307/2629] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:13.237299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.237893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.238362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.258830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:13.260026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.261601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1323/2630] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:13.271953 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1308/2631] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:13.273867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.274156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.275598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.285358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed42f-5a73-4907-aaab-c17922bad838 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.290914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.291708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.292006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.292310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.293078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:54:13.293382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.294926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:13.295073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.312387 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1324/2632] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:54:13.317378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.346639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5ce5-3ee9-4519-98bf-6679e68be990 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.351898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.352641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.352973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.353249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.353973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.355985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356cc11-e54b-4c2c-a2b1-56f01eaf9907 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.362336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f9b2-05a5-4da2-96c7-b0589621dd3f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.366165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.366920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.367270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.367617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.381110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.382751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.394995 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1309/2633] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:13.404177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1325/2634] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:13.410294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.415656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.415996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.416278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.424750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2990d6-bdb6-45a0-aa7d-51997af2b954 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.459090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:13.463986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.522493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.523496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.523791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.524069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.524882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.529512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.540984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:13.600997 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1326/2635] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:13.602606 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1310/2636] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:13.607024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.609239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.622696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa51c5b-2e2f-4ccd-a112-02c1e9ab2536 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.628417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.629481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.629991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.630512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.631467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.633231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.635136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff1b-43f8-4f97-a1da-2d919b77a199 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.644632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.645706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.645840 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1327/2637] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:54:13.645941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.646070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.651641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.661027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.663688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.670938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d5b4-4bbe-4e26-a50f-5b937a247537 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.679057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1311/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:13.682156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.682987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.683366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.683758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.684640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.686504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec909810-5a5d-4ed4-8ded-d801001540cc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.705350 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1328/2639] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:13.707488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:13.724706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1aa0-d000-481b-b022-63e4a356118c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:13.732059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:13.733721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.734007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.734272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] PATH_INFO: `/v3/projects/9dc09e5f180c457dbba0f2cbbcb04bc7/users/2696f9ac198046f0904f307310ca3644/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.761578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc09e5f180c457dbba0f2cbbcb04bc7, user_id=2696f9ac198046f0904f307310ca3644, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:13.764598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:13.788025 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1312/2640] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:13 2022] PUT /identity/v3/projects/9dc09e5f180c457dbba0f2cbbcb04bc7/users/2696f9ac198046f0904f307310ca3644/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:13.799942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:13.800455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:13.800768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:13.850030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] MFA Rules not processed for user `2696f9ac198046f0904f307310ca3644`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:13.851556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:13.986341 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1329/2641] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:13.987829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.113191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeac27e-21b4-4258-950b-18cb70b29dc7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.120392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.122332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.122765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.123201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.124063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.127182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.132590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:14.191864 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1313/2642] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:13 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:54:14.193051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.207615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b6ab4-39fe-4085-af97-ca17bec4e0d6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.312161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.312908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.313194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.313471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.314241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.316719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.366894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1330/2643] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:14 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:14.369817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.393595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6334-14a1-4e0b-851a-62ec95621c28 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.405391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.407079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.407362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.407636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.409636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.413543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.439037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1314/2644] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:54:14.443358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.457223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cf041-456f-4068-a136-6af342810977 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.464022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.465327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.465665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.465951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] PATH_INFO: `/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f/users/59f95c874cf44b56ae576d2db1b2402a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.490379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5e84bc2a284aeb892ff7cfef2ea08f, user_id=59f95c874cf44b56ae576d2db1b2402a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.493394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.522767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1331/2645] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:14 2022] PUT /identity/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f/users/59f95c874cf44b56ae576d2db1b2402a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:14.524106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.545878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83bcc-4e6f-4f73-b4c3-8427eaf25779 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.659460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.661761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.662057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.662349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.663300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.665566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3483a-5cde-4a4c-8efe-32ecc236a13d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.720888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1315/2646] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:14.721178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:14.737186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f6049-3a16-4830-9ca8-298fd9185158 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:14.760900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:14.763323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.766200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.766886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] PATH_INFO: `/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f/users/59f95c874cf44b56ae576d2db1b2402a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.773627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5e84bc2a284aeb892ff7cfef2ea08f, user_id=59f95c874cf44b56ae576d2db1b2402a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:14.780751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:14.827966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1332/2647] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:14 2022] PUT /identity/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f/users/59f95c874cf44b56ae576d2db1b2402a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:14.839733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:14.840019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:14.840296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:14.891415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] MFA Rules not processed for user `59f95c874cf44b56ae576d2db1b2402a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:14.892696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:15.015777 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1316/2648] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:15.027562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:15.032770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:15.041687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:15.128949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec226b-4f5a-4aae-8963-dbb1ee48738b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:15.135543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:15.137016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:15.137352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:15.137729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:15.149263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:15.151046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c389ec-a27f-451a-9d63-2e8c78bfaddd service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:15.173848 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1333/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:15.436276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:15.518608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:15.529099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9edab-d9b0-478b-b0d0-dc8f67c8cf2e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:15.538620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:15.539912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:15.540203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:15.540877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] PATH_INFO: `/v3/users/2696f9ac198046f0904f307310ca3644` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:15.542485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2696f9ac198046f0904f307310ca3644)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:15.544586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:15.617139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2696f9ac198046f0904f307310ca3644'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:15.633691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2696f9ac198046f0904f307310ca3644'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:15.648177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2696f9ac198046f0904f307310ca3644'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:15.648973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2696f9ac198046f0904f307310ca3644'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:15.649633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2696f9ac198046f0904f307310ca3644'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:15.664189 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1317/2650] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:15 2022] DELETE /identity/v3/users/2696f9ac198046f0904f307310ca3644 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:15.671231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f1bb-d5b5-439e-aa63-b6e787956098 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:15.671530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f1bb-d5b5-439e-aa63-b6e787956098 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:15.671849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f1bb-d5b5-439e-aa63-b6e787956098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:15.695047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-46e5f1bb-d5b5-439e-aa63-b6e787956098 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:15.696369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-46e5f1bb-d5b5-439e-aa63-b6e787956098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:15.792356 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1334/2651] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:15.799146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:15.800653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:15.875658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406379-fa4e-4b33-99c6-a9ee47c092f1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:15.880736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:15.881418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:15.881708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:15.881991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:15.892376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:15.893889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:15.905109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1318/2652] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:16.531766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:16.531766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:16.532388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:16.550656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:16.551994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:16.610256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:16.614790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:16.643277 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1335/2653] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:16.669870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d449b-0120-47da-b747-1f4dafece479 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:16.674988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:16.675861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:16.676272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:16.676590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] PATH_INFO: `/v3/projects/9dc09e5f180c457dbba0f2cbbcb04bc7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:16.677855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc09e5f180c457dbba0f2cbbcb04bc7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:16.680367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:16.739872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc09e5f180c457dbba0f2cbbcb04bc7', 'request_id': 'req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.748832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc09e5f180c457dbba0f2cbbcb04bc7', 'request_id': 'req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.755663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc09e5f180c457dbba0f2cbbcb04bc7', 'request_id': 'req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.770116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] The token cache is being invalidate because project 9dc09e5f180c457dbba0f2cbbcb04bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:16.770415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.771098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.777557 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1319/2654] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:16 2022] DELETE /identity/v3/projects/9dc09e5f180c457dbba0f2cbbcb04bc7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:16.778494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:16.809601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda8a0e-9ba0-45c8-914a-2a627baf651d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:16.863906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:16.909143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:16.910695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:16.910984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:16.911265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] PATH_INFO: `/v3/users/59f95c874cf44b56ae576d2db1b2402a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:16.912954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f95c874cf44b56ae576d2db1b2402a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:16.915167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:16.979319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f95c874cf44b56ae576d2db1b2402a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.980342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f95c874cf44b56ae576d2db1b2402a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:16.997039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f95c874cf44b56ae576d2db1b2402a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:17.029810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f95c874cf44b56ae576d2db1b2402a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:17.038317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b67b0259-d29a-4b8b-83a9-d76f35c18e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f95c874cf44b56ae576d2db1b2402a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:17.045001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1336/2655] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:16 2022] DELETE /identity/v3/users/59f95c874cf44b56ae576d2db1b2402a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:17.626553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:17.628221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:17.650563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:17.662096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97f8f8-e28f-4c11-93dc-d5d1c5c86df7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:17.844395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:17.846586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:17.847198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:17.847817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] PATH_INFO: `/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:17.850177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5e84bc2a284aeb892ff7cfef2ea08f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:17.853776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:17.970750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5e84bc2a284aeb892ff7cfef2ea08f', 'request_id': 'req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:17.984719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5e84bc2a284aeb892ff7cfef2ea08f', 'request_id': 'req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:17.991770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5e84bc2a284aeb892ff7cfef2ea08f', 'request_id': 'req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:18.003597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] The token cache is being invalidate because project bc5e84bc2a284aeb892ff7cfef2ea08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:18.004192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:18.004758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4b82036-7e87-4bc8-a03c-38f60bdebbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:18.006542 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1320/2656] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:17 2022] DELETE /identity/v3/projects/bc5e84bc2a284aeb892ff7cfef2ea08f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:18.012594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.013748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.014372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.063671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:18.065357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:18.211810 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1337/2657] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:18.213635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.213892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.214243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.239344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:18.241370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:18.252673 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1321/2658] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:18.257067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.269487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153de6-671f-44de-9a01-8668be3fb3f3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.285231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.286314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.286314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.286514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.287313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:54:18.287570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.289258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.309002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1338/2659] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:54:18.310980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.335504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9a726-0cf3-47a5-8d2f-cd7c9c1b36d3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.363955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.364985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.365642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.367408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.369282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.372632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.434639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.435095 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1322/2660] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:18 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:18.450111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9476a-b0b1-4755-86d5-bbae5b45d281 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.549404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:18.572191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.573016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.573382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.573766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.574698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.577061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.616449 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1339/2661] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:18 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:18.620307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.630868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c554c2c-fa9b-4561-bb90-0cbee072d96a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.638158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.639218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.639590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.639954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.640957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.642781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.834665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1323/2662] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:18.839113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.852874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5276c-2ae2-45b6-903b-edf9bb0b8b9e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.859143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.860105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.860633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.861159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.862121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.864786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169ff0-5321-4125-9e0a-ca6f10fce79b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.883369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1340/2663] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:18.887794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:18.898955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda44a-917e-48d9-a71e-015a65051e56 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:18.904523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:18.905538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.906175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.906663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] PATH_INFO: `/v3/projects/c734d57dbb974b2bba1efc21917a7269/users/9a8cd690a02e4b47afb24d9d4dba52b9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.927103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c734d57dbb974b2bba1efc21917a7269, user_id=9a8cd690a02e4b47afb24d9d4dba52b9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:18.930461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:18.947155 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1324/2664] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:18 2022] PUT /identity/v3/projects/c734d57dbb974b2bba1efc21917a7269/users/9a8cd690a02e4b47afb24d9d4dba52b9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:18.953465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1b90c-fa9d-443f-a778-a4bc05365255 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:18.953995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1b90c-fa9d-443f-a778-a4bc05365255 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:18.954539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1b90c-fa9d-443f-a778-a4bc05365255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:18.975349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0f1b90c-fa9d-443f-a778-a4bc05365255 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:18.976780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0f1b90c-fa9d-443f-a778-a4bc05365255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:19.076350 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1341/2665] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:19.089697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:19.092535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:19.145515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:19.165077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706841-3610-412c-8184-0b1b9a5e1ccd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:19.168694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:19.169342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:19.169618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:19.169886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:19.179227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:19.180815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:19.190544 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1325/2666] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:26.655991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:26.656981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:26.657575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:26.691613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] MFA Rules not processed for user `9a8cd690a02e4b47afb24d9d4dba52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:26.693209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:26.786177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1342/2667] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:26.790758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:26.814210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0e3d-f434-40a1-8d30-a7b94ad80357 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:26.819504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:26.820303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:26.820728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:26.821070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:26.822540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:26.824732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:26.874391 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1326/2668] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:26 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:26.875347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:26.889117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40b94-f19f-4021-a650-379f3c79dd91 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.003555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:27.030997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.031772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.032099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.032380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.033198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.036569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.069217 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1343/2669] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:26 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:27.075067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.092891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b05651-24c5-46b7-aba1-71ba53f3ec0b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.105927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.107775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:27.113580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.114273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.114550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.114818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.117491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.123683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.154887 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1327/2670] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:27.158963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.181195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2b48-9edf-4bd8-ad28-3eaf84227e30 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.213468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.217188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.217495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.217778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] PATH_INFO: `/v3/projects/b4e23fb2c30f4011bb282de21bfa377f/users/18e3ab49c8ff457fa39b252d305e5766/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.281538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e23fb2c30f4011bb282de21bfa377f, user_id=18e3ab49c8ff457fa39b252d305e5766, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.284908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.286404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc689-cdc6-41d4-9095-55cbb3105072 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.293727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.295428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.295570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.296220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.298715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:27.312809 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1328/2671] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:27 2022] PUT /identity/v3/projects/b4e23fb2c30f4011bb282de21bfa377f/users/18e3ab49c8ff457fa39b252d305e5766/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:27.317241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.441125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.442777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.457941 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1344/2672] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:27.461716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.464510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:27.484704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb1e7-ab1f-40af-86c9-a39dd04d6be0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.489600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.490126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.490856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.490856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.491391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.493147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.516960 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1329/2673] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:54:27.521398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:27.541671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186af581-ccd2-4dee-9d28-24d29d53e284 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.549919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.550972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.551300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.551639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] PATH_INFO: `/v3/projects/b4e23fb2c30f4011bb282de21bfa377f/users/18e3ab49c8ff457fa39b252d305e5766/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.562130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e23fb2c30f4011bb282de21bfa377f, user_id=18e3ab49c8ff457fa39b252d305e5766, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.568012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9383-8863-4ea8-9544-eb75f87317fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.599286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1330/2674] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:27 2022] PUT /identity/v3/projects/b4e23fb2c30f4011bb282de21bfa377f/users/18e3ab49c8ff457fa39b252d305e5766/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:27.659397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e413041-2c4e-4422-b2fd-7c97025d1d8a service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:27.688750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:27.782584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:27.783558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:27.783943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:27.784336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:27.787847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:27.812185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:27.824747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:27.853470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1345/2675] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:31.486017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:31.486977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:31.489003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:31.519982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] MFA Rules not processed for user `e9c6e12528ea4760bed65f994df57783`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:31.522021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:31.599056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1331/2676] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:33.384764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:33.411072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31112e2-6a0b-48c7-8e1a-fe0b18e70478 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:33.423760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:33.425054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:33.425054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:33.425241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:33.427901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:33.445540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:33.448788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aad32-12d8-4f43-99de-8e5eefae598c service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:33.452750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:33.455066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:33.468378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:33.475483 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1346/2677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:33.479604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aa13c-c58d-4039-b8d1-e0c6af1ded7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:33.487370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:33.488232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:33.488550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:33.489032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:33.499488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:33.501823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:33.514196 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1332/2678] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:40.901908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:40.903503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:40.903941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:41.002502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] MFA Rules not processed for user `18e3ab49c8ff457fa39b252d305e5766`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:41.004079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:41.573740 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1347/2679] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 674 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:41.582064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:41.584159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:41.703316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28bd7-a39e-4aff-851f-f15921781544 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:41.708729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:41.709805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:41.710259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:41.711693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:41.722800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:41.724893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:41.738932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1333/2680] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:41.839894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:41.843819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:42.030436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29f96-ef24-43ee-b969-97f68fed8044 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:42.045198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:42.046254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:42.046643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:42.047020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] PATH_INFO: `/v3/users/67284d616ad14540b8e798ce389b10a7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:42.061657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67284d616ad14540b8e798ce389b10a7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:42.065051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:42.126539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:42.183641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67284d616ad14540b8e798ce389b10a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:42.185558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67284d616ad14540b8e798ce389b10a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:42.209631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67284d616ad14540b8e798ce389b10a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:42.241794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67284d616ad14540b8e798ce389b10a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:42.255981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84b5c16-b70c-4dcc-bf4f-136113ae214c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67284d616ad14540b8e798ce389b10a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:42.274723 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1348/2681] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:41 2022] DELETE /identity/v3/users/67284d616ad14540b8e798ce389b10a7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:42.742096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:42.766808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ec8b-e598-4181-b3cd-4cd93f3d6b97 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:42.983007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:42.983924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:42.984209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:42.988661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] PATH_INFO: `/v3/projects/ecaaba0e553049e6a4da58c2c5081305` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:42.991545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecaaba0e553049e6a4da58c2c5081305)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:43.002097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:43.108875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecaaba0e553049e6a4da58c2c5081305', 'request_id': 'req-5817421e-b733-4f36-ab71-2d55974a6eef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:43.123637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecaaba0e553049e6a4da58c2c5081305', 'request_id': 'req-5817421e-b733-4f36-ab71-2d55974a6eef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:43.134059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecaaba0e553049e6a4da58c2c5081305', 'request_id': 'req-5817421e-b733-4f36-ab71-2d55974a6eef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:43.159850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] The token cache is being invalidate because project ecaaba0e553049e6a4da58c2c5081305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:43.160692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:43.161008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5817421e-b733-4f36-ab71-2d55974a6eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:43.170333 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1334/2682] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:42 2022] DELETE /identity/v3/projects/ecaaba0e553049e6a4da58c2c5081305 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:43.172334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:43.172809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:43.172901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:43.234131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:43.235577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:43.437848 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1349/2683] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:43.439297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:43.439930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:43.441620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:43.479972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:43.556868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:43.558373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:43.593139 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1335/2684] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:43.596531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:43.618494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e8117-f5f8-4658-b4cc-43c23a8647e9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:43.630777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:43.631477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:43.631760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:43.632036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:43.632912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:54:43.633223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:43.634859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:43.666633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1350/2685] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:54:43.667955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:43.685428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b67b-9608-470d-aeda-989287874e9d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:43.701042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:43.701042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:43.701042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:43.701042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:43.703973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:43.730385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:43.824045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1336/2686] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:43 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:43.828322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:43.844748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa880-8b02-41fb-a2e2-989d0225c45a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:44.045070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:44.045784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.046995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.047321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.048300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:44.051447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:44.105493 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1351/2687] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:43 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:44.107306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:44.126197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95170da9-43ff-4cb9-8d71-51233229bee3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:44.155730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:44.155730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.155730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.156725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.159523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:44.165373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:44.201170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:44.202330 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1337/2688] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:44.215572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b207c3-349a-47ca-932f-a63d2aa97375 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:44.228828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:44.233082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.233417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.233703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.234508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:44.238235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998be25-0dab-4787-b5fb-3b5fa17023c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:44.274566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:44.291711 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1352/2689] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:44.294235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ac7b0-8260-40d7-8261-c9e2c8b3c6a7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:44.318109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:44.319071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.319355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.319701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] PATH_INFO: `/v3/projects/af0da2567efe463f90d5db2b4a125ba1/users/db1c30066ddd478fafc7c203867fd7de/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.374085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0da2567efe463f90d5db2b4a125ba1, user_id=db1c30066ddd478fafc7c203867fd7de, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:44.374085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baefd4-0adc-4014-b311-e3ab9275c291 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:44.421739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1338/2690] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:44 2022] PUT /identity/v3/projects/af0da2567efe463f90d5db2b4a125ba1/users/db1c30066ddd478fafc7c203867fd7de/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:44.427347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a7fe1-7c9d-4c33-9255-9e29a2d562b1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.427545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a7fe1-7c9d-4c33-9255-9e29a2d562b1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.427814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a7fe1-7c9d-4c33-9255-9e29a2d562b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.436737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:44.491158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.491158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.491158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.493364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-703a7fe1-7c9d-4c33-9255-9e29a2d562b1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:44.498807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-703a7fe1-7c9d-4c33-9255-9e29a2d562b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:44.522947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:44.524290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:44.650289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1339/2691] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:44.687979 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1353/2692] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:44.700004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:44.708293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:44.873731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6790-a6d0-4987-b97f-cade01c4a559 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:44.885043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:44.885718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:44.886003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:44.886278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:44.947253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:44.948977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:44.981397 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1340/2693] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:47.584685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b6c-11ce-4a82-9518-30c5b7853c17 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:47.585502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b6c-11ce-4a82-9518-30c5b7853c17 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:47.585502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b6c-11ce-4a82-9518-30c5b7853c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:47.629893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-759c0b6c-11ce-4a82-9518-30c5b7853c17 None None] MFA Rules not processed for user `db1c30066ddd478fafc7c203867fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:47.631532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-759c0b6c-11ce-4a82-9518-30c5b7853c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:47.683592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:47.685132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:47.703741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9273c-f09f-4487-8b23-a9256172d71d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:47.718947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:47.720147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:47.720819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:47.721299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] PATH_INFO: `/v3/users/af65f7ab19604ee1841ce4ae7e65a994` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:47.724399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af65f7ab19604ee1841ce4ae7e65a994)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:47.727490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:47.782261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1354/2694] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:47.787692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044037-4c9c-414d-b6ca-2874b45d0cce None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:47.788015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044037-4c9c-414d-b6ca-2874b45d0cce None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:47.788367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044037-4c9c-414d-b6ca-2874b45d0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:47.828359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5e044037-4c9c-414d-b6ca-2874b45d0cce None None] MFA Rules not processed for user `db1c30066ddd478fafc7c203867fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:47.830896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5e044037-4c9c-414d-b6ca-2874b45d0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:47.831910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:47.843458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af65f7ab19604ee1841ce4ae7e65a994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:47.876275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1355/2695] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:47.878972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af65f7ab19604ee1841ce4ae7e65a994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:47.891532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:47.891929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:47.892212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:47.921109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af65f7ab19604ee1841ce4ae7e65a994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:47.922207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af65f7ab19604ee1841ce4ae7e65a994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:47.926437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9f6889fe-45e0-4cf8-abd5-4ab502fd617b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af65f7ab19604ee1841ce4ae7e65a994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:47.939024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] MFA Rules not processed for user `db1c30066ddd478fafc7c203867fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:47.940369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:47.977901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1341/2696] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:47 2022] DELETE /identity/v3/users/af65f7ab19604ee1841ce4ae7e65a994 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:47.983262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:47.983803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:47.985330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:48.014253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1356/2697] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:48.021261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:48.023804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:48.039208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:48.042958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:48.264319 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1342/2698] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:48.268444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98d76-573c-461c-93a0-9eb51da662d2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:48.278521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:48.280317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:48.309255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:48.426247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:48.427139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:48.427953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:48.428728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:48.433006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d350a0-eadb-4776-b883-a0f4d30df95f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:48.434139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:48.453949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:48.455303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:48.455811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:48.456276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:48.478253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:48.480060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:48.505385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1343/2699] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:48.542603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:48.544451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:48.556945 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1357/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:48.885448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:48.886975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:48.907516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c29e2-aa48-47b5-8cd5-28d21cde7328 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:48.925662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:48.926714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:48.927274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:48.927654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] PATH_INFO: `/v3/projects/ea50e527346c47a2b3c0f7362ff5449b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:48.929721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea50e527346c47a2b3c0f7362ff5449b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:48.931831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:49.036478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea50e527346c47a2b3c0f7362ff5449b', 'request_id': 'req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.056790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea50e527346c47a2b3c0f7362ff5449b', 'request_id': 'req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.058677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:49.076278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea50e527346c47a2b3c0f7362ff5449b', 'request_id': 'req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.105481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] The token cache is being invalidate because project ea50e527346c47a2b3c0f7362ff5449b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:49.105839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.107798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.115151 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1344/2701] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:48 2022] DELETE /identity/v3/projects/ea50e527346c47a2b3c0f7362ff5449b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:49.116802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:49.137772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3496c-86de-48b7-857b-33f6522d2384 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:49.273530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:49.276127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:49.276617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:49.277071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] PATH_INFO: `/v3/users/026230b7926140c1859a630ebe633242` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:49.280111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=026230b7926140c1859a630ebe633242)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:49.285266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:49.456640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026230b7926140c1859a630ebe633242'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.457256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026230b7926140c1859a630ebe633242'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.467987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026230b7926140c1859a630ebe633242'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.470599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:49.494113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026230b7926140c1859a630ebe633242'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.502132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63eb5cc-0e2a-4323-b0f8-2290f1a689ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026230b7926140c1859a630ebe633242'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:49.519406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1358/2702] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:49 2022] DELETE /identity/v3/users/026230b7926140c1859a630ebe633242 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:50.077728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:50.080172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:50.111586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bcce2-bca1-4ff9-8356-3c2b3ceb5bc3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:50.212474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1fe3b-83f6-4633-9acb-cc1195ab72ad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:50.212474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1fe3b-83f6-4633-9acb-cc1195ab72ad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:50.212474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1fe3b-83f6-4633-9acb-cc1195ab72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:50.257245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f7d1fe3b-83f6-4633-9acb-cc1195ab72ad None None] MFA Rules not processed for user `db1c30066ddd478fafc7c203867fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:50.264994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f7d1fe3b-83f6-4633-9acb-cc1195ab72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:50.426428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:50.427324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:50.427609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:50.427884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] PATH_INFO: `/v3/projects/20751ea751214751af64f3f053198949` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:50.429623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20751ea751214751af64f3f053198949)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:50.431585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:50.507185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1359/2703] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:50.569486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20751ea751214751af64f3f053198949', 'request_id': 'req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:50.593208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20751ea751214751af64f3f053198949', 'request_id': 'req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:50.603251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20751ea751214751af64f3f053198949', 'request_id': 'req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:50.684228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] The token cache is being invalidate because project 20751ea751214751af64f3f053198949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:50.690246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:50.696669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf3ed0ce-e2b4-4ad9-bf4a-ec684df2f296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:50.699203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1345/2704] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:50 2022] DELETE /identity/v3/projects/20751ea751214751af64f3f053198949 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:50.707123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:50.707414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:50.707867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:50.739494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:50.741275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:50.993275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1360/2705] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:50.994948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:50.995727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:50.999035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.111662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:51.113896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:51.148335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.159362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1346/2706] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:54:51.166536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d4bc-f21a-4f9d-a767-e3dce3f2b339 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.193818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.194609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.194901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.195187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.195943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:54:51.196261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.206179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.264316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1361/2707] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:54:51.268971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.280746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087a09f-444b-4610-bc91-bcbc31bd4014 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.304833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.305780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.306220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.306632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.307643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.320193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.419124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.431337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12ad94-ee35-499e-b5b1-ecd576d76b40 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.435236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1347/2708] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:51 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:51.557377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.558619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.558934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.559565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.560356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.562366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.588284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:51.620908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1362/2709] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:51 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:51.625061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.639422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad566-acf0-4b87-a5ff-529135162f93 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.669983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.671738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.672182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.672645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.674173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.676229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.704831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.715883 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1348/2710] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:51.723719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda7572-551e-4b4a-acc3-96a7b652b00d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.747770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.749200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.749662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.750116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.751619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.756905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1512-dcb6-4e98-a7a6-22ce084bf468 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.790634 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1363/2711] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:51.793358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:51.830595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c95ae-f37d-4d8f-bfb8-8730d43e2112 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:51.846317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:51.849656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.850163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.850686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] PATH_INFO: `/v3/projects/5260992f3b084c389ae95a11610b6983/users/63142884f27b46e18e3c0a44dc973199/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:51.899497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5260992f3b084c389ae95a11610b6983, user_id=63142884f27b46e18e3c0a44dc973199, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:51.912379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:51.963600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1349/2712] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:51 2022] PUT /identity/v3/projects/5260992f3b084c389ae95a11610b6983/users/63142884f27b46e18e3c0a44dc973199/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:51.971830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:51.972461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:51.972917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:52.023448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] MFA Rules not processed for user `63142884f27b46e18e3c0a44dc973199`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:52.025052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:52.275174 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1364/2713] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:52.280083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:52.310801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:52.467546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1a89-039a-4214-aa1a-b05b2c220fcd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:52.485317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:52.486009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:52.486489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:52.486935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:52.489347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:52.510576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:52.633765 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1350/2714] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:54:52 2022] POST /identity/v3/projects => generated 393 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:52.638397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:52.654193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc62f-097a-4ca7-aa88-e232d9f6a828 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:52.833337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:52.834366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:52.835650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:52.836462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:52.837341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:52.843458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:52.922985 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1365/2715] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:54:52 2022] POST /identity/v3/users => generated 303 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:54:52.923518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:52.950195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a174a52-7d95-43ee-88bc-93a8d35e79c7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:52.967291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:52.970426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:52.973555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:52.975122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:52.978034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:52.984338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:53.002471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1351/2716] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:54:53.008389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:53.038518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ccbbd-02aa-47da-a324-4b19c4a0cd49 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:53.052991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:53.054309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:53.055482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:53.057028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] PATH_INFO: `/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035/users/4181eb50a22c45538246cbe11e4a7443/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:53.105952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7317ccfced44c9868ae6c4ffbc8035, user_id=4181eb50a22c45538246cbe11e4a7443, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:53.109657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:53.135343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:53.135612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1366/2717] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:53 2022] PUT /identity/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035/users/4181eb50a22c45538246cbe11e4a7443/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:53.145888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a8eae-2ac8-425d-98a3-918a7db12a1f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:53.252615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:53.253305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:53.253586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:53.253859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:53.254597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:53.256376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51888-5cb1-43a7-8052-c38d9fe8cdfe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:53.269723 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1352/2718] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:54:53.274295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:53.304575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e303aed-98ff-4dc5-9f28-cd6e38d55c89 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:53.311275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:53.312615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:53.314857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:53.315354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] PATH_INFO: `/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035/users/4181eb50a22c45538246cbe11e4a7443/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:53.327315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7317ccfced44c9868ae6c4ffbc8035, user_id=4181eb50a22c45538246cbe11e4a7443, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:53.330131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:53.360474 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1367/2719] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:54:53 2022] PUT /identity/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035/users/4181eb50a22c45538246cbe11e4a7443/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:53.378596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb39-9c9c-4b94-afdb-8baf7a929e95 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:53.379131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb39-9c9c-4b94-afdb-8baf7a929e95 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:53.379131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cb39-9c9c-4b94-afdb-8baf7a929e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:53.443314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-66a8cb39-9c9c-4b94-afdb-8baf7a929e95 None None] MFA Rules not processed for user `4181eb50a22c45538246cbe11e4a7443`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:53.452952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-66a8cb39-9c9c-4b94-afdb-8baf7a929e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:53.565715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1353/2720] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:54.047183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:54.054378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:54.145672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9b61-03eb-4101-9759-bba1a64968b4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:54.145964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9b61-03eb-4101-9759-bba1a64968b4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:54.146249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9b61-03eb-4101-9759-bba1a64968b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:54.162391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:54.193589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f28f9b61-03eb-4101-9759-bba1a64968b4 None None] MFA Rules not processed for user `db1c30066ddd478fafc7c203867fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:54.197319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f28f9b61-03eb-4101-9759-bba1a64968b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:54.199494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:54.385208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7ab4-f020-4acc-b23a-ad3b8f103b7b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:54.419138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:54.419853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:54.420134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:54.420413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:54.453969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1354/2721] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:54.455856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:54.458289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:54.496470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1368/2722] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:55.697565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:55.700816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:55.702478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:55.755149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:55.767377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ae00-b7ea-49c8-bee3-159e37a9b7cc service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:55.774757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:55.775731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:55.776204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:55.776733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:55.853736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:55.857739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:55.886158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:55.887818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:55.910325 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1369/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:55.954430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:55.967371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1355/2724] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:56.054592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:56.056181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:56.187493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582028-76b0-40e5-bbee-d105f1ea02e1 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:56.211651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:56.215183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:56.217135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:56.219531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] PATH_INFO: `/v3/users/63142884f27b46e18e3c0a44dc973199` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:56.225827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63142884f27b46e18e3c0a44dc973199)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:56.231974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:56.256895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3e34-fa8c-4fd6-8e33-adb7ff8d058c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:56.273750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:56.274469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:56.274755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:56.275029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:56.288109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:56.304832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:56.309233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b01f18-a198-402d-bf03-71e2166442df service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:56.344148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63142884f27b46e18e3c0a44dc973199'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:56.345899 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1356/2725] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:54:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 20:54:56.355024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63142884f27b46e18e3c0a44dc973199'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:56.394168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:56.407195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63142884f27b46e18e3c0a44dc973199'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:56.441521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63142884f27b46e18e3c0a44dc973199'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:56.461015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63142884f27b46e18e3c0a44dc973199'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:56.484569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1370/2726] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:55 2022] DELETE /identity/v3/users/63142884f27b46e18e3c0a44dc973199 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:54:56.489047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd516-3fac-4ebd-8640-22b817740711 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:56.489388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd516-3fac-4ebd-8640-22b817740711 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:56.489714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd516-3fac-4ebd-8640-22b817740711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:56.547263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1d3cd516-3fac-4ebd-8640-22b817740711 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:56.550951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d3cd516-3fac-4ebd-8640-22b817740711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:56.815013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1357/2727] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:56.880480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:56.882549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:57.017186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fbe99-f03a-4cd0-9c91-3a730b7a62c1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:57.033685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:57.034393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:57.034683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:57.034961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:57.074124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:57.077243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:57.104205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1371/2728] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:54:58.293770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:58.294343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:58.294343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:58.313885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] MFA Rules not processed for user `39e82edaa30d418d96ea37f942d62755`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:58.315878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:58.420076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1358/2729] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:58.799600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:58.825977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:58.853545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ade5-7789-49c6-821c-430e0b6f35f7 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:58.861969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:58.864757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:58.866307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:58.866594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] PATH_INFO: `/v3/projects/5260992f3b084c389ae95a11610b6983` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:58.868282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5260992f3b084c389ae95a11610b6983)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:58.870295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:58.941349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5260992f3b084c389ae95a11610b6983', 'request_id': 'req-ad941f28-bf33-483b-b5c6-0e07e83a38f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:58.953116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5260992f3b084c389ae95a11610b6983', 'request_id': 'req-ad941f28-bf33-483b-b5c6-0e07e83a38f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:58.979876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5260992f3b084c389ae95a11610b6983', 'request_id': 'req-ad941f28-bf33-483b-b5c6-0e07e83a38f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.008630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] The token cache is being invalidate because project 5260992f3b084c389ae95a11610b6983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:54:59.008933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.011556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.015628 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1372/2730] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:54:58 2022] DELETE /identity/v3/projects/5260992f3b084c389ae95a11610b6983 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:54:59.021108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:54:59.042210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b67d-b7b0-464a-be76-205f00e9146d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:54:59.219161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:54:59.220837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:59.221046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:59.221300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] PATH_INFO: `/v3/users/4181eb50a22c45538246cbe11e4a7443` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:59.222548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4181eb50a22c45538246cbe11e4a7443)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:54:59.224517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:54:59.327962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:59.341180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4181eb50a22c45538246cbe11e4a7443'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.355100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4181eb50a22c45538246cbe11e4a7443'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.385611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4181eb50a22c45538246cbe11e4a7443'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.386625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4181eb50a22c45538246cbe11e4a7443'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.387260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d7b7869e-8640-4cc0-8c86-9020b64363a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4181eb50a22c45538246cbe11e4a7443'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:54:59.429010 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1359/2731] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:54:59 2022] DELETE /identity/v3/users/4181eb50a22c45538246cbe11e4a7443 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:00.848974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:00.852902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:00.883119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941f28-bf33-483b-b5c6-0e07e83a38f4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:01.094855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:01.111499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:01.112612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:01.112983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:01.113353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] PATH_INFO: `/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:01.114728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7317ccfced44c9868ae6c4ffbc8035)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:01.121767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:01.230155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7317ccfced44c9868ae6c4ffbc8035', 'request_id': 'req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:01.243803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7317ccfced44c9868ae6c4ffbc8035', 'request_id': 'req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:01.254953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7317ccfced44c9868ae6c4ffbc8035', 'request_id': 'req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:01.284447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] The token cache is being invalidate because project ef7317ccfced44c9868ae6c4ffbc8035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:55:01.284757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:01.285639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-05f8d4d8-d8d4-4d26-a703-b3a7e6830670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:01.288218 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1373/2732] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:55:00 2022] DELETE /identity/v3/projects/ef7317ccfced44c9868ae6c4ffbc8035 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:01.298391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:01.303008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:01.303801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:01.331276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:01.333670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:01.550890 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1360/2733] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:01.685631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1374/2734] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:01.686790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:01.713660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861b5ff-ccca-434c-9fb7-692f86476911 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:01.724935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:01.726133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:01.726656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:01.727111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:01.728797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:55:01.729290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:01.731185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:01.751066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1361/2735] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:55:01.756415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:01.778613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c11f-5599-4815-9aaa-00c7201dbaae None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:01.784548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:01.785110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:01.785398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:01.785882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:01.786596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:01.790533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:01.862774 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1375/2736] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:55:01 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:55:01.864026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:01.875896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657049f2-a18c-410d-bb34-a91f66896253 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:02.018879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:02.021261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.021553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.022792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.023538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:02.025930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:02.089516 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1362/2737] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:55:01 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:55:02.093042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:02.125740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df728173-3f18-4952-beb4-23979752b697 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:02.130712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:02.131486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.131789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.132067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.133938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:02.135688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:02.153184 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1376/2738] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:55:02.154069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:02.169522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a604-2296-4da0-942c-657f40b9d295 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:02.186661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:02.189878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.190368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.190991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.192193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:02.194378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b93ea1-d9a4-487b-9c5f-b8365216b14b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:02.223278 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1363/2739] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:55:02.230154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:02.245254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a095-de36-494e-a135-5d1fad4a7fd6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:02.267019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:02.267961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.268242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.269782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] PATH_INFO: `/v3/projects/0801d9a5f554498ca601b58fd3b7f273/users/d3905dd6225b4bb897143cd1a27df118/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.295902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0801d9a5f554498ca601b58fd3b7f273, user_id=d3905dd6225b4bb897143cd1a27df118, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:02.302300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:02.331957 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1377/2740] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:55:02 2022] PUT /identity/v3/projects/0801d9a5f554498ca601b58fd3b7f273/users/d3905dd6225b4bb897143cd1a27df118/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:02.337927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b94c-a43d-48b4-9b81-d4891ab47711 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.338490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b94c-a43d-48b4-9b81-d4891ab47711 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.338764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903b94c-a43d-48b4-9b81-d4891ab47711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.380691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d903b94c-a43d-48b4-9b81-d4891ab47711 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:02.382222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d903b94c-a43d-48b4-9b81-d4891ab47711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:02.422742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:02.511633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1364/2741] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:55:02.557686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:02.559481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:02.730329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d89c-f566-40b3-b982-f02804280e40 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:02.751440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:02.754270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:02.754977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:02.755371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:02.781991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:02.783637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324291-bd79-4a08-b7df-fd223bbe066a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:02.812173 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1378/2742] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:06.030032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:06.031041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:06.033069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:06.037350 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1365/2743] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:55:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:55:06.054166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:06.054166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:06.054809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:06.090991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:06.094372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:06.179014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:06.374487 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1379/2744] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:06.396465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:06.398607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:06.422821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793d7e-a033-4129-b9cd-5e0ab5b6c46a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:06.431906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:06.433705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:06.434223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:06.434730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:06.449352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:06.451844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdbd45-b26b-45db-9a3a-1444fac056c9 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:06.470361 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1366/2745] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:08.338530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:08.341462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:08.369896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec9922-951e-475a-85c3-92de075f96f3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:08.396995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:08.400990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:08.405716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:08.407226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] PATH_INFO: `/v3/users/7001fd3982074ec9ac00f5acd8efd71d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:08.411778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7001fd3982074ec9ac00f5acd8efd71d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:08.424190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:08.535507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7001fd3982074ec9ac00f5acd8efd71d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:08.536607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7001fd3982074ec9ac00f5acd8efd71d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:08.561309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7001fd3982074ec9ac00f5acd8efd71d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:08.603175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7001fd3982074ec9ac00f5acd8efd71d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:08.628370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7001fd3982074ec9ac00f5acd8efd71d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:08.648850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305b06f-6f02-486d-ab48-aa3e45d196c0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:08.649412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305b06f-6f02-486d-ab48-aa3e45d196c0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:08.649547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305b06f-6f02-486d-ab48-aa3e45d196c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:08.650817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1380/2746] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:55:08 2022] DELETE /identity/v3/users/7001fd3982074ec9ac00f5acd8efd71d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:08.719958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9305b06f-6f02-486d-ab48-aa3e45d196c0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:08.725472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9305b06f-6f02-486d-ab48-aa3e45d196c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:09.076956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1367/2747] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:55:09.105777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:09.109398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:09.358778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53054-70b1-4d98-af07-cd2cf83200fa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:09.372181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:09.375948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:09.376863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:09.377279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:09.413832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:09.415369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:09.442141 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1381/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:11.121420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:11.122506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:11.122989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:11.155917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:11.158838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:11.307036 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1368/2749] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:12.342736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:12.344746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:12.382244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35673c2-2a7a-4ad9-a46a-5b9452225c23 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:12.395892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:12.397600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:12.399044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:12.400197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] PATH_INFO: `/v3/projects/26b3a9ffdd5b4cf5b483c2a770e54a85` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:12.405877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b3a9ffdd5b4cf5b483c2a770e54a85)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:12.411551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:12.506365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:12.566209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'request_id': 'req-bd1d1144-f3b0-4811-ac48-287fe9634b50'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:12.596469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'request_id': 'req-bd1d1144-f3b0-4811-ac48-287fe9634b50'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:12.616861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'request_id': 'req-bd1d1144-f3b0-4811-ac48-287fe9634b50'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:12.656761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] The token cache is being invalidate because project 26b3a9ffdd5b4cf5b483c2a770e54a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:55:12.657283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:12.658067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd1d1144-f3b0-4811-ac48-287fe9634b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:12.663487 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1382/2750] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:55:12 2022] DELETE /identity/v3/projects/26b3a9ffdd5b4cf5b483c2a770e54a85 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:12.665523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:12.697635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7973-7dca-42f4-8e6b-ac67529718e6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:12.925504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:12.941372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:12.946996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:12.947641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:12.948110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] PATH_INFO: `/v3/users/de698ef9f4be4f82b38b9ae7062f88c6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:12.951425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de698ef9f4be4f82b38b9ae7062f88c6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:12.962440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:13.072140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de698ef9f4be4f82b38b9ae7062f88c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:13.092841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de698ef9f4be4f82b38b9ae7062f88c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:13.122334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de698ef9f4be4f82b38b9ae7062f88c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:13.123332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de698ef9f4be4f82b38b9ae7062f88c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:13.124097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de698ef9f4be4f82b38b9ae7062f88c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:13.147738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1369/2751] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:55:12 2022] DELETE /identity/v3/users/de698ef9f4be4f82b38b9ae7062f88c6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:15.241377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:15.241991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:15.241991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:15.290764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] MFA Rules not processed for user `d3905dd6225b4bb897143cd1a27df118`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:15.296296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:15.299239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:15.299375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:15.396924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1383/2752] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:15.481544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33aa5-43fe-4065-aef9-d80625185457 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:15.508984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:15.510072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:15.510364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:15.510645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] PATH_INFO: `/v3/projects/dc160f0e61d84bb4b64a816716d61a23` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:15.517597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:15.521150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:15.529342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc160f0e61d84bb4b64a816716d61a23)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:15.534983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:15.648065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc160f0e61d84bb4b64a816716d61a23', 'request_id': 'req-a53833ec-8897-4784-8597-21598b683d63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:15.668357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc160f0e61d84bb4b64a816716d61a23', 'request_id': 'req-a53833ec-8897-4784-8597-21598b683d63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:15.682799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc160f0e61d84bb4b64a816716d61a23', 'request_id': 'req-a53833ec-8897-4784-8597-21598b683d63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:15.703945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ee00-1063-4269-b0e8-6cefe90af5eb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:15.710163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] The token cache is being invalidate because project dc160f0e61d84bb4b64a816716d61a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:55:15.710812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:15.711483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a53833ec-8897-4784-8597-21598b683d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:15.722000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1370/2753] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:55:15 2022] DELETE /identity/v3/projects/dc160f0e61d84bb4b64a816716d61a23 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:15.733283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3676b-0576-4fd2-99bc-0290d40ba64f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:15.733283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3676b-0576-4fd2-99bc-0290d40ba64f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:15.733283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3676b-0576-4fd2-99bc-0290d40ba64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:15.758137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:15.769562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e8d3676b-0576-4fd2-99bc-0290d40ba64f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:15.770857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e8d3676b-0576-4fd2-99bc-0290d40ba64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:15.833195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:15.882523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:15.883121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:15.883400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:15.883677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:15.891206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:15.949247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1371/2754] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:15.960934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:15.961358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:15.961647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.010632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:16.014901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:16.032240 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1372/2755] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:16.039678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.065919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.069352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.070190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046e76-13c6-4805-a1ea-f82b20f5170c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.087423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.088370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.088557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.091860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1384/2756] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:16.093316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.094123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:55:16.094445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.100827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.155388 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1373/2757] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:55:16.159961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.178644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9698d-5566-4839-8f0a-b75263737585 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.199730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.204618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.204618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.204618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.208699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.221397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.303904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1385/2758] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:55:16 2022] POST /identity/v3/projects => generated 413 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:55:16.308344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.326997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644fee-592e-4335-85fc-0dc8401fc0bc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.470814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.472200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.473859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.477107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.478017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.482356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.521716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.522699 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1374/2759] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:55:16 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:55:16.544308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b043a-4073-4145-9193-3f7531f7105a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.549736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.551139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.551814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.552286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.553346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.555451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.579586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.597706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1386/2760] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:55:16.603805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b854e5-1125-43f0-970f-29013458c49b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.609842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.611650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.612207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.612760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.614566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.616881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c325ef5-d98d-4e03-b905-a261edb20947 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.641860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:16.644783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1375/2761] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:55:16.659068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd2eb7-2499-43a2-9acd-03bf9ec8c11a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:16.690254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:16.690254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.690254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.690254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] PATH_INFO: `/v3/projects/a5871754d5114ee3a8093652ebb6b2b5/users/f9190ad58b5c40958a4fcec77ccdfc5a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.741602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5871754d5114ee3a8093652ebb6b2b5, user_id=f9190ad58b5c40958a4fcec77ccdfc5a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:16.745725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:16.770630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1387/2762] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:55:16 2022] PUT /identity/v3/projects/a5871754d5114ee3a8093652ebb6b2b5/users/f9190ad58b5c40958a4fcec77ccdfc5a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:16.802495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:16.803542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:16.804184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:16.883742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:16.885078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:17.092729 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1376/2763] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:17.104693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:17.106662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:17.227546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378e004-0b56-4f70-91d0-c3296743adc0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:17.232869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:17.244025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:17.244025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:17.244025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:17.255743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:17.257542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ebaad-8e5b-4f78-a5e8-329e37987740 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:17.284505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1388/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:18.950577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:18.955365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:18.992777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:19.171383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aff5aa-6e1e-4042-a44c-3cf364a595c3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:19.187326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:19.188065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:19.188413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:19.188713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:19.190867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:19.269707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:19.271543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9160c4-cc45-4047-8cc0-09efc40a1be3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:19.301374 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1377/2765] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:24.679915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:24.683660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:24.684147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:24.728564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] MFA Rules not processed for user `33d0756150114bc7bd3f6f72b93cb56a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:24.731465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:24.828101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:24.905544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1389/2766] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:26.321378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:26.321955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:26.322063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:26.359152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] MFA Rules not processed for user `9a8cd690a02e4b47afb24d9d4dba52b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:26.363198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:26.382968 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1378/2767] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:27.356319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:27.357004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:27.381636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798e80-e15e-428b-a708-1dcf226e8591 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:27.390306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:27.392443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:27.393011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:27.393526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] PATH_INFO: `/v3/users/d3905dd6225b4bb897143cd1a27df118` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:27.395239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3905dd6225b4bb897143cd1a27df118)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:27.399954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:27.531211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3905dd6225b4bb897143cd1a27df118'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:27.534490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3905dd6225b4bb897143cd1a27df118'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:27.562074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3905dd6225b4bb897143cd1a27df118'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:27.586339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3905dd6225b4bb897143cd1a27df118'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:27.610387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-54097547-f70b-4406-9768-f320de094f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3905dd6225b4bb897143cd1a27df118'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:27.629003 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1390/2768] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:55:27 2022] DELETE /identity/v3/users/d3905dd6225b4bb897143cd1a27df118 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:28.261896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:28.283521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c535d76-ab51-4130-b1f9-13c209bad2ec None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:28.350086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:28.351058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.351406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.351774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] PATH_INFO: `/v3/projects/0801d9a5f554498ca601b58fd3b7f273` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.353165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0801d9a5f554498ca601b58fd3b7f273)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:28.356288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:28.462325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:28.478833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0801d9a5f554498ca601b58fd3b7f273', 'request_id': 'req-cd6d4386-7a3d-4d6b-89ec-86c4568125af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:28.493746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0801d9a5f554498ca601b58fd3b7f273', 'request_id': 'req-cd6d4386-7a3d-4d6b-89ec-86c4568125af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:28.506072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0801d9a5f554498ca601b58fd3b7f273', 'request_id': 'req-cd6d4386-7a3d-4d6b-89ec-86c4568125af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:28.526950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] The token cache is being invalidate because project 0801d9a5f554498ca601b58fd3b7f273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:55:28.527249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:28.528709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cd6d4386-7a3d-4d6b-89ec-86c4568125af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:28.532463 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1379/2769] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:55:28 2022] DELETE /identity/v3/projects/0801d9a5f554498ca601b58fd3b7f273 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:28.537462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899336-1567-46a9-8c93-b1a968466958 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.538515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899336-1567-46a9-8c93-b1a968466958 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.539109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899336-1567-46a9-8c93-b1a968466958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.572635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-73899336-1567-46a9-8c93-b1a968466958 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:28.575146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73899336-1567-46a9-8c93-b1a968466958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:28.681156 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1391/2770] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:28.690515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.691039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.692575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.733703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:28.735070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:28.771113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899336-1567-46a9-8c93-b1a968466958 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:28.771989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1380/2771] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:28.783961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899336-1567-46a9-8c93-b1a968466958 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:28.804995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:28.813316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.813959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.814409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.815357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:55:28.815828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:28.817525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:28.842172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1392/2772] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:55:28.846720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:28.858639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714159-181c-4d77-95da-2ff429718f14 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:28.873201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:28.874045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.874429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.874814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.875593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:28.877778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606988-125d-4dbb-be99-6d5064861108 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:28.910050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1381/2773] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:55:28 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:55:28.914959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:28.926760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d3dcd-25a7-40b8-b037-758a1f20f53e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:28.940628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404dbc-5e7b-4585-8568-e9bc4e1c8703 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:28.940927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404dbc-5e7b-4585-8568-e9bc4e1c8703 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:28.941205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf404dbc-5e7b-4585-8568-e9bc4e1c8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:28.980238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:28.999561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cf404dbc-5e7b-4585-8568-e9bc4e1c8703 None None] MFA Rules not processed for user `f9190ad58b5c40958a4fcec77ccdfc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:29.001376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf404dbc-5e7b-4585-8568-e9bc4e1c8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:29.072433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:29.076826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.078974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.079893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.082361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:29.086957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:29.125737 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1382/2774] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:55:29.137012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.137867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.139001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.144043 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1393/2775] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:55:28 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:55:29.147852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:29.164501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a5586-a3bd-49e9-b726-546b1c2bb97b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:29.170623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:29.171381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] MFA Rules not processed for user `f9190ad58b5c40958a4fcec77ccdfc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:29.171500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.171661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.172122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.173323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:29.173870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:29.177001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:29.193448 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1383/2776] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:29.201152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1394/2777] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:55:29.204844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:29.241110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf393c6-1203-4926-80c0-73478526dc73 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:29.247357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:29.248249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.248728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.249055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.250271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:29.252651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413dfb5-85b5-4a70-97a7-29621a2e5541 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:29.269416 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1384/2778] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:55:29.270087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:29.288974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921554-2add-4aa1-9b68-1daa137b5d59 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:29.300411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:29.301963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.303342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.304092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] PATH_INFO: `/v3/projects/0705a9948d8b49b5a41cde4819c470d0/users/cdf4dbb95b6a440fad542fad69b6a5d8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.343643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0705a9948d8b49b5a41cde4819c470d0, user_id=cdf4dbb95b6a440fad542fad69b6a5d8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:29.347126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:29.395615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1395/2779] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:55:29 2022] PUT /identity/v3/projects/0705a9948d8b49b5a41cde4819c470d0/users/cdf4dbb95b6a440fad542fad69b6a5d8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:29.397090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.400875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.401279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.455119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:29.461805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:29.594574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1385/2780] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:29.833570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:29.836948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:29.953542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74848376-cd0f-4318-9f8a-122161202461 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:29.962064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:29.964130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:29.964541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:29.964878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:29.965612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:29.966015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:29.997640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:30.111429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:30.112387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf348a-c44a-41eb-9547-f391d3ccac09 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:30.136947 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1396/2781] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:30.170300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64a9d5-1f9b-484b-9293-cbe085fa7892 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:30.213126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:30.216374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:30.222925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:30.223338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:30.269662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:30.272450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:30.298775 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1386/2782] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:32.519603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4d30-391e-40f1-9b5f-c55f401f2c70 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:32.520896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4d30-391e-40f1-9b5f-c55f401f2c70 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:32.521383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca4d30-391e-40f1-9b5f-c55f401f2c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:32.543968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-56ca4d30-391e-40f1-9b5f-c55f401f2c70 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:32.545662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56ca4d30-391e-40f1-9b5f-c55f401f2c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:32.574001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:32.679209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1397/2783] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:32.695844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:32.699864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:32.906339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46e18-bd36-4d10-8e4a-e2bf4f189e3d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:32.922354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:32.923087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:32.923377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:32.923654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:32.957775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:32.964214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ba58-c0de-4f51-b82c-61ac5a4cd4d6 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:33.020864 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1387/2784] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:55:42.663251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=14 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:42.994284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=53 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:45.024890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:45.026528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:45.026972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:45.056933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] MFA Rules not processed for user `cdf4dbb95b6a440fad542fad69b6a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:45.058816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:45.139292 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1398/2785] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:45.145687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694413-7696-4230-b189-9f1d6d8caad4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:45.146179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694413-7696-4230-b189-9f1d6d8caad4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:45.146266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694413-7696-4230-b189-9f1d6d8caad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:45.166022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-34694413-7696-4230-b189-9f1d6d8caad4 None None] MFA Rules not processed for user `cdf4dbb95b6a440fad542fad69b6a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:45.167262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-34694413-7696-4230-b189-9f1d6d8caad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:45.174714 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1388/2786] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:45.309055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:45.330989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e5ccb-3dcc-4027-a75f-b87325741c2b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:45.336835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:45.337481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:45.337759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:45.338427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:45.348176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:45.349939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986b1de-9e87-40b8-a0f7-b0c076431b9f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:45.360157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1399/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:55:55.160819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:55.355900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=38 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:00.691253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6529-47db-4ff8-8d73-43dd6eaaf985 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:00.691827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6529-47db-4ff8-8d73-43dd6eaaf985 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:00.691911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6529-47db-4ff8-8d73-43dd6eaaf985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:00.731127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-955a6529-47db-4ff8-8d73-43dd6eaaf985 None None] MFA Rules not processed for user `c6773441662d41b2aecf9e43100633d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:00.735391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-955a6529-47db-4ff8-8d73-43dd6eaaf985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:00.840337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1389/2788] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:04.096612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05ff4-c51f-4022-9860-c4a09612fca1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:04.097598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05ff4-c51f-4022-9860-c4a09612fca1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:04.098130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05ff4-c51f-4022-9860-c4a09612fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:04.137532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a5a05ff4-c51f-4022-9860-c4a09612fca1 None None] MFA Rules not processed for user `e9c6e12528ea4760bed65f994df57783`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:04.143322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a5a05ff4-c51f-4022-9860-c4a09612fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:04.290882 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1400/2789] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:10.830081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=25 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:11.040323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:11.040977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:11.042254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:11.044097 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1390/2790] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:56:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:11.050719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:11.051322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:11.051404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:11.077995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:11.079261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:11.185778 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1401/2791] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:11.197321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:11.199439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:11.223440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcb751-1f46-4f56-b9f1-037501e43ef6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:11.231397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:11.232386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:11.232794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:11.233091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:11.245985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:11.247773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:11.272221 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1391/2792] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:14.243381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:14.245683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:14.261090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5abfd6-d35a-440f-874b-478aa824a7b9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:14.267348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:14.268523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:14.269222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:14.269958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] PATH_INFO: `/v3/users/f9190ad58b5c40958a4fcec77ccdfc5a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:14.271620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9190ad58b5c40958a4fcec77ccdfc5a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:14.273619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:14.325457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9190ad58b5c40958a4fcec77ccdfc5a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.326531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9190ad58b5c40958a4fcec77ccdfc5a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.338864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9190ad58b5c40958a4fcec77ccdfc5a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.356054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9190ad58b5c40958a4fcec77ccdfc5a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.366083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83e9650b-85c9-4ef6-8f27-0fc2dfbf5c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9190ad58b5c40958a4fcec77ccdfc5a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.375090 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1402/2793] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:14 2022] DELETE /identity/v3/users/f9190ad58b5c40958a4fcec77ccdfc5a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:14.677927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:14.690411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77d4c2-0e07-435e-b505-e92504245291 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:14.770677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:14.771902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:14.772374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:14.772879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] PATH_INFO: `/v3/projects/a5871754d5114ee3a8093652ebb6b2b5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:14.774408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5871754d5114ee3a8093652ebb6b2b5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:14.778354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:14.844706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5871754d5114ee3a8093652ebb6b2b5', 'request_id': 'req-2ec3e73d-e2ef-4d69-b031-211975430876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.853998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5871754d5114ee3a8093652ebb6b2b5', 'request_id': 'req-2ec3e73d-e2ef-4d69-b031-211975430876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.862624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5871754d5114ee3a8093652ebb6b2b5', 'request_id': 'req-2ec3e73d-e2ef-4d69-b031-211975430876'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.877342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] The token cache is being invalidate because project a5871754d5114ee3a8093652ebb6b2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:14.877939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.878749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ec3e73d-e2ef-4d69-b031-211975430876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:14.880956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1392/2794] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:14 2022] DELETE /identity/v3/projects/a5871754d5114ee3a8093652ebb6b2b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:14.886033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:14.886851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:14.887322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:14.908524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:14.910534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:14.923675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:15.035076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1403/2795] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:15.043617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.043904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.044182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.071797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:15.073934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:15.083850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1393/2796] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:15.089111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.102896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77c272-806e-4db8-9caa-d4968616bdc3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.109955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.110723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.111206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.111544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.116635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:56:15.117011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.118697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.136698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1404/2797] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:56:15.141352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.151247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800e20-0012-4ac1-a104-2f8e12d36203 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.156288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.157661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.157661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.157661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.158461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.160675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.204982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1394/2798] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:15 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:15.207744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.218505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20919996-43ba-4d04-9385-39d834b68d4f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.275578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.276551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.276834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.277121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.277814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.279718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.326036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1405/2799] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:15 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:56:15.329966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.341321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28258-eebd-4151-bc18-86b68d9f1d22 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.348556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.349402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.349797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.350163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.350985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.352776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.364470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1395/2800] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:15.369045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.379884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a4f7e-9936-4e70-a921-7949ca35ef41 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.386019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.386808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.387205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.387582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.388402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.390118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598f362-358f-40c9-83d5-448dd5987370 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.404613 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1406/2801] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:15.409065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.419633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c041e7-62b1-4d72-a4aa-79c96728cf2f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.424584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.425489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.425772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.426114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] PATH_INFO: `/v3/projects/ca77764a1f5e436db2f6436a02b2fc24/users/dbd8d82d694941b58fa2d18311ea5785/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.442362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca77764a1f5e436db2f6436a02b2fc24, user_id=dbd8d82d694941b58fa2d18311ea5785, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.446584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.472647 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1396/2802] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:15 2022] PUT /identity/v3/projects/ca77764a1f5e436db2f6436a02b2fc24/users/dbd8d82d694941b58fa2d18311ea5785/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:15.486599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842077-1c69-4add-a418-516b58052f1f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.486899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842077-1c69-4add-a418-516b58052f1f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.487348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b842077-1c69-4add-a418-516b58052f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.509286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2b842077-1c69-4add-a418-516b58052f1f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:15.510864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b842077-1c69-4add-a418-516b58052f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:15.585845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1407/2803] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:15.597117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:15.599422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:15.609576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:15.671477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c4718-f19c-4da6-8e1d-f20d19b41e21 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:15.675468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:15.676154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:15.677061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:15.677061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:15.690832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:15.693418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390ed4-fcb2-4d6d-9cb0-1ddbc76eb45a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:15.710398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1397/2804] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:21.765165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:21.765658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:21.765762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:21.812579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] MFA Rules not processed for user `dbd8d82d694941b58fa2d18311ea5785`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:21.813847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:21.844468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:21.921183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1408/2805] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:21.931985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:21.932544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:21.932848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:21.954847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] MFA Rules not processed for user `dbd8d82d694941b58fa2d18311ea5785`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:21.956501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:21.968472 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1398/2806] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:21.994395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:21.996113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:22.093127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fa331-51db-40ef-af5d-d1de90fbfb9c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:22.100695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:22.101381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:22.101664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:22.101943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:22.110874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:22.112551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:22.122514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1409/2807] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:31.949401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=27 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:32.118531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=57 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:42.447648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:42.449284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:42.482010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d8b17-9dca-44b9-a59c-d21a0bafcccc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:42.490020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:42.492860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:42.493337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:42.493774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] PATH_INFO: `/v3/users/33d0756150114bc7bd3f6f72b93cb56a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:42.495615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d0756150114bc7bd3f6f72b93cb56a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:42.499123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:42.572540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d0756150114bc7bd3f6f72b93cb56a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:42.583596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d0756150114bc7bd3f6f72b93cb56a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:42.603541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d0756150114bc7bd3f6f72b93cb56a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:42.609634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d0756150114bc7bd3f6f72b93cb56a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:42.611739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d0756150114bc7bd3f6f72b93cb56a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:42.638136 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1399/2808] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:42 2022] DELETE /identity/v3/users/33d0756150114bc7bd3f6f72b93cb56a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:42.920257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:42.955205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e23a-9c72-472c-a401-0cbfd73162a1 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:43.047598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:43.049130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:43.049599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:43.050686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] PATH_INFO: `/v3/projects/2ce47feeb3ff411a8511889a370e746e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:43.052247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce47feeb3ff411a8511889a370e746e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:43.055395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:43.122376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce47feeb3ff411a8511889a370e746e', 'request_id': 'req-0b7c146e-c9f0-4aef-890e-f665f8704b5e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.135966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce47feeb3ff411a8511889a370e746e', 'request_id': 'req-0b7c146e-c9f0-4aef-890e-f665f8704b5e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.147812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce47feeb3ff411a8511889a370e746e', 'request_id': 'req-0b7c146e-c9f0-4aef-890e-f665f8704b5e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.165248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] The token cache is being invalidate because project 2ce47feeb3ff411a8511889a370e746e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:43.165643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.166364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.167998 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1410/2809] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:42 2022] DELETE /identity/v3/projects/2ce47feeb3ff411a8511889a370e746e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:43.172165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:43.173622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:43.181785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:43.183182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:43.190509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdc1e6-b82d-46c7-9f83-84aa223faceb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:43.262512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c146e-c9f0-4aef-890e-f665f8704b5e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:43.265988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:43.267017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:43.267299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:43.267577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] PATH_INFO: `/v3/users/cc0670c25dc5443db0107674ace9b3d5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:43.267739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:43.268763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:43.268874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0670c25dc5443db0107674ace9b3d5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:43.269212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:43.269576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] PATH_INFO: `/v3/users/db1c30066ddd478fafc7c203867fd7de` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:43.270939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:43.271144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1c30066ddd478fafc7c203867fd7de)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:43.273239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:43.311765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:43.328525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1c30066ddd478fafc7c203867fd7de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.329383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1c30066ddd478fafc7c203867fd7de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.330777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0670c25dc5443db0107674ace9b3d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.340661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1c30066ddd478fafc7c203867fd7de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.344198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0670c25dc5443db0107674ace9b3d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.356934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1c30066ddd478fafc7c203867fd7de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.360573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0670c25dc5443db0107674ace9b3d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.361693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0670c25dc5443db0107674ace9b3d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.362352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d6699c3-9096-4c8c-8547-f487fc2110e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0670c25dc5443db0107674ace9b3d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.364955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:43.365358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1c30066ddd478fafc7c203867fd7de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.373547 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1411/2810] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:43 2022] DELETE /identity/v3/users/db1c30066ddd478fafc7c203867fd7de => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:43.382301 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1400/2811] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:43 2022] DELETE /identity/v3/users/cc0670c25dc5443db0107674ace9b3d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:43.683969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:43.686073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:43.792893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec5f43-8338-44c6-8ba1-301dcc7898eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:43.861265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:43.862201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:43.862483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:43.862750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] PATH_INFO: `/v3/projects/93b37eb8c15148799cec309889c357e1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:43.864116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b37eb8c15148799cec309889c357e1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:43.866101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:43.922779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b37eb8c15148799cec309889c357e1', 'request_id': 'req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.936713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b37eb8c15148799cec309889c357e1', 'request_id': 'req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.939066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:43.944020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b37eb8c15148799cec309889c357e1', 'request_id': 'req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.958394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] The token cache is being invalidate because project 93b37eb8c15148799cec309889c357e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:43.958687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.959452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b84e0617-741b-4f7f-9f3d-1e86f0f32fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:43.966321 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1412/2812] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:43 2022] DELETE /identity/v3/projects/93b37eb8c15148799cec309889c357e1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:43.968112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:43.968635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:43.968752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:43.987408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:43.988804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.052372 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1401/2813] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:44.060247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.060807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.061089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.081406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:44.083530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.100325 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1413/2814] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:44.100548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.114209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718368ae-371b-44e1-8cf4-cce189120684 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.118878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.119544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.119833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.120113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.120874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:56:44.121183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.122811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.134580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1402/2815] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:44.139400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.150084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec0b2-a18d-4865-b0c4-b476161e9085 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.155045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.155712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.155993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.156267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.157207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.159100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.194727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1414/2816] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/projects => generated 395 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:56:44.199102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.228382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31a823-e59f-4e0d-be67-1be714a9530c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.257496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.259737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.323946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.325118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.325599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.326028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.327388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.330759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.350651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e8897-a768-4c2f-beba-dcb455f6a59e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.362427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.363721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.364998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.365398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] PATH_INFO: `/v3/projects/af0da2567efe463f90d5db2b4a125ba1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.366943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0da2567efe463f90d5db2b4a125ba1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.372003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.380817 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1403/2817] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:44.381877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.398882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd032670-2ea6-4e85-b24c-4302f4aa77fe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.421652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.422415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.423575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.423860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.424974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.427653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.443977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1404/2818] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:44.445234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.458637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0da2567efe463f90d5db2b4a125ba1', 'request_id': 'req-8a580847-f91e-4ecb-86c9-c840fd04b427'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:44.465139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dacac4-5e02-4e18-8b9d-4b03baa96e85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.475766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0da2567efe463f90d5db2b4a125ba1', 'request_id': 'req-8a580847-f91e-4ecb-86c9-c840fd04b427'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:44.494590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0da2567efe463f90d5db2b4a125ba1', 'request_id': 'req-8a580847-f91e-4ecb-86c9-c840fd04b427'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:44.529986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] The token cache is being invalidate because project af0da2567efe463f90d5db2b4a125ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:44.530258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:44.531027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8a580847-f91e-4ecb-86c9-c840fd04b427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:44.536035 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1415/2819] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:44 2022] DELETE /identity/v3/projects/af0da2567efe463f90d5db2b4a125ba1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:44.537788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1b7e-d1d6-41e1-891e-f8e41e0dadb0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.538037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1b7e-d1d6-41e1-891e-f8e41e0dadb0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.538317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1b7e-d1d6-41e1-891e-f8e41e0dadb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.582397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a1ea1b7e-d1d6-41e1-891e-f8e41e0dadb0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:44.584242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:44.585001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a1ea1b7e-d1d6-41e1-891e-f8e41e0dadb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.597466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.598470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.599126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.599481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.601326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.604153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.629574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1405/2820] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:44.632657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.635739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.658843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:44.671202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eb1de-89d0-4577-bef8-c0225ec337e3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.686772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.687757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.688041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.688316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] PATH_INFO: `/v3/projects/b5ff3ebdc1a142ba94f056c9c9170c1f/users/6b752490da72475490bda09028f70f1d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.697687 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1416/2821] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:44.700019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.700318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.700720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.720882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ff3ebdc1a142ba94f056c9c9170c1f, user_id=6b752490da72475490bda09028f70f1d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.724245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:44.725321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c045830-c714-4eab-9b8f-d09ec322169e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.725729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.740585 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1417/2822] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:44.741592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.753128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1406/2823] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:44 2022] PUT /identity/v3/projects/b5ff3ebdc1a142ba94f056c9c9170c1f/users/6b752490da72475490bda09028f70f1d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:44.755966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.756332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.756707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.758912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c472f-f1dc-447f-a369-443f83a05371 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.827765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] MFA Rules not processed for user `6b752490da72475490bda09028f70f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:44.830229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:44.853870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.854936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.855237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.855587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.857140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:56:44.857528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.859905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.894290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1418/2824] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:44.895685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.915887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83f54d-4b27-45ab-8848-b13c98b8fc11 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.930706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.931406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.932755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.933114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.933897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.939648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:44.957621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1407/2825] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:44.962609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:44.978596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b732f0-ba8b-4ea4-a0ed-6dace77f658b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:44.988210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:44.989397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:44.989991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:44.990453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:44.992735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:44.995871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.002533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1419/2826] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:45.010912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.075511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1408/2827] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:44 2022] POST /identity/v3/projects => generated 395 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:56:45.076942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.111244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a760-321e-4846-9dbd-26b6b41169f8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.207920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.209175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.209511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.209791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.211219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.216915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.238819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:45.273548 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1420/2828] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:45 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:45.278811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.280876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3242a-d024-41d0-be2d-fe8ec7d3b081 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.286851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.287634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.287998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.289021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.289767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.292726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c2179-c5aa-413d-9cb3-d3c700a1a273 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.292876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.299370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.300236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.300845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.301323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.302219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.304684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.319176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1409/2829] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:45 2022] POST /identity/v3/users => generated 304 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:45.321878 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1421/2830] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:56:45.323086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.324410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.340896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0c6b5-bc79-460d-851c-824b4d94de7e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.345426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6b3c-9b64-44d6-b877-99b26ae238c6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.345807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.346499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.346784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.347080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.347881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.349839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.354286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.355267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.355767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.356566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.357524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.359504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.366262 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1422/2831] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:45.367496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.377703 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1410/2832] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:45.382691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920f8de-10c5-4b3a-be07-b06d1d766f29 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.382912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.388990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.392298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.392793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.394278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] PATH_INFO: `/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0/users/2fb42e647edb4275b602aeb8afba24cd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.396162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30e41-e5f9-465e-8802-08e18220d505 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.403646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.406328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.406716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.407155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] PATH_INFO: `/v3/projects/5fc39b845ba24fc49935ae2ecbf9eefc/users/b9793101e6554c61bd3276d4290c0331/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.419409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f76eb5a27c410688a9ff5ef0e876e0, user_id=2fb42e647edb4275b602aeb8afba24cd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.423432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.428378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:45.432293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc39b845ba24fc49935ae2ecbf9eefc, user_id=b9793101e6554c61bd3276d4290c0331, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.435424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17178f-f252-424d-9d4b-5e1a6f83a2ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.452999 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1423/2833] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:45 2022] PUT /identity/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0/users/2fb42e647edb4275b602aeb8afba24cd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:45.454777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.467796 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1411/2834] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:45 2022] PUT /identity/v3/projects/5fc39b845ba24fc49935ae2ecbf9eefc/users/b9793101e6554c61bd3276d4290c0331/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:45.474798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.475165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.475514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.525647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:45.527602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:45.569510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e1aa-1a11-47a7-8bf3-f540f9d8ce8b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.675928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1412/2835] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:45.698957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.700700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:45.721177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.722152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.723289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.723735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.725832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.728685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.759178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1424/2836] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:56:45.761942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:45.775291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52acb83-65e6-4a69-a47a-6a546eeaf9c3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.781279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.783119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.783890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.784913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] PATH_INFO: `/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0/users/2fb42e647edb4275b602aeb8afba24cd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.803465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f76eb5a27c410688a9ff5ef0e876e0, user_id=2fb42e647edb4275b602aeb8afba24cd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:45.806181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe540b-cf0f-4f9a-9272-fa4f1c5e0a0e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:45.849091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1425/2837] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:45 2022] PUT /identity/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0/users/2fb42e647edb4275b602aeb8afba24cd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:45.851293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.851683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.851967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:45.882035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e75b-eba8-45d2-9ef5-2417c2ee99da None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:45.892733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] MFA Rules not processed for user `2fb42e647edb4275b602aeb8afba24cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:45.894209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:45.943097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:45.992650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:45.993586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:45.994044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:45.994548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:46.050492 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1426/2838] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:46.084884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:46.086213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:46.090899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:46.100919 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1413/2839] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:46.113972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:46.116116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:46.263156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb749a6-53af-478b-8d55-231096dd34a3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:46.283522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:46.284306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:46.284640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:46.284917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:46.302445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:46.304203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508f5e-41ae-47c6-ba73-779fc86b97e2 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:46.330289 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1427/2840] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:46.421475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:46.432972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873eda7-5bab-444e-a46a-33d23464b855 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:46.441467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:46.442760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:46.443139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:46.443508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] PATH_INFO: `/v3/users/6b752490da72475490bda09028f70f1d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:46.444997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b752490da72475490bda09028f70f1d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:46.447162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:46.515534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b752490da72475490bda09028f70f1d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:46.526593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b752490da72475490bda09028f70f1d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:46.545008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b752490da72475490bda09028f70f1d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:46.545761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b752490da72475490bda09028f70f1d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:46.546354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b752490da72475490bda09028f70f1d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:46.562337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1414/2841] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:46 2022] DELETE /identity/v3/users/6b752490da72475490bda09028f70f1d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:46.566866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:46.567154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:46.567434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:46.587784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:46.589175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:46.659216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1428/2842] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:46.669802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:46.671391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:46.730871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065a40f-367a-4b32-b0aa-de36e4865e72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:46.735600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:46.736272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:46.736593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:46.736872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:46.746853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:46.748362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:46.758416 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1415/2843] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:47.396450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:47.398620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:47.412251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ff1e8-aacf-466f-9d38-18b367ce6697 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:47.419738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:47.420924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:47.421220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:47.421531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] PATH_INFO: `/v3/projects/b5ff3ebdc1a142ba94f056c9c9170c1f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:47.423259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ff3ebdc1a142ba94f056c9c9170c1f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:47.425600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:47.486120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:47.497256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ff3ebdc1a142ba94f056c9c9170c1f', 'request_id': 'req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.509491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ff3ebdc1a142ba94f056c9c9170c1f', 'request_id': 'req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.520099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ff3ebdc1a142ba94f056c9c9170c1f', 'request_id': 'req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.535595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] The token cache is being invalidate because project b5ff3ebdc1a142ba94f056c9c9170c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:47.536135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.541399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.547904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1429/2844] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:47 2022] DELETE /identity/v3/projects/b5ff3ebdc1a142ba94f056c9c9170c1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:47.549169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:47.561289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb573-80b6-4b6a-84df-282352d7e645 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:47.702163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:47.703067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:47.703348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:47.703625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] PATH_INFO: `/v3/users/2fb42e647edb4275b602aeb8afba24cd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:47.705047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb42e647edb4275b602aeb8afba24cd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:47.707541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:47.725746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:47.787679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb42e647edb4275b602aeb8afba24cd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.799023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb42e647edb4275b602aeb8afba24cd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.818789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb42e647edb4275b602aeb8afba24cd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.819993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb42e647edb4275b602aeb8afba24cd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.820780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb42e647edb4275b602aeb8afba24cd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:47.840317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1416/2845] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:47 2022] DELETE /identity/v3/users/2fb42e647edb4275b602aeb8afba24cd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:47.867485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:47.868993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:47.987159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d96f8-4db6-4d88-bd06-edf36f0b8741 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:48.064321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:48.065064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.065485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.065654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.067633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:48.155086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:48.157455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511675a-1649-4e29-b3f5-eb0215cc64ae service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:48.172805 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1430/2846] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:48.429477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:48.431276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:48.539628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0079c-0fd0-46e9-a54a-fcaa1668d534 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:48.546638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:48.547528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.547817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.548092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] PATH_INFO: `/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.549375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f76eb5a27c410688a9ff5ef0e876e0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:48.551755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:48.622086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f76eb5a27c410688a9ff5ef0e876e0', 'request_id': 'req-5331eda0-9dc4-4fba-9586-1837ef7a18f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:48.634375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f76eb5a27c410688a9ff5ef0e876e0', 'request_id': 'req-5331eda0-9dc4-4fba-9586-1837ef7a18f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:48.654837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f76eb5a27c410688a9ff5ef0e876e0', 'request_id': 'req-5331eda0-9dc4-4fba-9586-1837ef7a18f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:48.692721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] The token cache is being invalidate because project 08f76eb5a27c410688a9ff5ef0e876e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:48.693268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:48.696844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5331eda0-9dc4-4fba-9586-1837ef7a18f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:48.698819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1417/2847] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:48 2022] DELETE /identity/v3/projects/08f76eb5a27c410688a9ff5ef0e876e0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:48.703700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.704211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.704211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.726326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:48.727894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:48.777034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:48.853839 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1431/2848] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:48.861580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.861872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.862312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.883818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:48.885079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:48.900016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1418/2849] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:48.904502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:48.914765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1fb7-93bc-45d8-a26e-95422a6bdb87 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:48.919341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:48.920006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.920293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.920741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.921513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:56:48.921829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:48.923447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:48.935812 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1432/2850] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:48.940017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:48.949904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5c235-5fae-4549-85a3-6c32a0a91e5f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:48.954649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:48.955430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:48.955778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:48.956117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:48.956917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:48.958961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:48.973526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:48.992260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1419/2851] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:48 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:56:48.994302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.006684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839491-8b15-4766-881c-dad1d2ec131f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.069064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.070217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.070217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.070424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.070981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.072989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.096799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1433/2852] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:48 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:49.101378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.112457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71403ee5-2b0b-4186-b471-3d53db6d5ffa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.117419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.118111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.118396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.118702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.119449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.121249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.132465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1420/2853] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:56:49.137280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.151039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e854e-083b-4feb-b7d4-594c067556c9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.157965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.158688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.158976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.159267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.159992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.161873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97da8ec-1535-4a5c-b94e-4b159b24770d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.177644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.178775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1434/2854] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:49.191318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff88c-75b7-45bd-bd71-e65098f5c596 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.197135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.198366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.198366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.198596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37/users/a47744d718c64cf59765b192c38b8fdb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.215392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37, user_id=a47744d718c64cf59765b192c38b8fdb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.218213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.235688 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1421/2855] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:49 2022] PUT /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37/users/a47744d718c64cf59765b192c38b8fdb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:49.247082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.247082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.247082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.281331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] MFA Rules not processed for user `a47744d718c64cf59765b192c38b8fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:49.283040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:49.418057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1435/2856] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:49.422521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.516634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90457a8-435e-423d-a22d-c9b392be68c8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.523113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.524997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.525665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.526319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.527543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.529784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.574917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1422/2857] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:56:49.578672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.595520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44383c08-d81f-4612-b7a0-4641a2202dcd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.655788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:49.735889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.736623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.736962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.737245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.738037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.740123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.777256 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1436/2858] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:56:49 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:56:49.778740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.790421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853596d-4a48-48b7-a9cb-a8e51ce8775e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.795445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.796132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.796448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.796734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.797532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.799230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.813549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1423/2859] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:49.818330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.830457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10c73b-5dea-49a7-9074-d5972176f680 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.837459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:49.838522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.838884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.839240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] PATH_INFO: `/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18/users/5ffc726b80484e2e9cf4c1c74ad85daf/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:49.862187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad7b75c53d2403fb855644ab8d9ef18, user_id=5ffc726b80484e2e9cf4c1c74ad85daf, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:49.869378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0704518-ee7c-4273-8507-20e72f1a602f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:49.904856 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1437/2860] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:49 2022] PUT /identity/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18/users/5ffc726b80484e2e9cf4c1c74ad85daf/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:49.909083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:49.921184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8a229-f788-4cee-b3f0-adf1cf7780e0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:49.950933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:49.951330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:49.951682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:50.004888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] MFA Rules not processed for user `39e82edaa30d418d96ea37f942d62755`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:50.006365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:50.049361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:50.050067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:50.050515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:50.050795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:50.051641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:50.053609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:50.074984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1424/2861] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:56:50.076246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:50.091666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3a1d2-9a1e-4089-82c6-30dcc40a3c7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:50.096883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:50.098298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:50.098676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:50.099408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] PATH_INFO: `/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18/users/5ffc726b80484e2e9cf4c1c74ad85daf/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:50.101542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad7b75c53d2403fb855644ab8d9ef18, user_id=5ffc726b80484e2e9cf4c1c74ad85daf, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:50.104528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3831-4532-488c-bdcf-2e4dc507e6ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:50.130932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1425/2862] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:56:50 2022] PUT /identity/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18/users/5ffc726b80484e2e9cf4c1c74ad85daf/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:50.132770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1f956-f825-4317-94a8-b7427c47e9ed None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:50.134091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1f956-f825-4317-94a8-b7427c47e9ed None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:50.134385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1f956-f825-4317-94a8-b7427c47e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:50.161861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1438/2863] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:50.228305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-00a1f956-f825-4317-94a8-b7427c47e9ed None None] MFA Rules not processed for user `5ffc726b80484e2e9cf4c1c74ad85daf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:50.229620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-00a1f956-f825-4317-94a8-b7427c47e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:50.248289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:50.443410 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1426/2864] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:50.456455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:50.457944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:50.727293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4397e-c1ff-4d04-be31-6b35e33e3479 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:50.830608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:50.921328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:50.926345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:50.926635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:50.926918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:50.956483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:50.958786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:50.983608 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1439/2865] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:51.015368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:51.016128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:51.017161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:51.021328 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1427/2866] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:51.026746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:51.059112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:51.086654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada489-c0b0-4bc5-a8c1-094c0c566879 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:51.122932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:51.123795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:51.124267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:51.124863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:51.130605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:51.133913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c62709-a094-437c-8e8f-9ffde245d616 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:51.149265 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1440/2867] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:51 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:51.379500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:51.382191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:51.513279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee0622-63ec-4ecf-9627-e70767702b49 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:51.527135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:51.528024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:51.528320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:51.529436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:51.536883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:51.586233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:51.589764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:51.650428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1428/2868] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:51.788733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4b0c-16de-4f86-ae8a-c456cee0f531 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:51.789029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4b0c-16de-4f86-ae8a-c456cee0f531 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:51.789609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4b0c-16de-4f86-ae8a-c456cee0f531 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:51.791002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1441/2869] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:51.804935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:51.806389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:51.828547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:51.855945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ab08-94fc-4f33-99ee-b8e243096bb0 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:51.860885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:51.861816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:51.862100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:51.862374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:51.863870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:51.867692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:51.870803 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1429/2870] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:51 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:52.036797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca836a-6299-467b-8a44-9be03462c895 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:52.037663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca836a-6299-467b-8a44-9be03462c895 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:52.038138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca836a-6299-467b-8a44-9be03462c895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:52.069989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2fca836a-6299-467b-8a44-9be03462c895 None None] MFA Rules not processed for user `a47744d718c64cf59765b192c38b8fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:52.073236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2fca836a-6299-467b-8a44-9be03462c895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:52.204247 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1442/2871] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:52.218581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:52.237539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f1fa7-abae-4bde-9930-3114154a9800 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:52.275132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:52.275819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:52.276107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:52.276475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:52.312860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:52.315139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:52.343541 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1430/2872] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:53.149013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6270fc-f1da-4721-9401-1c63fe7da1e1 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.149597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6270fc-f1da-4721-9401-1c63fe7da1e1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.149727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6270fc-f1da-4721-9401-1c63fe7da1e1 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.151697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1443/2873] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:53.158668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:53.178741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:53.224044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403739de-e155-4d17-a69a-ffa5ede0057e service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:53.252126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:53.252828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.253227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.253749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.255564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:53.258443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:53.262165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1431/2874] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:53 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:53.517258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8414-e268-4c51-917e-34ae7ce953f0 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.518430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8414-e268-4c51-917e-34ae7ce953f0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.518891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf8414-e268-4c51-917e-34ae7ce953f0 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.520897 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1444/2875] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:53.529096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:53.552990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:53.565570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ed6f3-37cd-43af-affb-9a115ff0e0d8 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:53.575793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:53.577743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.578119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.578489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.579827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:53.585507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:53.603554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1432/2876] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:53 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:53.675286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd8c0-7248-446e-aed1-76ebbd1bd6e8 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.677021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd8c0-7248-446e-aed1-76ebbd1bd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.677021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd8c0-7248-446e-aed1-76ebbd1bd6e8 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.680069 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1445/2877] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:53 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:53.690522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:53.720874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:53.735592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3767-fbae-4f88-9055-85dfb885a7f5 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:53.751524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:53.752850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.753292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.765583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.767991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:53.770593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff46bc-1b2b-4ded-98d9-71c971021ce4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:53.772791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1433/2878] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:53 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:53.890060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:53.890349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:53.890627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:53.926602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] MFA Rules not processed for user `a47744d718c64cf59765b192c38b8fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:53.927928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:53.962658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1446/2879] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:54.621582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb17dc-4a6d-417b-b390-84242e9af259 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:54.622055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb17dc-4a6d-417b-b390-84242e9af259 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:54.622515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb17dc-4a6d-417b-b390-84242e9af259 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:54.624916 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1434/2880] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:54.631094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:54.660462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:54.683857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7dc3e-5506-46a4-ae08-fa2fd4ccdb21 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:54.690253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:54.691371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:54.691899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:54.692182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:54.698727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:54.700867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:54.717363 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1447/2881] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:54 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:54.853385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e426e-f8ca-40c9-acde-a7a305c5f223 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:54.853673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e426e-f8ca-40c9-acde-a7a305c5f223 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:54.854400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e426e-f8ca-40c9-acde-a7a305c5f223 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:54.856550 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1435/2882] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:54.862213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:54.880830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:54.888743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da2ae-e70d-4eba-b42c-fdb9a71457d6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:54.889734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da2ae-e70d-4eba-b42c-fdb9a71457d6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:54.890110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da2ae-e70d-4eba-b42c-fdb9a71457d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:54.914326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df212-c3c4-4dda-9690-b1b179131eb3 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:54.921402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:54.924693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:54.925320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:54.932215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:54.933989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:54.936748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d49743-06a8-4c9d-9d43-cff1cbeb54b4 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:54.954846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4a4da2ae-e70d-4eba-b42c-fdb9a71457d6 None None] MFA Rules not processed for user `b9793101e6554c61bd3276d4290c0331`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:54.956283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a4da2ae-e70d-4eba-b42c-fdb9a71457d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:54.962229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1448/2883] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:54 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:56:55.022715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.023284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.024274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.026827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1449/2884] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:56:55.038192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:55.057104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:55.057765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:55.076680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4c64-17b2-4251-a887-7b3d843a7b1a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:55.087222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:55.088571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.089075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.089567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.091063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:55.093538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1436/2885] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:55.093759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007823a7-d41d-4081-b902-2c076d1d096c tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:55.105210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.106825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.108872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.111276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1450/2886] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:55 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:56:55.146362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] MFA Rules not processed for user `b9793101e6554c61bd3276d4290c0331`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:55.147907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:55.160043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1437/2887] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:55.237096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.237494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.237934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.250405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:55.272397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] MFA Rules not processed for user `a47744d718c64cf59765b192c38b8fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:55.273881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:55.291850 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1451/2888] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:55.300848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860cfc3-6b7e-4166-b04f-2c91cff8b228 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:55.307935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:55.309449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.310509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.311527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.334605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:55.336789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3dd74-aa0f-43ee-bfca-9de568f624a5 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:55.366977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1438/2889] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:55.404661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:55.406401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:55.426377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fead4-4191-467f-b2c5-b17bab7867cb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:55.430246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:55.430903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:55.431112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:55.431387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:55.433733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:55.452553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:55.455192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:55.466743 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1452/2890] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:56.387931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811df8-a602-4813-b690-3838c76eb210 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:56.388613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811df8-a602-4813-b690-3838c76eb210 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:56.388613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811df8-a602-4813-b690-3838c76eb210 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:56.390867 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1439/2891] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 20:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:56:56.395431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 20:56:56.423149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:56.434813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811df8-a602-4813-b690-3838c76eb210 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:56.436635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-73811df8-a602-4813-b690-3838c76eb210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:56.439089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1ea10-4c28-49c3-902a-6a69f58f8ba7 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:56.445979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ffc726b80484e2e9cf4c1c74ad85daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad7b75c53d2403fb855644ab8d9ef18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:56.446882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:56.447173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:56.447454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:56.449176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorizing `identity:get_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:56.451584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:56.453743 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1453/2892] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 20:56:56 2022] GET /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 381 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:56:56.549543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811df8-a602-4813-b690-3838c76eb210 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:56.559611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:56.560872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:56.561259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:56.561540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:56.564109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:56.581060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:56.583078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a031e8-9d80-44d3-8b27-0f836a469d20 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:56.604641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1440/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:56:56.661814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:56.797231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:56.812570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bf4a-274f-4c47-a837-b36ab4c7c81d tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:56.827593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:56.828542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:56.828831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:56.829114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] PATH_INFO: `/v3/users/a47744d718c64cf59765b192c38b8fdb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:56.841285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47744d718c64cf59765b192c38b8fdb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:56.848934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:56.936869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47744d718c64cf59765b192c38b8fdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:56.937539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47744d718c64cf59765b192c38b8fdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:56.951686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47744d718c64cf59765b192c38b8fdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:56.970624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47744d718c64cf59765b192c38b8fdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:56.983646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47744d718c64cf59765b192c38b8fdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:56.995556 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1454/2894] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:56 2022] DELETE /identity/v3/users/a47744d718c64cf59765b192c38b8fdb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:57.000015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:57.000301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:57.000646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:57.023915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:57.025981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:57.119779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1441/2895] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:56:57.131076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:57.132970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:57.250505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8288db-7be9-40a8-99fb-2e0d1c1b46df admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:57.259656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:57.260408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:57.260691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:57.261219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:57.295599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:57.301864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698c2d1-392e-434c-81f1-471361a062bc service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:57.317327 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1455/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:57.488985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:57.490561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:57.531358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7382f-e5fb-4f68-984b-035c5910e324 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:57.544242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:57.545846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:57.547714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:57.548908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] PATH_INFO: `/v3/users/c6773441662d41b2aecf9e43100633d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:57.551815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6773441662d41b2aecf9e43100633d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:57.554894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:57.677553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6773441662d41b2aecf9e43100633d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:57.684535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:57.700324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6773441662d41b2aecf9e43100633d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:57.728462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6773441662d41b2aecf9e43100633d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:57.731585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6773441662d41b2aecf9e43100633d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:57.732760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6773441662d41b2aecf9e43100633d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:57.763031 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1442/2897] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:57 2022] DELETE /identity/v3/users/c6773441662d41b2aecf9e43100633d3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:57.772044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:57.773357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:57.773845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:57.795420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:57.797616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:58.031558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:58.033604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:58.045085 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1456/2898] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:58.055013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:58.056837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:58.060773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0922-a8ec-4573-98f7-515d394060ba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:58.074865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:58.076730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:58.078121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:58.079282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] PATH_INFO: `/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:58.083199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e6d79ca8ed4ca2b0e8ebd835d52e37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:58.088349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:58.089881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:58.234185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fce0db-073c-4513-a9c3-3a87db00c0ad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:58.235528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e6d79ca8ed4ca2b0e8ebd835d52e37', 'request_id': 'req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.258791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e6d79ca8ed4ca2b0e8ebd835d52e37', 'request_id': 'req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.270885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e6d79ca8ed4ca2b0e8ebd835d52e37', 'request_id': 'req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.322886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] The token cache is being invalidate because project 54e6d79ca8ed4ca2b0e8ebd835d52e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:58.323262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.329096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.333745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1443/2899] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:58 2022] DELETE /identity/v3/projects/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:56:58.338369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:58.340248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:58.425754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:58.426967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:58.428803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:58.432258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:58.436595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:58.581086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b61c-2e0b-48f7-a11a-94fc4dd62f29 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:58.599965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:58.600921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:58.601756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:58.602042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] PATH_INFO: `/v3/users/5ffc726b80484e2e9cf4c1c74ad85daf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:58.608354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffc726b80484e2e9cf4c1c74ad85daf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:58.617055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:58.686650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:58.688765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df47bd-b5db-49ea-b470-01fdfe932a69 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:58.713498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1457/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:56:58.778368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffc726b80484e2e9cf4c1c74ad85daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.796007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:58.805449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffc726b80484e2e9cf4c1c74ad85daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.847266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffc726b80484e2e9cf4c1c74ad85daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.848765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffc726b80484e2e9cf4c1c74ad85daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.850296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffc726b80484e2e9cf4c1c74ad85daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:58.889116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170469-ae95-4230-a51c-166eb732effb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:58.889694 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1444/2901] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:56:58 2022] DELETE /identity/v3/users/5ffc726b80484e2e9cf4c1c74ad85daf => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:58.890454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170469-ae95-4230-a51c-166eb732effb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:58.890919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0170469-ae95-4230-a51c-166eb732effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:58.929108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d0170469-ae95-4230-a51c-166eb732effb None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:56:58.930791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0170469-ae95-4230-a51c-166eb732effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:59.025466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1458/2902] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:56:59.099059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:59.100638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:59.308932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c412-8e3b-4eb2-9693-6380db248055 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:59.332593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:59.333594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:59.333883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:59.334164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:59.362940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:59.370829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:59.392346 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1445/2903] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:59.582717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0170469-ae95-4230-a51c-166eb732effb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:59.584631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0170469-ae95-4230-a51c-166eb732effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:59.647691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:59.817647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0170469-ae95-4230-a51c-166eb732effb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:59.859207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:59.861021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:59.861520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:59.862122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] PATH_INFO: `/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:59.864267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad7b75c53d2403fb855644ab8d9ef18)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:59.867249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:59.941950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:59.950467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:00.022072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2d301-061a-486a-a102-ba3846129261 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:00.049595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad7b75c53d2403fb855644ab8d9ef18', 'request_id': 'req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.080160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad7b75c53d2403fb855644ab8d9ef18', 'request_id': 'req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.113087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad7b75c53d2403fb855644ab8d9ef18', 'request_id': 'req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.166229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] The token cache is being invalidate because project 8ad7b75c53d2403fb855644ab8d9ef18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:00.166884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.174511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6f2852d-77e9-4c01-b4ba-17548fa3ccec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.178511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1459/2904] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:59 2022] DELETE /identity/v3/projects/8ad7b75c53d2403fb855644ab8d9ef18 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:00.184214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d629ff-a7a0-49b3-8d5f-fb81e3271e3e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.185902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d629ff-a7a0-49b3-8d5f-fb81e3271e3e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.186448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d629ff-a7a0-49b3-8d5f-fb81e3271e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.246783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-88d629ff-a7a0-49b3-8d5f-fb81e3271e3e None None] MFA Rules not processed for user `cdf4dbb95b6a440fad542fad69b6a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:00.251072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-88d629ff-a7a0-49b3-8d5f-fb81e3271e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:00.355972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:00.356967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.357257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.357537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] PATH_INFO: `/v3/projects/29037675b33a4f318e1fcafc33b6bed5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.370504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29037675b33a4f318e1fcafc33b6bed5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:00.375250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:00.409814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1460/2905] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:00.415795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374051e6-1ba9-40d1-8d32-10b786f11daa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.416136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374051e6-1ba9-40d1-8d32-10b786f11daa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.416344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374051e6-1ba9-40d1-8d32-10b786f11daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.459347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-374051e6-1ba9-40d1-8d32-10b786f11daa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:00.463461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-374051e6-1ba9-40d1-8d32-10b786f11daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:00.482421 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1461/2906] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:00.491929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.492223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.492521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.537305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:00.539125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:00.594758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29037675b33a4f318e1fcafc33b6bed5', 'request_id': 'req-6fb1f684-2fd2-475e-bca5-1a78f080c998'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.611018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29037675b33a4f318e1fcafc33b6bed5', 'request_id': 'req-6fb1f684-2fd2-475e-bca5-1a78f080c998'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.617589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:00.634478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29037675b33a4f318e1fcafc33b6bed5', 'request_id': 'req-6fb1f684-2fd2-475e-bca5-1a78f080c998'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.684678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] The token cache is being invalidate because project 29037675b33a4f318e1fcafc33b6bed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:00.685279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.688371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:00.694440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:00.696739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1446/2907] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:59 2022] DELETE /identity/v3/projects/29037675b33a4f318e1fcafc33b6bed5 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:00.706556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:00.711637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:00.745012 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1462/2908] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:00.747736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:00.775357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94967ed3-31c4-4bdd-8334-927c7be2db21 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:00.789604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:00.790361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.790635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.790916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.792274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:57:00.792706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:00.794875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:00.853971 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1463/2909] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:57:00.856034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:00.875586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf25d-ba77-4b8d-9c28-b5b3c1b6a99d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:00.881968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:00.882636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:00.882922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:00.883934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:00.884696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:00.886714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:00.925651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1464/2910] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:57:00 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:00.930926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:00.975581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1f684-2fd2-475e-bca5-1a78f080c998 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.051999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0af45-3325-4cc0-acd2-34279f38c027 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.060936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.062959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.063921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.064929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.065784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.071478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.122432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1465/2911] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:57:00 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:01.129810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:01.151207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.158170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.159439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.160642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] PATH_INFO: `/v3/users/9b6a41873bb54260900f520278dafe13` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.164400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6a41873bb54260900f520278dafe13)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.170940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.172038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de893c-57bc-4e9e-9826-d2be33319fde admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.178679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.179528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.179944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.180326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.181302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.183716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.214660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1466/2912] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:01.219696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:01.255540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8a2e-f5d2-429b-9c42-43ad386579a4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.288263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.291499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.296282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.298208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.300165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.305846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.349539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6a41873bb54260900f520278dafe13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:01.368406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1467/2913] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:01.373569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:01.376155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6a41873bb54260900f520278dafe13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:01.405374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961689a-d96f-4309-89dc-396c6021340e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.406757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6a41873bb54260900f520278dafe13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:01.408571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6a41873bb54260900f520278dafe13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:01.409539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf400e8-bd46-4b9f-b5c2-d025e1428fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6a41873bb54260900f520278dafe13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:01.421558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.424852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.425140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.425423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] PATH_INFO: `/v3/projects/fd2dd16178804914b9afde659428992f/users/662ef2b3df5e4c59b373fccab9c911c2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.447529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1447/2914] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:00 2022] DELETE /identity/v3/users/9b6a41873bb54260900f520278dafe13 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:01.457650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2dd16178804914b9afde659428992f, user_id=662ef2b3df5e4c59b373fccab9c911c2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.461490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.497156 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1468/2915] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:57:01 2022] PUT /identity/v3/projects/fd2dd16178804914b9afde659428992f/users/662ef2b3df5e4c59b373fccab9c911c2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:57:01.502335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809295-ff61-486b-949e-1611065930c2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.502622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809295-ff61-486b-949e-1611065930c2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.502897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809295-ff61-486b-949e-1611065930c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.553830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8a809295-ff61-486b-949e-1611065930c2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:01.560625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8a809295-ff61-486b-949e-1611065930c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:01.591495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:01.743636 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1448/2916] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:01.783698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:01.785900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:01.791463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a809295-ff61-486b-949e-1611065930c2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:01.793726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8a809295-ff61-486b-949e-1611065930c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:01.965430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a809295-ff61-486b-949e-1611065930c2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.970973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.971906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.972346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.972808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:01.975522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:01.984322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6cdd0-ce93-4e93-a3bc-e85ced7f3786 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:01.990575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:01.994497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:01.995483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:01.996245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:01.996759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:01.997187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:02.010605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:02.012646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac91a2-cadf-41b0-847e-5047ca98a44b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:02.014914 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1449/2917] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:57:02.030385 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1469/2918] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:02.592184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:02.595310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:02.635109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be572ea-dbfe-4207-9a50-f0c690e96160 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:02.649364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:02.650363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:02.650697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:02.650980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] PATH_INFO: `/v3/projects/7550b26198664271bfe44282f57c903e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:02.652915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7550b26198664271bfe44282f57c903e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:02.654896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:02.760344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7550b26198664271bfe44282f57c903e', 'request_id': 'req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:02.777527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7550b26198664271bfe44282f57c903e', 'request_id': 'req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:02.792673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7550b26198664271bfe44282f57c903e', 'request_id': 'req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:02.826498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] The token cache is being invalidate because project 7550b26198664271bfe44282f57c903e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:02.827776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:02.829915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f00daa1c-ccd0-4996-8550-cf82ec8c9cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:02.831679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1450/2919] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:02 2022] DELETE /identity/v3/projects/7550b26198664271bfe44282f57c903e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:57:02.837212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:02.837707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:02.838305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:02.846616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:02.888827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:02.888827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:03.185321 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1470/2920] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:03.194580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.195763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.196224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.227898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:03.229755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:03.259844 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1451/2921] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:03.264663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.293262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9b9d-b526-43b9-a0a2-c3086270a508 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.338577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.339294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.344299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.344942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.350487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:57:03.351529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.355100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:03.381298 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1471/2922] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:57:03.387822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.408310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ec104-1f25-4348-902c-2148b62661a4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.423794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.425345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.433526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.434648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.437110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.444317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:03.496620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1452/2923] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:57:03 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:03.499274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.517464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dae7ec-f1c5-4a5f-8a3a-7882d37d2bbf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.632986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.634290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.634442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.634728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.636674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.640664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:03.691889 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1472/2924] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:57:03 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:57:03.696632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.714953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384351-0198-4332-8f45-a23c86882966 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.726593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.727311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.728089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.729076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.731678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.737011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:03.762817 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1453/2925] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:03.767391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.785733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a81d-45c7-44fc-8352-7a7eb9e6aba1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.809360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.809360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.809360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.809360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.809892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.809892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76406226-6339-452b-a0b0-a21e4baeb155 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:03.858418 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1473/2926] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:03.864885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:03.873517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:03.889970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930053b-b711-41c9-84de-2f1f9513e847 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:03.912857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:03.915152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:03.917511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:03.919746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] PATH_INFO: `/v3/projects/cac44a003ea94dfba170af264c2412ed/users/ab974f6a346044b39b4e0a9a57ce4dd9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:03.963152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac44a003ea94dfba170af264c2412ed, user_id=ab974f6a346044b39b4e0a9a57ce4dd9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:03.970256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:04.028176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1454/2927] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:57:03 2022] PUT /identity/v3/projects/cac44a003ea94dfba170af264c2412ed/users/ab974f6a346044b39b4e0a9a57ce4dd9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:04.037119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:04.037414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:04.037701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:04.107924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] MFA Rules not processed for user `ab974f6a346044b39b4e0a9a57ce4dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:04.109495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:04.265096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:04.279344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1474/2928] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:04.280985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:04.455376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c844745-0c34-4a68-b45c-0002da490adb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:04.467003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:04.467754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:04.470296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:04.470641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:04.473903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:04.475888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:04.522679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1455/2929] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:04.527194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:04.558200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2439a45-9b82-4b03-a682-c95959314f85 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:04.746246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:04.746246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:04.746246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:04.746246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:04.747861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:04.753257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:04.821479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1475/2930] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:57:04 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:57:04.821675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:04.848415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1368-17e1-457c-b9a7-7cfa75779643 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:04.887428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:04.888231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:04.888591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:04.888877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:04.890587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:04.895457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:04.916617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1456/2931] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:04.919657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:04.936515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c939-ee56-4f05-9772-43736b2b2909 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:04.942367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:04.943358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:04.944170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:04.944537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] PATH_INFO: `/v3/projects/7c7f0f438ec4466b91cfa33171644a6c/users/a0b2dd67a1f8476f94841e06f9079f03/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:04.970024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7f0f438ec4466b91cfa33171644a6c, user_id=a0b2dd67a1f8476f94841e06f9079f03, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:04.974582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:05.035512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1476/2932] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:57:04 2022] PUT /identity/v3/projects/7c7f0f438ec4466b91cfa33171644a6c/users/a0b2dd67a1f8476f94841e06f9079f03/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:05.037667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:05.052611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1436b0-bfd2-48e3-bb90-2076b1f40052 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:05.313909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:05.315547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:05.316029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:05.316514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:05.317522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:05.325447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3c804-c515-4ef4-8433-e757d9b1a9c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:05.363806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1457/2933] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:05.368199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:05.387194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa539-7fbb-4c42-9992-d34baf195ab8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:05.404734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:05.407223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:05.416269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:05.416613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] PATH_INFO: `/v3/projects/7c7f0f438ec4466b91cfa33171644a6c/users/a0b2dd67a1f8476f94841e06f9079f03/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:05.420889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7f0f438ec4466b91cfa33171644a6c, user_id=a0b2dd67a1f8476f94841e06f9079f03, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:05.431268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8173067-c75e-426f-8e18-ce027e4dd42f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:05.475432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1477/2934] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:57:05 2022] PUT /identity/v3/projects/7c7f0f438ec4466b91cfa33171644a6c/users/a0b2dd67a1f8476f94841e06f9079f03/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:05.486494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8512aa-c2ea-4f13-94bb-b2eec84b5a3a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:05.486900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8512aa-c2ea-4f13-94bb-b2eec84b5a3a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:05.487289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8512aa-c2ea-4f13-94bb-b2eec84b5a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:05.556835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-df8512aa-c2ea-4f13-94bb-b2eec84b5a3a None None] MFA Rules not processed for user `a0b2dd67a1f8476f94841e06f9079f03`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:05.558541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df8512aa-c2ea-4f13-94bb-b2eec84b5a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:05.670780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:05.788677 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1458/2935] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:05.814359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:05.815133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:05.815718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:05.862945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] MFA Rules not processed for user `ab974f6a346044b39b4e0a9a57ce4dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:05.867525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:05.994616 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1478/2936] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:12.613752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:12.614245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:12.614520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:12.705957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:12.707781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:12.724951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] MFA Rules not processed for user `662ef2b3df5e4c59b373fccab9c911c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:12.726198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:12.793109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:12.843335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290b18-88b6-4e96-ba03-ac7b991e4d03 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:12.858352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:12.859463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:12.860934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:12.861447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:12.866947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:12.896664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:12.902243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5098b0-b054-4af3-9ec1-12bc6a1e7c40 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:12.928884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1479/2937] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:12.932583 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1459/2938] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:12.948541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:12.951904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:12.957359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:12.999137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] MFA Rules not processed for user `662ef2b3df5e4c59b373fccab9c911c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:13.001531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:13.019328 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1480/2939] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:13.027727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:13.047031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eacf8-74c3-47b9-bd80-dff57aa9bae4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:13.061696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:13.062373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:13.062656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:13.062957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:13.082870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:13.084417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:13.116538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1460/2940] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:13.387982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:13.389634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:13.421284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7884ad5-f07c-42e7-aa52-b1246c28cf3a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:13.434575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:13.436843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:13.436843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:13.436843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:13.451366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:13.477345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:13.479154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:13.536816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1481/2941] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:14.013514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:14.036167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009009-513a-40c3-a439-19d59f03c2e9 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:14.083093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:14.088321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:14.089959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:14.091137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:14.136882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:14.140839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902ef26-67c8-4d23-a2b1-fd6d658bdcde service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:14.185699 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1461/2942] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:18.005430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:18.029839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ae70-7901-4b4e-8673-0f040ba30569 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:18.069152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:18.070655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:18.073224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:18.074089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:18.090016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:18.139715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:18.142219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe00dda-f272-416a-9d13-2562037b15ee service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:18.193862 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1482/2943] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:24.131149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:24.131675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:24.131778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:24.133433 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1462/2944] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:57:24.147304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48f4f-195e-443e-b265-fbcbe7e8f8fc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:24.147821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48f4f-195e-443e-b265-fbcbe7e8f8fc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:24.147907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48f4f-195e-443e-b265-fbcbe7e8f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:24.159705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=56 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:24.189250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-48b48f4f-195e-443e-b265-fbcbe7e8f8fc None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:24.190893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-48b48f4f-195e-443e-b265-fbcbe7e8f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:24.410208 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1483/2945] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:24.422560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:24.433448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:24.463794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8ca-2bd5-4a26-8e8a-0cfc37d28daf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:24.472801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:24.473968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:24.474503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:24.474938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:24.493866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:24.496185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:24.509638 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1463/2946] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:27.215584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bc33-cfe7-498d-8e0c-34aca41b8dab None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:27.216577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bc33-cfe7-498d-8e0c-34aca41b8dab None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:27.216859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bc33-cfe7-498d-8e0c-34aca41b8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:27.235415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bc82bc33-cfe7-498d-8e0c-34aca41b8dab None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:27.236794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc82bc33-cfe7-498d-8e0c-34aca41b8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:27.292551 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1484/2947] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:27.305912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:27.307606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:27.391352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f189-259b-44ef-8e61-82ff4b444f2d service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:27.397766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:27.398440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:27.398718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:27.398989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:27.411458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:27.413221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:27.424927 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1464/2948] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:57:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:28.075675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:28.075675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:28.076074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:28.142570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] MFA Rules not processed for user `dbd8d82d694941b58fa2d18311ea5785`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:28.144949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:28.223282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:28.252894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1485/2949] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:37.420740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=38 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:38.242550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:47.506801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:47.519872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f199-cc3b-442a-a68a-55720eafb784 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:47.530293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:47.531208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:47.531642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:47.532108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:47.544208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:47.546271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:47.571374 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1465/2950] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:49.762582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:49.764796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:49.865991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02edb-c8fe-4169-8198-0c989bca20e0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:49.871824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:49.872866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:49.873152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:49.873431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] PATH_INFO: `/v3/users/b9793101e6554c61bd3276d4290c0331` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:49.875105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9793101e6554c61bd3276d4290c0331)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:49.878029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:49.947005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9793101e6554c61bd3276d4290c0331'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:49.948123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9793101e6554c61bd3276d4290c0331'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:49.965085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9793101e6554c61bd3276d4290c0331'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:49.980191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9793101e6554c61bd3276d4290c0331'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:49.989896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9793101e6554c61bd3276d4290c0331'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:49.996978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1486/2951] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:49 2022] DELETE /identity/v3/users/b9793101e6554c61bd3276d4290c0331 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:57:50.309998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:50.322600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29948-dfa6-4950-a2f8-be65d182101e service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:50.442631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:50.444462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.444781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.445173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] PATH_INFO: `/v3/projects/5fc39b845ba24fc49935ae2ecbf9eefc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.446715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc39b845ba24fc49935ae2ecbf9eefc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:50.449660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:50.501609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:50.503237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:50.530176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc39b845ba24fc49935ae2ecbf9eefc', 'request_id': 'req-db8f3d95-bd60-4a15-9a2e-caced6388a4d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:50.541623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc39b845ba24fc49935ae2ecbf9eefc', 'request_id': 'req-db8f3d95-bd60-4a15-9a2e-caced6388a4d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:50.553137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc39b845ba24fc49935ae2ecbf9eefc', 'request_id': 'req-db8f3d95-bd60-4a15-9a2e-caced6388a4d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:50.571614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] The token cache is being invalidate because project 5fc39b845ba24fc49935ae2ecbf9eefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:50.571919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:50.572619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-db8f3d95-bd60-4a15-9a2e-caced6388a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:50.575042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1466/2952] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:50 2022] DELETE /identity/v3/projects/5fc39b845ba24fc49935ae2ecbf9eefc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:50.580742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a628-8291-4837-9abb-59874da0a7a1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.581100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a628-8291-4837-9abb-59874da0a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.581443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a628-8291-4837-9abb-59874da0a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.590966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48850b-c31c-4e2a-a9b9-92e7d24101ef admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:50.604094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eb53a628-8291-4837-9abb-59874da0a7a1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:50.605620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb53a628-8291-4837-9abb-59874da0a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:50.607664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:50.681332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:50.682424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.682548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1467/2953] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:50.682691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.683088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.685057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:50.690626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.690922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.691202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.712922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:50.714145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:50.725168 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1468/2954] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:57:50.729315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:50.741564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabfb46-e502-4020-84e1-0c756f771621 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:50.758731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:50.761557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:50.773336 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1487/2955] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:50.778282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:50.779783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.780101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.780372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.782288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:57:50.783630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:50.786464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:50.795475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:50.801621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1469/2956] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:57:50.806400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:50.824223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d842a3-a969-4877-a0bb-0f1d17f7dc8e service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:50.830122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:50.831127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.831528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.831890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.832805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:50.834875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:50.879650 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1488/2957] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:57:50 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:50.884176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:50.895074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebd91-cb16-4bfb-a5a2-fe1647e59cdb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:50.972104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:50.972884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:50.973290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:50.973658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:50.974561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:50.976879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:51.001246 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1470/2958] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:57:50 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:51.005014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:51.015397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1af6c-d33b-4dc1-af32-0376f56a9d41 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:51.021149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:51.021942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:51.022393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:51.022669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:51.023403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:51.025816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:51.042601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1489/2959] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:57:51.044204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:51.056658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede73b0-e8b0-43c9-b221-02349adfd386 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:51.061580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:51.062267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:51.062550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:51.063112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:51.063853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:51.065566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc532-cd5e-4bb0-9768-1e22d53a04b2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:51.088010 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1471/2960] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:57:51.092392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:51.115242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250433-f018-4928-bff2-b1f1dde098b9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:51.122068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:51.123591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:51.124064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:51.124636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] PATH_INFO: `/v3/projects/ead50a31ce9d4d108bcc8f2d8844ac39/users/a64a76813475430a9ee6e8d297bb8683/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:51.147969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead50a31ce9d4d108bcc8f2d8844ac39, user_id=a64a76813475430a9ee6e8d297bb8683, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:51.151411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:51.172107 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1490/2961] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:57:51 2022] PUT /identity/v3/projects/ead50a31ce9d4d108bcc8f2d8844ac39/users/a64a76813475430a9ee6e8d297bb8683/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:51.172980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57063c6-95f1-44d5-8505-8760d4723b6d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:51.173312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57063c6-95f1-44d5-8505-8760d4723b6d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:51.173590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57063c6-95f1-44d5-8505-8760d4723b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:51.197252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b57063c6-95f1-44d5-8505-8760d4723b6d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:51.198624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b57063c6-95f1-44d5-8505-8760d4723b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:51.277738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1472/2962] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:57:51.301429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:51.303721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:51.410800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de87b-7b21-4c9a-a26d-d34bc14dd2fd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:51.420919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:51.422302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:51.424317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:51.427003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:51.455000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:51.458215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:51.465281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:51.475550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1491/2963] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:52.313590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc102-4cfe-42a7-8b38-e4eb726bb2d1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:52.314090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc102-4cfe-42a7-8b38-e4eb726bb2d1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:52.314200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc102-4cfe-42a7-8b38-e4eb726bb2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:52.345573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ea7bc102-4cfe-42a7-8b38-e4eb726bb2d1 None None] MFA Rules not processed for user `662ef2b3df5e4c59b373fccab9c911c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:52.346980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea7bc102-4cfe-42a7-8b38-e4eb726bb2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:52.416087 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1473/2964] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:55.357386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:55.359463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:55.389834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6d27-74e6-42ce-b247-2c8ca12b5aa7 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:55.400194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:55.401145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:55.401430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:55.401710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] PATH_INFO: `/v3/users/ab974f6a346044b39b4e0a9a57ce4dd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:55.405111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab974f6a346044b39b4e0a9a57ce4dd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:55.407848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:55.495908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab974f6a346044b39b4e0a9a57ce4dd9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:55.496921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab974f6a346044b39b4e0a9a57ce4dd9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:55.508029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab974f6a346044b39b4e0a9a57ce4dd9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:55.525031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab974f6a346044b39b4e0a9a57ce4dd9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:55.535482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab974f6a346044b39b4e0a9a57ce4dd9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:55.547750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:55.548279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1492/2965] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:55 2022] DELETE /identity/v3/users/ab974f6a346044b39b4e0a9a57ce4dd9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:55.550118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:55.550615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:55.572659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:55.574169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:55.606520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:55.710787 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1474/2966] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:57:55.753185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:55.755248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:55.883920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb566e8-ba80-4733-90f4-0a23534be4ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:55.897403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:55.898226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:55.898719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:55.899629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:55.912034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:55.914697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab13d-8162-4541-acd4-416bf633d7fa service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:55.929422 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1493/2967] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:57.048829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:57.050843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:57.051113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:57.051875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:57.052297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:57.069041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a592-b3c7-47b3-a9e1-1bf2c36bc10f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:57.077154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:57.078495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:57.078944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:57.079361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] PATH_INFO: `/v3/projects/cac44a003ea94dfba170af264c2412ed` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:57.081638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac44a003ea94dfba170af264c2412ed)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:57.085685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:57.094370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:57.095621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:57.210268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac44a003ea94dfba170af264c2412ed', 'request_id': 'req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.231762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac44a003ea94dfba170af264c2412ed', 'request_id': 'req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.240289 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1494/2968] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:57.249558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac44a003ea94dfba170af264c2412ed', 'request_id': 'req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.257248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:57.260270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:57.295923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] The token cache is being invalidate because project cac44a003ea94dfba170af264c2412ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:57.296489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.297514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.306054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:57.307281 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1475/2969] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:57 2022] DELETE /identity/v3/projects/cac44a003ea94dfba170af264c2412ed => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:57.320203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:57.323060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:57.417042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12545c5-71c7-4f8f-a788-d749b08d972a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:57.505274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0b50-e71f-42b7-ac05-9d3e5f09ade7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:57.516091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:57.517460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:57.517953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:57.518467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] PATH_INFO: `/v3/users/a0b2dd67a1f8476f94841e06f9079f03` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:57.519750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:57.520383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b2dd67a1f8476f94841e06f9079f03)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:57.520533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:57.520726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:57.521001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:57.523166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:57.530889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:57.620323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:57.624397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:57.631240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b2dd67a1f8476f94841e06f9079f03'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.633262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:57.655859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b2dd67a1f8476f94841e06f9079f03'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.671488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1495/2970] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 20:57:57.681014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b2dd67a1f8476f94841e06f9079f03'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.681745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b2dd67a1f8476f94841e06f9079f03'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.682364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3756a4a7-69e5-45ee-96b2-e9df2900b46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b2dd67a1f8476f94841e06f9079f03'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:57.721502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1476/2971] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:57 2022] DELETE /identity/v3/users/a0b2dd67a1f8476f94841e06f9079f03 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:59.289995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:59.322765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b2b-a11b-498f-8ce0-e8012b9c919a service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:59.472136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:59.473125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:59.473408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:59.473738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] PATH_INFO: `/v3/projects/7c7f0f438ec4466b91cfa33171644a6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:59.476206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7f0f438ec4466b91cfa33171644a6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:59.483086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:59.495309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:59.585898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7f0f438ec4466b91cfa33171644a6c', 'request_id': 'req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:59.601536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7f0f438ec4466b91cfa33171644a6c', 'request_id': 'req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:59.631867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7f0f438ec4466b91cfa33171644a6c', 'request_id': 'req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:59.666130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] The token cache is being invalidate because project 7c7f0f438ec4466b91cfa33171644a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:59.666512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:59.668837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9ca1df3-0492-4a57-aaa9-9b1e8771cbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:59.671179 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1496/2972] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:59 2022] DELETE /identity/v3/projects/7c7f0f438ec4466b91cfa33171644a6c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:59.677639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176974-919f-43a3-8590-64b33756f328 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:59.678639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176974-919f-43a3-8590-64b33756f328 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:59.679157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176974-919f-43a3-8590-64b33756f328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:59.702031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c9176974-919f-43a3-8590-64b33756f328 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:59.704294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c9176974-919f-43a3-8590-64b33756f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:59.796351 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1477/2973] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:59.803200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:59.803737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:59.804313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:59.834678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:59.840058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:59.856997 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1497/2974] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:57:59.857670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9176974-919f-43a3-8590-64b33756f328 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:59.870453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9176974-919f-43a3-8590-64b33756f328 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:59.882656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:59.883383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:59.883875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:59.884004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:59.884696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:57:59.885007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:59.887163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:59.913205 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1478/2975] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:57:59.917673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:59.928289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea109a-25a3-490c-a5f1-0358adb137aa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:59.935847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:59.936839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:59.936968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:59.937145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:59.938454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:59.940739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:59.979660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1498/2976] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:57:59 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:57:59.983833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:59.994794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864627d1-145c-435e-b333-9414252fa7ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:00.065301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:00.066106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.066531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.066992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.067782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:00.069897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:00.098831 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1479/2977] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:57:59 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:58:00.102721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:00.116277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32f4cf-1836-471d-b277-46fbf811f82d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:00.129075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:00.130001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.130449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.130838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.177550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:00.179676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:00.220816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:00.229046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1499/2978] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:58:00.239224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298a19-044e-4d2f-a131-be6176efc92b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:00.245561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:00.246233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.246509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.246791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.247509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:00.249167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21422ae1-2a2a-4400-b00a-35cccf5f0962 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:00.273924 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1480/2979] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:58:00.275997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:00.288387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8d75-9020-4273-9e2e-3e963a531f17 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:00.293624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:00.295366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.296489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.297048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] PATH_INFO: `/v3/projects/3227da8dcf454c74b49bd33a773843f8/users/8d619431eaaa4acdbdcf5e18635f6ce8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.316695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3227da8dcf454c74b49bd33a773843f8, user_id=8d619431eaaa4acdbdcf5e18635f6ce8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:00.319563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:00.350199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216c07-c286-45e2-bdda-76ad4bcf1d24 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.350781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216c07-c286-45e2-bdda-76ad4bcf1d24 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.351071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216c07-c286-45e2-bdda-76ad4bcf1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.354605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1500/2980] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:58:00 2022] PUT /identity/v3/projects/3227da8dcf454c74b49bd33a773843f8/users/8d619431eaaa4acdbdcf5e18635f6ce8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:00.398397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a3216c07-c286-45e2-bdda-76ad4bcf1d24 None None] MFA Rules not processed for user `8d619431eaaa4acdbdcf5e18635f6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:00.401000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a3216c07-c286-45e2-bdda-76ad4bcf1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:00.430509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:00.522466 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1481/2981] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:58:00.538300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:00.540273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:00.686782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83a64-e434-48de-8ac3-c6fc5001561f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:00.696739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:00.697662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:00.698156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:00.698498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:00.708594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:00.711881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6257ad-4435-4f27-8012-3ceefb5af790 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:00.724576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1501/2982] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:01.058757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.059318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.059318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.104811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:01.107511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.285303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1482/2983] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:01.311889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955b1c-8c3c-4e00-ac1f-8457d6e609c3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.312960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955b1c-8c3c-4e00-ac1f-8457d6e609c3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.312960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d955b1c-8c3c-4e00-ac1f-8457d6e609c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.325322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:01.347934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.369489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7d955b1c-8c3c-4e00-ac1f-8457d6e609c3 None None] MFA Rules not processed for user `a64a76813475430a9ee6e8d297bb8683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:01.370758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7d955b1c-8c3c-4e00-ac1f-8457d6e609c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.380963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:01.545385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7c25-08cb-464e-8124-5ec07616c68c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:01.548483 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1502/2984] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:01.560122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:01.562023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.562023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.562023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.562392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.562392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.562903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.585137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:01.585591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] MFA Rules not processed for user `a64a76813475430a9ee6e8d297bb8683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:01.586835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.588760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b78205-5616-47c8-a749-b767452ecd21 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:01.610338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1503/2985] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:01.617478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1483/2986] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 20:58:01.701544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:01.703637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.723285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff5e3-51cb-45a3-a477-f7e8758c66cc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:01.729013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:01.729765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.730135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.730447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.740282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:01.741961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:01.759514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1504/2987] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:01.761494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028c5a-e5dd-4fa7-a7f2-6adee916c46b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:01.761786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028c5a-e5dd-4fa7-a7f2-6adee916c46b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:01.762106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028c5a-e5dd-4fa7-a7f2-6adee916c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:01.782357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fb028c5a-e5dd-4fa7-a7f2-6adee916c46b None None] MFA Rules not processed for user `8d619431eaaa4acdbdcf5e18635f6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:01.783184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fb028c5a-e5dd-4fa7-a7f2-6adee916c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:01.796415 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1484/2988] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:58:02.016743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:02.018326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:02.117539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735754-9fcd-4a63-bcfd-db44c404b656 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:02.121446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:02.122112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:02.122397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:02.122703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:02.124590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:02.135863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:02.137431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:02.146318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1505/2989] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:03.060634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:03.061141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:03.061255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:03.115693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:03.118739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:03.148224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1485/2990] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:58:03.161620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:03.194636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd10b9-a3a1-4953-8fe4-f48cdef22722 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:03.206557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:03.207447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:03.209133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:03.209392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:03.248976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:03.251589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817fdc-42d4-496f-aeb2-1337ca6857d9 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:03.287509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1506/2991] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:58:03.507769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:03.652842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:03.701349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861d307-6e8b-47e2-99b7-038e60fe6845 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:03.714955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:03.717396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:03.717703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:03.718077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] PATH_INFO: `/v3/users/8d619431eaaa4acdbdcf5e18635f6ce8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:03.727318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d619431eaaa4acdbdcf5e18635f6ce8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:03.729796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:03.860103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d619431eaaa4acdbdcf5e18635f6ce8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:03.888228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d619431eaaa4acdbdcf5e18635f6ce8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:03.936622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d619431eaaa4acdbdcf5e18635f6ce8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:03.937411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d619431eaaa4acdbdcf5e18635f6ce8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:03.942608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d619431eaaa4acdbdcf5e18635f6ce8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:03.972817 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1486/2992] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:58:03 2022] DELETE /identity/v3/users/8d619431eaaa4acdbdcf5e18635f6ce8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:03.977811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a3f14-2b99-4bd0-a745-842f19420683 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:03.978207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a3f14-2b99-4bd0-a745-842f19420683 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:03.978394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a3f14-2b99-4bd0-a745-842f19420683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:04.029557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-526a3f14-2b99-4bd0-a745-842f19420683 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:04.031014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-526a3f14-2b99-4bd0-a745-842f19420683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:04.267557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1507/2993] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:04.281424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:04.286053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:04.533789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a69a6-22d1-4209-ae10-5f1a1a9b3799 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:04.542381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:04.543743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:04.544309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:04.544620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:04.565323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:04.568972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3d8e-66c6-40d8-b055-74e16a79677d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:04.613728 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1487/2994] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:05.082840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.083411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.083689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.085161 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1508/2995] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:58:05.098340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.098635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.098918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.129594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:05.131370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:05.253032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:05.278637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1488/2996] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:05.305961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:05.308876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:05.317277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:05.319265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:05.343789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbf29-e42b-4333-93d3-9d2efc5dd138 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:05.345891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c710-03ea-4945-9d6f-37377c4d3a87 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:05.351904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:05.353044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.353582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.354252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] PATH_INFO: `/v3/projects/3227da8dcf454c74b49bd33a773843f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.356059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3227da8dcf454c74b49bd33a773843f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:05.358218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:05.358444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:05.359238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.359607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.359986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.372777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:05.374923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76494-68a1-4c0f-8d3e-492a415ce9b0 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:05.419151 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1509/2997] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:05.423299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3227da8dcf454c74b49bd33a773843f8', 'request_id': 'req-5de860c9-0eba-4b60-a440-b9c735d9fd60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:05.433009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3227da8dcf454c74b49bd33a773843f8', 'request_id': 'req-5de860c9-0eba-4b60-a440-b9c735d9fd60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:05.454041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3227da8dcf454c74b49bd33a773843f8', 'request_id': 'req-5de860c9-0eba-4b60-a440-b9c735d9fd60'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:05.483044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] The token cache is being invalidate because project 3227da8dcf454c74b49bd33a773843f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:58:05.483350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:05.484046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5de860c9-0eba-4b60-a440-b9c735d9fd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:05.490140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1489/2998] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:05 2022] DELETE /identity/v3/projects/3227da8dcf454c74b49bd33a773843f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:58:05.491421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.491712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.491988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.499638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:05.554721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:05.556792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:05.682459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1510/2999] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:58:05.694428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.694719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.695004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.736976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:05.738539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:05.753380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1490/3000] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:05.754419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:05.771034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78701-f4dc-44d3-8a6b-367fe34719bc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:05.796909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:05.797594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.797885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.798162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.798899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:58:05.799206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:05.805465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:05.838188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1511/3001] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:58:05.839398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:05.862295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22500dc-0c1d-4a99-94de-532a290cc395 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:05.868686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:05.869368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:05.869649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:05.869927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:05.870627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:05.872612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:05.993730 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1491/3002] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:58:05.995227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:06.010041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224492bd-c184-470e-a679-fdbadc936ab0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:06.138917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:06.139759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.140216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.140628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.141431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:06.143499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:06.184413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1512/3003] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:58:05 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:58:06.188443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:06.208038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75e73-cc05-4d11-b22e-86d0ae512786 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:06.220056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:06.232192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.233491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.233826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.236398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:06.238304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:06.257663 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1492/3004] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:58:06.261945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:06.276689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8eb68-0250-4e01-a0a5-57809d16a2c2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:06.297945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:06.299093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.299420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.299710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.300533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:06.302381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381dd58-a167-4737-b917-bdf72006e429 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:06.322747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1513/3005] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:58:06.326712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:06.345384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddf51c-bca0-42e1-9d21-54a598218cc9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:06.356297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:06.357577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.358537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.359186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] PATH_INFO: `/v3/projects/392c7f01e10b47119b4b8bd637735529/users/a0cfa694d8fa44e0896c445f84043137/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.397308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=392c7f01e10b47119b4b8bd637735529, user_id=a0cfa694d8fa44e0896c445f84043137, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:06.408396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:06.444954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1493/3006] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:58:06 2022] PUT /identity/v3/projects/392c7f01e10b47119b4b8bd637735529/users/a0cfa694d8fa44e0896c445f84043137/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:06.450415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17b08-d13b-4617-8a7f-8121f025e177 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.451632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17b08-d13b-4617-8a7f-8121f025e177 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.457963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17b08-d13b-4617-8a7f-8121f025e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.521006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-14c17b08-d13b-4617-8a7f-8121f025e177 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:06.522473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-14c17b08-d13b-4617-8a7f-8121f025e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:06.676401 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1514/3007] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:06.711553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:06.714910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:06.872034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83c23-a77c-4703-b385-96a22a92f556 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:06.876095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:06.876750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:06.877037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:06.877318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:06.888852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:06.890069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:06.922059 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1494/3008] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:10.549806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa19df-4d64-4e51-a323-1acb6852fded None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:10.550388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa19df-4d64-4e51-a323-1acb6852fded None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:10.550388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa19df-4d64-4e51-a323-1acb6852fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:10.600649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-24fa19df-4d64-4e51-a323-1acb6852fded None None] MFA Rules not processed for user `e9c6e12528ea4760bed65f994df57783`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:10.602023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-24fa19df-4d64-4e51-a323-1acb6852fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:10.617918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:10.738408 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1515/3009] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:16.912211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:17.859468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:17.869755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264842-8544-4a5d-88e3-1774b92b46b2 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:17.879431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:17.880558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:17.881075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:17.881431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:17.885821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:18.057163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:18.059475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:18.075084 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1495/3010] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:19.848242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:19.848746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:19.848890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:19.947985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] MFA Rules not processed for user `a0cfa694d8fa44e0896c445f84043137`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:19.949568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:20.197494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1516/3011] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:20.324790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:20.326423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:20.351726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df18a-11eb-4020-a9b3-f031aa3f7e18 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:20.358060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:20.360465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:20.361400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:20.362005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] PATH_INFO: `/v3/users/9a8cd690a02e4b47afb24d9d4dba52b9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:20.364838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8cd690a02e4b47afb24d9d4dba52b9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:20.368821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:20.484866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8cd690a02e4b47afb24d9d4dba52b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:20.497598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8cd690a02e4b47afb24d9d4dba52b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:20.553346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8cd690a02e4b47afb24d9d4dba52b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:20.554388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8cd690a02e4b47afb24d9d4dba52b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:20.555151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8cd690a02e4b47afb24d9d4dba52b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:20.613190 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1496/3012] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:58:20 2022] DELETE /identity/v3/users/9a8cd690a02e4b47afb24d9d4dba52b9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:21.253793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:21.255579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:21.406972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381147-eb1d-4e16-9406-ea3127d22dd0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:21.409401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:21.411762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:21.497904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:21.563917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:21.565272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:21.565272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:21.566799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:21.571415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:21.591872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ebd8-2a76-415d-8b5d-a283a2a3c559 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:21.635089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:21.636323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:21.648683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:21.649093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] PATH_INFO: `/v3/projects/c734d57dbb974b2bba1efc21917a7269` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:21.652886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c734d57dbb974b2bba1efc21917a7269)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:21.662451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:21.693499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:21.724027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:21.726174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:21.773264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1517/3013] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:21.793661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c734d57dbb974b2bba1efc21917a7269', 'request_id': 'req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:21.803994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c734d57dbb974b2bba1efc21917a7269', 'request_id': 'req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:21.817952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c734d57dbb974b2bba1efc21917a7269', 'request_id': 'req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:21.841284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] The token cache is being invalidate because project c734d57dbb974b2bba1efc21917a7269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:58:21.841775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:21.845209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:21.850555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1497/3014] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:21 2022] DELETE /identity/v3/projects/c734d57dbb974b2bba1efc21917a7269 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:21.851666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:21.872676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bc1d5-a44c-4012-bce5-3e0bcbd5b47b service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:22.053549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:22.054840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:22.055370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:22.055990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] PATH_INFO: `/v3/users/18e3ab49c8ff457fa39b252d305e5766` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:22.057503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e3ab49c8ff457fa39b252d305e5766)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:22.060959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:22.180296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e3ab49c8ff457fa39b252d305e5766'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:22.181142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e3ab49c8ff457fa39b252d305e5766'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:22.193060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e3ab49c8ff457fa39b252d305e5766'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:22.222255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e3ab49c8ff457fa39b252d305e5766'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:22.237872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b0f43d7-73ab-4d8f-b746-d19ef6a04055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e3ab49c8ff457fa39b252d305e5766'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:22.242356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:22.261644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1518/3015] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:58:21 2022] DELETE /identity/v3/users/18e3ab49c8ff457fa39b252d305e5766 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:58:22.735410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:22.737788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:22.760663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29382ce-82a1-46a4-bc2b-a8ac362c83c4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:23.032249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:23.037918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.038299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.038688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] PATH_INFO: `/v3/projects/b4e23fb2c30f4011bb282de21bfa377f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.040711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e23fb2c30f4011bb282de21bfa377f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:23.047508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:23.205819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e23fb2c30f4011bb282de21bfa377f', 'request_id': 'req-1541fa7d-14e6-4a33-adc8-675dc5f57870'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:23.226950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e23fb2c30f4011bb282de21bfa377f', 'request_id': 'req-1541fa7d-14e6-4a33-adc8-675dc5f57870'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:23.249247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e23fb2c30f4011bb282de21bfa377f', 'request_id': 'req-1541fa7d-14e6-4a33-adc8-675dc5f57870'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:23.289355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] The token cache is being invalidate because project b4e23fb2c30f4011bb282de21bfa377f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:58:23.289907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:23.291109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1541fa7d-14e6-4a33-adc8-675dc5f57870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:58:23.292912 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1498/3016] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:22 2022] DELETE /identity/v3/projects/b4e23fb2c30f4011bb282de21bfa377f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:23.298648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.299748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.300217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.357982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:23.359295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:23.566027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1519/3017] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:23.574624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.575209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.575652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.610636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:23.612115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:23.632411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1499/3018] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:23.637438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:23.668191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160e40-7beb-46c2-a1e7-bf7d2a9c182e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:23.674762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:23.675780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.676297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.677104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.678462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:58:23.678925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:23.681938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:23.710310 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1520/3019] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:58:23.714602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:23.725788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490b5d4-f967-4da1-af13-cb3585cfac50 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:23.731245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:23.732265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.732813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.733317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.734257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:23.736441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:23.768402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:23.792384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:23.804109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1500/3020] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:58:23 2022] POST /identity/v3/projects => generated 397 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:58:23.816975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847fcc2-7da6-472a-9e63-bde65fd84fa1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:23.928492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:23.930765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:23.931359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:23.931875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:23.933388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:23.935873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:23.973292 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1521/3021] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:58:23 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:58:23.980125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:23.995708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64727d4-f398-4d96-a4a4-5b1d64a73c69 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:24.001035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:24.002428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.002711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.002986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.004319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:24.006326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:24.020540 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1501/3022] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:58:24.024808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:24.039270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501170fe-10e5-4bb5-a29e-2ea910da9898 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:24.048223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:24.049133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.050104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.050485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.051625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:24.053895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf5e56-9237-4592-bb48-a0e1f0cc1261 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:24.071119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1522/3023] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:58:24.075258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:24.089904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea96f-537d-4e22-897c-47428ce252a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:24.103375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:24.105955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.106144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.107396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] PATH_INFO: `/v3/projects/ffbad622c26749aebba510fde1cb72c0/users/da55b52fd3b54e549d9de4b92b76f6ee/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.139902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbad622c26749aebba510fde1cb72c0, user_id=da55b52fd3b54e549d9de4b92b76f6ee, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:24.143651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:24.167129 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1502/3024] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:58:24 2022] PUT /identity/v3/projects/ffbad622c26749aebba510fde1cb72c0/users/da55b52fd3b54e549d9de4b92b76f6ee/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:58:24.168691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed92-4c0f-47f1-8c80-ee285e08c5ee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.169923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed92-4c0f-47f1-8c80-ee285e08c5ee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.170218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed92-4c0f-47f1-8c80-ee285e08c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.214276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b3f6ed92-4c0f-47f1-8c80-ee285e08c5ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:24.216257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b3f6ed92-4c0f-47f1-8c80-ee285e08c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:24.342047 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1523/3025] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:58:24.367761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:24.370086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:24.530603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96287b02-381c-4f7b-972d-99316e0fc489 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:24.552465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:24.553187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.553474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.553750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.574474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:24.575964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:24.589186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3112ee-74cc-49e6-85d2-fd6a0dc5381a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.589830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3112ee-74cc-49e6-85d2-fd6a0dc5381a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.589951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3112ee-74cc-49e6-85d2-fd6a0dc5381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.598524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:24.604857 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1503/3026] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:24.626719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d3112ee-74cc-49e6-85d2-fd6a0dc5381a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:24.628017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d3112ee-74cc-49e6-85d2-fd6a0dc5381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:24.794152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1524/3027] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:24.811234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:24.815389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:24.896804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d21bb-1cb2-423c-97a8-93b9125a23c1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:24.897697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d21bb-1cb2-423c-97a8-93b9125a23c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:24.897982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d21bb-1cb2-423c-97a8-93b9125a23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:24.936728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dc6d21bb-1cb2-423c-97a8-93b9125a23c1 None None] MFA Rules not processed for user `cdf4dbb95b6a440fad542fad69b6a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:24.938433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dc6d21bb-1cb2-423c-97a8-93b9125a23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:25.045166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ee8d8-b08d-4427-be70-864495802270 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:25.074013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:25.078482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:25.078936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:25.079306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:25.120963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:25.127085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:25.137199 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1525/3028] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:25.139689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f5d-31f5-4685-b52d-e4bb099d416a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:25.140179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f5d-31f5-4685-b52d-e4bb099d416a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:25.140846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034f5d-31f5-4685-b52d-e4bb099d416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:25.180099 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1504/3029] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:58:25.205839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ab034f5d-31f5-4685-b52d-e4bb099d416a None None] MFA Rules not processed for user `662ef2b3df5e4c59b373fccab9c911c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:25.207131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ab034f5d-31f5-4685-b52d-e4bb099d416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:25.376342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1526/3030] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:26.071402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:26.073039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:26.103291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f4a66-7f13-41ce-9fe0-6e2c7ca9bee0 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:26.128880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:26.131773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:26.132229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:26.133097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:26.147053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:26.174557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:26.178996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:26.220071 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1505/3031] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:35.357994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=73 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:36.209538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:36.618032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9b86-3629-45ed-9725-1a5b4debee95 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:36.619681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9b86-3629-45ed-9725-1a5b4debee95 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:36.620410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9b86-3629-45ed-9725-1a5b4debee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:36.674904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-724e9b86-3629-45ed-9725-1a5b4debee95 None None] MFA Rules not processed for user `a64a76813475430a9ee6e8d297bb8683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:36.680222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-724e9b86-3629-45ed-9725-1a5b4debee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:36.827427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1527/3032] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:40.851971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:40.854571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:41.098308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fbc00-da4b-4846-aeef-7ed3ec9af0e2 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:41.122933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:41.123696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:41.123980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:41.124259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:41.128402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:41.486440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:41.490777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abeba5-25ec-473c-be23-021e1aaf60f0 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:41.556932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1506/3033] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:44.454210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:44.455308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:44.456032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:44.498228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] MFA Rules not processed for user `da55b52fd3b54e549d9de4b92b76f6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:44.501145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:44.631624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1528/3034] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:44.642458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ab9be-a4d3-438f-aa18-a34ab7c40c7d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:44.643659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ab9be-a4d3-438f-aa18-a34ab7c40c7d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:44.644973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ab9be-a4d3-438f-aa18-a34ab7c40c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:44.713962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-399ab9be-a4d3-438f-aa18-a34ab7c40c7d None None] MFA Rules not processed for user `da55b52fd3b54e549d9de4b92b76f6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:44.715421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-399ab9be-a4d3-438f-aa18-a34ab7c40c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:44.727654 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1507/3035] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:45.296308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:45.298220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:45.330686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397359-40fa-49f4-b0e7-84256839c983 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:45.353938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:45.355016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:45.355471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:45.356777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:45.377182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:45.382327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6960b81-5850-42d8-9d27-f6bb2f50a71d service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:45.424223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1529/3036] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:48.180525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:48.181349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:48.181349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:48.182443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1508/3037] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 20:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:58:48.189259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:48.190530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:48.190975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:48.246086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:48.250569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:48.568284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1530/3038] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:48.600024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:48.602753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:48.636832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ccf55-59ea-4f16-9f49-9e7f27ce9356 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:48.673700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:48.674499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:48.681889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:48.683359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:48.707073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:48.710102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:48.761846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1509/3039] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:49.260782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:49.278660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635d2c7-6230-48d3-beb1-79c14e32ab00 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:49.299786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:49.301684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:49.301976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:49.302256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:49.311217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:49.357807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:49.359583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:49.389198 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1531/3040] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:50.131093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:50.166917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37717-4491-4058-af89-7d68ca3a2d36 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:50.180168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:50.182981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:50.183273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:50.183553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:50.191983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:50.245680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:50.248238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3ae1-7ead-4a76-a94f-d60572931fb6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:50.283391 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1510/3041] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:50.338192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:50.345025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:50.354833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a3e8-c725-4ab6-8c27-ba6f01ee8679 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:50.374674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:50.375372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:50.375662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:50.375942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:50.380605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:50.417825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:50.419324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:50.435300 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1532/3042] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:53.914544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359502a-f9f3-40e7-b7f2-0fb00396309f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:53.915041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359502a-f9f3-40e7-b7f2-0fb00396309f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:53.915279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359502a-f9f3-40e7-b7f2-0fb00396309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:53.942063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2359502a-f9f3-40e7-b7f2-0fb00396309f None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:53.943816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2359502a-f9f3-40e7-b7f2-0fb00396309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:53.957166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1511/3043] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:58:53.972653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:58:53.988317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0b8d-c893-4c2e-a366-fdbc692de66f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:58:53.994776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:58:53.996708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:53.998216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:53.998732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:54.011977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:58:54.023251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488707b-c51e-4746-ab53-8aeda62ffa04 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:58:54.043533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1533/3044] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:58:55.009704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:58:55.010321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:58:55.010440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:58:55.034599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] MFA Rules not processed for user `dbd8d82d694941b58fa2d18311ea5785`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:58:55.036072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:58:55.122632 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1512/3045] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:04.037080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:05.111027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:06.674558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:06.678023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:06.678549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:06.738570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] MFA Rules not processed for user `da55b52fd3b54e549d9de4b92b76f6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:06.742375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:06.764977 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1534/3046] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:08.794949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:08.828154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d3018-11e4-4c0d-82b5-e7b7a4584cd9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:08.835146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:08.836042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:08.836735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:08.837024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:08.846982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:08.876854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:08.897761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:08.915317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1513/3047] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:09.044899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:09.047176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:09.105398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57413f-afca-46a8-9127-ef77cc59ac38 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:09.132936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:09.134311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:09.134829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:09.135425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] PATH_INFO: `/v3/users/a0cfa694d8fa44e0896c445f84043137` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:09.144235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cfa694d8fa44e0896c445f84043137)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:09.147242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:09.239613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cfa694d8fa44e0896c445f84043137'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.239613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cfa694d8fa44e0896c445f84043137'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.249752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cfa694d8fa44e0896c445f84043137'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.279488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cfa694d8fa44e0896c445f84043137'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.306933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b88c5609-d9f4-464e-9a4b-07e5893cb48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cfa694d8fa44e0896c445f84043137'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.326995 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1535/3048] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:09 2022] DELETE /identity/v3/users/a0cfa694d8fa44e0896c445f84043137 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:09.759136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:09.776463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccd820-87dd-4b7d-8f42-3248dc095839 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:09.869192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:09.870469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:09.870802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:09.871230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] PATH_INFO: `/v3/projects/392c7f01e10b47119b4b8bd637735529` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:09.872982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=392c7f01e10b47119b4b8bd637735529)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:09.875289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:09.951075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392c7f01e10b47119b4b8bd637735529', 'request_id': 'req-be6a236b-647b-4d64-acb3-47ea5d568b33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.964363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392c7f01e10b47119b4b8bd637735529', 'request_id': 'req-be6a236b-647b-4d64-acb3-47ea5d568b33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.976081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392c7f01e10b47119b4b8bd637735529', 'request_id': 'req-be6a236b-647b-4d64-acb3-47ea5d568b33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.994613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] The token cache is being invalidate because project 392c7f01e10b47119b4b8bd637735529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:09.995308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.996169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be6a236b-647b-4d64-acb3-47ea5d568b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:09.998600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1514/3049] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:09 2022] DELETE /identity/v3/projects/392c7f01e10b47119b4b8bd637735529 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:10.004292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.004713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.005122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.026820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:10.029064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:10.187650 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1536/3050] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:10.199279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.199568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.200444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.223939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:10.225246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:10.247283 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1515/3051] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:10.251781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.267227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426d22-24b2-40d8-b678-7b0734099d49 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.274457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.275410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.276185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.276716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.278531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:10.279034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.280972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.298149 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1537/3052] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:10.304554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.323657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077203eb-0b96-4de2-a905-83a80b694c12 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.330300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.331123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.331406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.331713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.333845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.336590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.368475 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1516/3053] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:10 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:10.373145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.399005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc0a9-5ce5-4fbe-85a3-ec13989b0948 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.465740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:10.486209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.487418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.487985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.488305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.489510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.492549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.523112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1538/3054] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:10 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:10.524779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.543572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aa81b-159e-443f-8c7d-b296d7a9c0a9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.548733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.549554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.549833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.550173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.550954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.553177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.575823 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1517/3055] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:10.577321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.599047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d384f-3a95-4772-b009-0a5d9935bead admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.616300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.617124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.617512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.619018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.619018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.620231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ace76-efed-4aee-8ef0-bc8e67007991 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.631758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1539/3056] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:10.640747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.649848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7b5e9-bd9c-4c90-b096-1727472424a5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:10.659259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:10.660240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.660628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.661064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] PATH_INFO: `/v3/projects/c460eddfd96a45808e9b4e174f3cf7a2/users/4ab6f09ea5354ac8b0f7db4a22f9471e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.690627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c460eddfd96a45808e9b4e174f3cf7a2, user_id=4ab6f09ea5354ac8b0f7db4a22f9471e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:10.694879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:10.750341 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1518/3057] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:10 2022] PUT /identity/v3/projects/c460eddfd96a45808e9b4e174f3cf7a2/users/4ab6f09ea5354ac8b0f7db4a22f9471e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:10.764569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:10.765126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:10.765600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:10.826231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] MFA Rules not processed for user `4ab6f09ea5354ac8b0f7db4a22f9471e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:10.827497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:10.866880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:10.869157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:10.930820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:10.999207 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1540/3058] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:11.012934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:11.014466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:11.148738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148abe-3c1b-4f81-8b70-143503eb6732 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:11.155790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:11.161109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:11.161109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:11.161468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:11.164919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:11.194111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b142b0-0aa5-4818-8d62-057df3faf607 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:11.211477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:11.215456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:11.216563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:11.218244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:11.245873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:11.249888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:11.265692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1541/3059] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:11.338418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:11.343674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb760c8-3df5-4930-bd2d-9b0ab1f659ef service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:11.389226 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1519/3060] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:59:12.685428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:12.805000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:12.865805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0a2e-b638-4b51-b1d3-99c8d4d04348 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:12.877159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:12.878124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:12.878510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:12.882918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] PATH_INFO: `/v3/users/4ab6f09ea5354ac8b0f7db4a22f9471e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:12.884722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab6f09ea5354ac8b0f7db4a22f9471e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:12.891663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:13.011931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab6f09ea5354ac8b0f7db4a22f9471e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:13.013891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab6f09ea5354ac8b0f7db4a22f9471e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:13.036666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab6f09ea5354ac8b0f7db4a22f9471e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:13.066728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab6f09ea5354ac8b0f7db4a22f9471e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:13.081092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab6f09ea5354ac8b0f7db4a22f9471e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:13.099719 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1542/3061] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:12 2022] DELETE /identity/v3/users/4ab6f09ea5354ac8b0f7db4a22f9471e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:13.101814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c887e-560c-4432-a529-c894f08cc0be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:13.102572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c887e-560c-4432-a529-c894f08cc0be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:13.102966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c887e-560c-4432-a529-c894f08cc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:13.146842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-930c887e-560c-4432-a529-c894f08cc0be None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:13.149918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-930c887e-560c-4432-a529-c894f08cc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:13.334661 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1520/3062] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:13.536522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:13.538140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:13.679127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869359-5ae5-4bd3-b6c6-d8d7168cf595 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:13.690415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:13.692965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:13.693517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:13.695616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:13.721411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:13.725707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:13.759015 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1543/3063] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:13.984066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c887e-560c-4432-a529-c894f08cc0be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:14.001903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c887e-560c-4432-a529-c894f08cc0be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:14.015970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:14.017228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:14.017520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:14.017801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:14.020476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:14.056965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:14.059924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07efe8-5fc8-4414-95a4-78cd98118c66 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:14.089187 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1521/3064] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:15.891692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:15.894942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:15.923287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227777f-2d75-4596-af90-4bad42092f42 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:15.929083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:15.930262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:15.930764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:15.931250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] PATH_INFO: `/v3/projects/c460eddfd96a45808e9b4e174f3cf7a2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:15.934402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c460eddfd96a45808e9b4e174f3cf7a2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:15.936708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.013433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c460eddfd96a45808e9b4e174f3cf7a2', 'request_id': 'req-807fc804-d69f-4e74-99fb-4dd3567ce060'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:16.024321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c460eddfd96a45808e9b4e174f3cf7a2', 'request_id': 'req-807fc804-d69f-4e74-99fb-4dd3567ce060'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:16.033637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:16.035765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c460eddfd96a45808e9b4e174f3cf7a2', 'request_id': 'req-807fc804-d69f-4e74-99fb-4dd3567ce060'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:16.053503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] The token cache is being invalidate because project c460eddfd96a45808e9b4e174f3cf7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:16.054243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:16.055229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-807fc804-d69f-4e74-99fb-4dd3567ce060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:16.057664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1544/3065] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:15 2022] DELETE /identity/v3/projects/c460eddfd96a45808e9b4e174f3cf7a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:16.064738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.065779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.066453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.094553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:16.096361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:16.132226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:16.188695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1522/3066] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:16.189635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.189999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.190351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.217797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:16.219442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:16.239093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.252566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1545/3067] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:16.254246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346d025-45c7-4c8e-a748-9a70abe10454 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.259518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.261056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.261440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.262530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.263765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:16.264236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.266977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.297365 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1523/3068] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:16.297676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.307932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8bd85-c881-4d39-a702-c45cc75943ae None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.314312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.315437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.316017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.316576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.317554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.319847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.351991 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1546/3069] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:16 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:16.356165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.378863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2b2e7-5fb6-462c-b5ec-edad6610a251 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.444193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.445513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.446186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.446975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.448014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.450700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.485089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1524/3070] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:16 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:59:16.490859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.505074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653702-c918-4ffe-beaf-3636bd883fab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.514121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.515242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.515768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.516300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.518762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.520835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.537191 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1547/3071] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:16.542746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.558640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd8ad-5840-4608-9b3c-f4fa42f3368e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.567393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.568370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.569452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.569979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.570882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.572857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff3b4e-1bd9-4066-b119-3b8606087444 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.587401 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1525/3072] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:16.592066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:16.607442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264ee6-a009-44e9-a540-e55c45296bde admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:16.620169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:16.621214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.621501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.621782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] PATH_INFO: `/v3/projects/93a8fd73df2a4456a59bee4c7dbcfd51/users/20d4b62df7dc491a9598c5c14f8278ac/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.658333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a8fd73df2a4456a59bee4c7dbcfd51, user_id=20d4b62df7dc491a9598c5c14f8278ac, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:16.662176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:16.697029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1548/3073] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:16 2022] PUT /identity/v3/projects/93a8fd73df2a4456a59bee4c7dbcfd51/users/20d4b62df7dc491a9598c5c14f8278ac/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:16.707509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:16.707718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:16.708036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:16.782503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] MFA Rules not processed for user `20d4b62df7dc491a9598c5c14f8278ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:16.784283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:16.887417 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1526/3074] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:17.362576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:17.365307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:17.483762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584833-79c4-459d-b0f9-a35004d6784e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:17.492823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:17.493872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:17.493872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:17.494210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:17.504141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:17.505659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95ae6-9dd3-49c0-a439-8407d6f9fa90 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:17.518004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1549/3075] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:20.613983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:20.680258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:20.793802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745b3d-ce97-4822-9c9c-eaf01baed206 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:20.814117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:20.815527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:20.816030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:20.816367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] PATH_INFO: `/v3/users/20d4b62df7dc491a9598c5c14f8278ac` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:20.818070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d4b62df7dc491a9598c5c14f8278ac)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:20.820528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:20.913155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d4b62df7dc491a9598c5c14f8278ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:20.927345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d4b62df7dc491a9598c5c14f8278ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:20.944729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d4b62df7dc491a9598c5c14f8278ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:20.945747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d4b62df7dc491a9598c5c14f8278ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:20.949021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d4b62df7dc491a9598c5c14f8278ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:20.967890 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1527/3076] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:20 2022] DELETE /identity/v3/users/20d4b62df7dc491a9598c5c14f8278ac => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:20.969002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:20.969531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:20.969706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:20.997656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:20.999617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:21.071905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1550/3077] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:21.122742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:21.124911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:21.163614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:21.165882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:21.182379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b69a18-2360-484b-8789-50169e50fabc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:21.191358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:21.192868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:21.193919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:21.194503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] PATH_INFO: `/v3/users/cdf4dbb95b6a440fad542fad69b6a5d8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:21.196775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf4dbb95b6a440fad542fad69b6a5d8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:21.200034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:21.223730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:21.251344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d420a-04a3-4025-8afa-5edf22d1dd33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:21.257666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:21.257666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:21.258198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:21.258628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:21.273860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:21.276091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:21.316078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1528/3078] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:21.351754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:21.353848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:21.374523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf4dbb95b6a440fad542fad69b6a5d8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.376794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf4dbb95b6a440fad542fad69b6a5d8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.395169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc216-fe8d-4d56-94db-b209059b88c9 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:21.410985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:21.412101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:21.412493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:21.412935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] PATH_INFO: `/v3/users/662ef2b3df5e4c59b373fccab9c911c2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:21.415495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf4dbb95b6a440fad542fad69b6a5d8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.417274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662ef2b3df5e4c59b373fccab9c911c2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:21.419543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:21.451777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf4dbb95b6a440fad542fad69b6a5d8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.480211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf4dbb95b6a440fad542fad69b6a5d8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.499775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1551/3079] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:21 2022] DELETE /identity/v3/users/cdf4dbb95b6a440fad542fad69b6a5d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:21.543799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:21.556921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662ef2b3df5e4c59b373fccab9c911c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.582645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662ef2b3df5e4c59b373fccab9c911c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.611873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662ef2b3df5e4c59b373fccab9c911c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.612881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662ef2b3df5e4c59b373fccab9c911c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.613963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662ef2b3df5e4c59b373fccab9c911c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:21.669193 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1529/3080] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:21 2022] DELETE /identity/v3/users/662ef2b3df5e4c59b373fccab9c911c2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:22.360387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:22.362128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:22.484619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd2ccd-989a-4a20-afa8-c117c0fec47b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:22.698097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:22.701584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:22.703315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:22.705576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] PATH_INFO: `/v3/projects/93a8fd73df2a4456a59bee4c7dbcfd51` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:22.709853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a8fd73df2a4456a59bee4c7dbcfd51)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:22.717601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:22.873388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:22.883083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:22.885168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:22.895531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a8fd73df2a4456a59bee4c7dbcfd51', 'request_id': 'req-2d98dacf-c412-4926-b1ff-57c0110ccac5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:22.915694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a8fd73df2a4456a59bee4c7dbcfd51', 'request_id': 'req-2d98dacf-c412-4926-b1ff-57c0110ccac5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:22.916444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010cb7c-81a4-439d-9222-3ade155973c1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:22.938020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a8fd73df2a4456a59bee4c7dbcfd51', 'request_id': 'req-2d98dacf-c412-4926-b1ff-57c0110ccac5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:22.997190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] The token cache is being invalidate because project 93a8fd73df2a4456a59bee4c7dbcfd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:22.997483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:22.999921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d98dacf-c412-4926-b1ff-57c0110ccac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.009701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1552/3081] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:22 2022] DELETE /identity/v3/projects/93a8fd73df2a4456a59bee4c7dbcfd51 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:23.011603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.011890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.012167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.103792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:23.105267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.149323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:23.150568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.151025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.151509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] PATH_INFO: `/v3/projects/fd2dd16178804914b9afde659428992f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.155976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2dd16178804914b9afde659428992f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:23.159375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:23.276156 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1553/3082] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:23.277612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:23.278965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.294686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb1a2c-bcfe-4fb7-ae0a-52b8acc68a7b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:23.367054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2dd16178804914b9afde659428992f', 'request_id': 'req-d14d8c15-c16a-4206-9dea-3f3ede6d7719'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.388118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2dd16178804914b9afde659428992f', 'request_id': 'req-d14d8c15-c16a-4206-9dea-3f3ede6d7719'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.403481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2dd16178804914b9afde659428992f', 'request_id': 'req-d14d8c15-c16a-4206-9dea-3f3ede6d7719'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.428329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] The token cache is being invalidate because project fd2dd16178804914b9afde659428992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:23.428329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.433017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d14d8c15-c16a-4206-9dea-3f3ede6d7719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.438280 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1530/3083] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:22 2022] DELETE /identity/v3/projects/fd2dd16178804914b9afde659428992f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:23.438280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55986fa-bc37-4efa-bbc7-e020447c357a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.438280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55986fa-bc37-4efa-bbc7-e020447c357a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.438280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55986fa-bc37-4efa-bbc7-e020447c357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.477537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b55986fa-bc37-4efa-bbc7-e020447c357a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:23.479651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:23.481585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b55986fa-bc37-4efa-bbc7-e020447c357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.489484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.490828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.494071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] PATH_INFO: `/v3/projects/0705a9948d8b49b5a41cde4819c470d0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.506862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0705a9948d8b49b5a41cde4819c470d0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:23.507525 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1531/3084] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:23.510460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.511943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.512495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.527818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:23.553118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:23.555016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.580316 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1532/3085] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:23.583693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:23.605387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0a930-a20a-4f45-9c4f-598d39c3d899 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:23.617572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:23.618278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.618455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.619250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.620682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:23.621082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:23.623945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78977695-d348-44bb-b6f0-ef56e5d360c0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:23.657939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1533/3086] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:23.659586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.659949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.660303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.690959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:23.692797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.715128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1534/3087] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:23.716448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:23.745312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0705a9948d8b49b5a41cde4819c470d0', 'request_id': 'req-8713617f-64fd-47be-9ce3-ad368871673e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.753410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e268d-4a10-440d-8431-90377f61ab36 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:23.775609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:23.794905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0705a9948d8b49b5a41cde4819c470d0', 'request_id': 'req-8713617f-64fd-47be-9ce3-ad368871673e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.812743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0705a9948d8b49b5a41cde4819c470d0', 'request_id': 'req-8713617f-64fd-47be-9ce3-ad368871673e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.819024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:23.869460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] The token cache is being invalidate because project 0705a9948d8b49b5a41cde4819c470d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:23.870420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.872041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:23.876975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1554/3088] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:23 2022] DELETE /identity/v3/projects/0705a9948d8b49b5a41cde4819c470d0 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:23.878105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:23.880328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:23.881154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.881775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.883623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:23.884168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.886481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:23.892020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ddd97-5622-4325-8974-6c008d18cbed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:23.917362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713617f-64fd-47be-9ce3-ad368871673e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:23.930494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:23.931420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.931797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.932223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.933439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:23.934082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:23.942857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:23.957387 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1535/3089] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:23.959504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:23.961412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:23.962926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:23.999218 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1555/3090] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:24.001982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.010087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:24.039397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:24.041157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:24.044359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd29c-963e-4186-8dd6-f1bff7ef7b9f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.248629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1536/3091] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:24.250369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.261864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.262566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.262849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.263130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.263856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.266022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dd8cd-e785-49bc-82e5-c11c25c316c1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.284808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67684a37-a7dd-4c17-bf1d-cebedef633ef None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.302726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.303415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.303697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.304880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.304880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.306641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.331687 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1556/3092] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:23 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:24.335120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.337131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.337713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.381765 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1537/3093] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:24 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:24.382917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.405299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:24.408379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:24.557452 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1557/3094] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:24.559348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.573507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dad8d-1ac0-4c56-b2a9-a7818bb46e4d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.582391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.583381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.583834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.584133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.585157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.592231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.602059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a97a-a035-48b6-940b-29a5251233e6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.614543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.615249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.615579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.615937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.617819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.622904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.642268 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1558/3095] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:24 2022] POST /identity/v3/users => generated 287 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:24.643725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.660373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63d3-e018-42bb-8882-79429b37b98d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.665351 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1538/3096] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:24.667412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.670618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.671751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.673382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.674297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.675576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:24.676213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.679290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.695981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7c57-d02a-41a9-8d2e-ff13905c650b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.703227 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1559/3097] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:24.704482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.721074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.721784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.722117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.722398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.723135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.727099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.742331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6a9b-9551-44ec-8d84-ba555fe6e672 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.747925 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1539/3098] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:24.749039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.752017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.752753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.753041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.753378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.754118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.763003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9621f7-70ca-4a21-b95e-c68a98c42ef4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.765710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.769053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.770348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.770526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.770899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.771647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.774298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.778507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:24.782845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1560/3099] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:24.782845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.807827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde3306-4db2-46ca-9a1d-43b1533e1b0f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.824573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:24.825248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:24.825514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:24.825897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:24.827997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:24.834687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:24.861856 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1561/3100] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:24.868737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.890898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc648726-ae9d-4469-8e41-395d76cb3ec9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:24.897869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1540/3101] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:24 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:24.899486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:24.923566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:25.025311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.026246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.026530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.026806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] PATH_INFO: `/v3/projects/acec722fe2034ddca7c8c5f836222b7e/users/cb8c8eecfff4448fa28c5d12aca9cc86/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.070244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee940c7-179c-424d-a3a7-b31b8aa725ef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.072742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acec722fe2034ddca7c8c5f836222b7e, user_id=cb8c8eecfff4448fa28c5d12aca9cc86, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.075723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.081390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.082422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.082710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.082987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] PATH_INFO: `/v3/projects/5dbd251024b743eeb8df3933633ad670/users/947e618099474e318580ab70d8d58a0d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.124901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1562/3102] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:24 2022] PUT /identity/v3/projects/acec722fe2034ddca7c8c5f836222b7e/users/cb8c8eecfff4448fa28c5d12aca9cc86/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:25.127368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbd251024b743eeb8df3933633ad670, user_id=947e618099474e318580ab70d8d58a0d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.127718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.137148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf308e6-ebc2-4763-a9f3-ffbd348d44ad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.169364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1541/3103] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:24 2022] PUT /identity/v3/projects/5dbd251024b743eeb8df3933633ad670/users/947e618099474e318580ab70d8d58a0d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:25.172191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1128bb-7b75-4177-beda-7a388beb152d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.172511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1128bb-7b75-4177-beda-7a388beb152d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.172844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1128bb-7b75-4177-beda-7a388beb152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.225445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cf1128bb-7b75-4177-beda-7a388beb152d None None] MFA Rules not processed for user `cb8c8eecfff4448fa28c5d12aca9cc86`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:25.226931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf1128bb-7b75-4177-beda-7a388beb152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:25.247030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816143e-c82a-48a5-b105-cd55069c0884 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.382135 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1542/3104] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:25.383481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.383763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.384038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.394420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.395294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.395653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.396049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.396912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.398933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.438431 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1563/3105] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:25 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:25.438714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] MFA Rules not processed for user `947e618099474e318580ab70d8d58a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:25.440046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:25.441478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.458920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:25.513199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:25.548259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:25.555312 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1543/3106] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:25.560901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.573172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2664-5f09-4973-b4ea-05a3067b66c9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.578313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.579105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.579464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.579861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.580724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.582873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.599951 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1544/3107] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:25.601963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.617866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed34f-f9fd-4b0f-9d53-26c5c249f5a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.626061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.626448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125c48-133a-4a42-8ba5-e9f5d01c7c9f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.627666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.628032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.628892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.629704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.633236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.644017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.644907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.645263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.645669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.656343 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1545/3108] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:25.657706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.661855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.663868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.673610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ee3b7-b259-44b8-92c7-fceb6fe9cc4d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.679668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.680867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.681152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.681425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] PATH_INFO: `/v3/projects/9fe2cfca1b434e0ca5e91e22cb9da9e2/users/78f952da089344fcbff6d88ab464e50a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.687226 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1564/3109] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:25.702752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe2cfca1b434e0ca5e91e22cb9da9e2, user_id=78f952da089344fcbff6d88ab464e50a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:25.706553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e3890-e974-434d-ba89-db3a262e289a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:25.725352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:25.736169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1546/3110] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:25 2022] PUT /identity/v3/projects/9fe2cfca1b434e0ca5e91e22cb9da9e2/users/78f952da089344fcbff6d88ab464e50a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:25.741049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.741413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.741765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.746767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3354fe-aaf6-403b-851a-e5c6df0726c0 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:25.812709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:25.824623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:25.880577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:25.881852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:25.882146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:25.882432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:25.957079 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1547/3111] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:26.039921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:26.041907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:26.056342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1565/3112] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:26.063412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:26.065205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:26.229331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279eeae-4c5b-4d8c-8fdd-86938bc9584a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:26.235055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:26.235725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:26.236011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:26.236292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:26.248602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:26.250092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8377-93da-45cb-a35b-f2180255e175 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:26.261884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1548/3113] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:26.599357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:26.616466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e20fdc-835d-4fdf-a69a-8f048760b44c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:26.629095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:26.631338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:26.631795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:26.632325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] PATH_INFO: `/v3/users/947e618099474e318580ab70d8d58a0d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:26.635154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947e618099474e318580ab70d8d58a0d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:26.637850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:26.709425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:26.709824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:26.710078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:26.747759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:26.749763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:26.754820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947e618099474e318580ab70d8d58a0d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:26.755837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947e618099474e318580ab70d8d58a0d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:26.770144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947e618099474e318580ab70d8d58a0d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:26.772307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:26.839288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947e618099474e318580ab70d8d58a0d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:26.888412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11a45cf1-6ace-4c6f-abc7-31bc70d73b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947e618099474e318580ab70d8d58a0d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:26.897370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:26.900093 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1566/3114] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:26 2022] DELETE /identity/v3/users/947e618099474e318580ab70d8d58a0d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:26.907781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:26.908351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:26.908883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:26.941943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1549/3115] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:26.952068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:26.953313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:26.992845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:26.992845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:27.151731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1567/3116] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:27.155550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:27.159386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:27.159770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96529a93-4154-483c-8dab-5c0a8922e049 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:27.195938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fae1f-117f-433c-9402-bf7d99f29cbe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:27.205717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:27.206922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:27.207384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:27.207823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] PATH_INFO: `/v3/users/cb8c8eecfff4448fa28c5d12aca9cc86` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:27.209244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8c8eecfff4448fa28c5d12aca9cc86)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:27.211353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:27.286746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:27.292458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:27.292458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:27.292458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:27.306994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8c8eecfff4448fa28c5d12aca9cc86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:27.309735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8c8eecfff4448fa28c5d12aca9cc86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:27.330443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8c8eecfff4448fa28c5d12aca9cc86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:27.361268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8c8eecfff4448fa28c5d12aca9cc86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:27.380042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8c8eecfff4448fa28c5d12aca9cc86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:27.429642 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1568/3117] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:27 2022] DELETE /identity/v3/users/cb8c8eecfff4448fa28c5d12aca9cc86 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:27.433730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:27.444523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:27.496896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:27.502332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f86e8-8885-4eda-acf3-003ca198b281 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:27.525342 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1550/3118] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:59:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:27.528718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:27.529325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:27.530749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:27.582257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:27.585135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:27.641038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:27.660877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c375-4702-41d6-b3da-9b2d1a314293 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:27.676782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:27.677478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:27.684044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:27.702108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:27.704464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:27.710126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:27.795842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1551/3119] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:27.928759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:27.932857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:27.971966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1569/3120] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:28.015177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:28.054695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb371e0c-6650-4b0c-bfb1-e045f84f89e2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:28.068592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:28.139616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:28.140251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:28.141207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:28.179365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:28.183019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:28.205579 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1552/3121] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:30.694093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:30.696220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:30.713818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe8ad-62d6-4388-8ab2-58465ea02b55 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:30.729498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:30.730463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:30.730748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:30.731109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] PATH_INFO: `/v3/projects/5dbd251024b743eeb8df3933633ad670` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:30.732875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbd251024b743eeb8df3933633ad670)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:30.734882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:30.886090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:30.891683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:30.918324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbd251024b743eeb8df3933633ad670', 'request_id': 'req-e01971eb-d03e-4136-970e-1f636af11dec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:30.930270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbd251024b743eeb8df3933633ad670', 'request_id': 'req-e01971eb-d03e-4136-970e-1f636af11dec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:30.939844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbd251024b743eeb8df3933633ad670', 'request_id': 'req-e01971eb-d03e-4136-970e-1f636af11dec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:30.956845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] The token cache is being invalidate because project 5dbd251024b743eeb8df3933633ad670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:30.957123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:30.958317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e01971eb-d03e-4136-970e-1f636af11dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:30.963917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1570/3122] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:30 2022] DELETE /identity/v3/projects/5dbd251024b743eeb8df3933633ad670 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:30.966007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961850-a83a-4aac-90d7-e1eea77dac86 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:30.966007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961850-a83a-4aac-90d7-e1eea77dac86 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:30.966340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961850-a83a-4aac-90d7-e1eea77dac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:30.992608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-06961850-a83a-4aac-90d7-e1eea77dac86 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:30.993961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06961850-a83a-4aac-90d7-e1eea77dac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:31.075199 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1571/3123] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:31.170192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.170906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.171399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.182323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb95a-e0bc-4c64-90a5-96cc775f030c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.216353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:31.221683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:31.247439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1572/3124] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:31.251357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.267328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fb40f-77b5-4036-af38-fc052bdbe64b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.275576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.276841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.277338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.277818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.285644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:31.286516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.288596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.300137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:31.315269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.316068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.316348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.316645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.318323 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1573/3125] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:59:31.321984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:31.322397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.341912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5fcf-b2bc-4127-8b17-08de6663680a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.349393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.351006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.354900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.359020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.359020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.359020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.359020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.362637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.373222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1553/3126] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:59:31.430841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1574/3127] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:31 2022] POST /identity/v3/projects => generated 395 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:59:31.435273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.448390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ee62f-7c34-4f8f-bfc5-b897221be740 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.523464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:31.540713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.542037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.542844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.543135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.549119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.555011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.613488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.621925 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1554/3128] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:31 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:31.627602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4180c38-67d3-4622-8933-54dd4fc5024c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.634028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.635296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.635779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.637118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.638123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.640130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.676562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.683284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1575/3129] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:31.692307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26545c83-c443-4683-a5c9-aaf948c2293e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.715957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.718313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.719853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.720504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.722308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.731579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53730f3-48cc-44a2-b19c-085ff16dd529 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.765826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.767262 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1555/3130] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:31.807764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657429-bfe1-45da-89f3-37937c687700 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:31.828415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:31.829377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.830948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.831278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] PATH_INFO: `/v3/projects/5bc003f45965400d8bc55f9c1ed4cb34/users/1c2fbc5cb7934f25bfa96539a603a20f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.882436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc003f45965400d8bc55f9c1ed4cb34, user_id=1c2fbc5cb7934f25bfa96539a603a20f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:31.890710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:31.934460 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1576/3131] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:31 2022] PUT /identity/v3/projects/5bc003f45965400d8bc55f9c1ed4cb34/users/1c2fbc5cb7934f25bfa96539a603a20f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:31.944728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:31.945622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:31.946071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:31.958921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:31.961214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.008136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:32.009717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.185216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1556/3132] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:32.190700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:32.192492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.192846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6550d-cad4-42ff-b290-14a5839cc608 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:32.217266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:32.220574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:32.220909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:32.221202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] PATH_INFO: `/v3/users/a64a76813475430a9ee6e8d297bb8683` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:32.221978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc09fa-1103-4398-a7ba-6b4db4661439 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:32.224731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64a76813475430a9ee6e8d297bb8683)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:32.229902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:32.253503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:32.254703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:32.255082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:32.255456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] PATH_INFO: `/v3/projects/acec722fe2034ddca7c8c5f836222b7e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:32.257727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acec722fe2034ddca7c8c5f836222b7e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:32.262295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:32.465413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64a76813475430a9ee6e8d297bb8683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.467903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64a76813475430a9ee6e8d297bb8683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.489837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64a76813475430a9ee6e8d297bb8683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.521180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64a76813475430a9ee6e8d297bb8683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.525412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acec722fe2034ddca7c8c5f836222b7e', 'request_id': 'req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.541656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9158edb9-d0b2-4ee1-97c9-cfa1112876fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64a76813475430a9ee6e8d297bb8683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.548763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acec722fe2034ddca7c8c5f836222b7e', 'request_id': 'req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.564967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acec722fe2034ddca7c8c5f836222b7e', 'request_id': 'req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.577577 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1577/3133] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:31 2022] DELETE /identity/v3/users/a64a76813475430a9ee6e8d297bb8683 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:32.580634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b90f-de6c-4feb-b146-c02b5ce05993 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:32.585860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b90f-de6c-4feb-b146-c02b5ce05993 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:32.586587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b90f-de6c-4feb-b146-c02b5ce05993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:32.587336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] The token cache is being invalidate because project acec722fe2034ddca7c8c5f836222b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:32.587643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.589793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:32.592254 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1557/3134] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:32 2022] DELETE /identity/v3/projects/acec722fe2034ddca7c8c5f836222b7e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:59:32.593159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:32.604466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.637018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7a03b90f-de6c-4feb-b146-c02b5ce05993 None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:32.638868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a03b90f-de6c-4feb-b146-c02b5ce05993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.669481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:32.758351 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1578/3135] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:32.760157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6433-3c0b-4ef9-bb79-f70dfe3321b5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:32.760719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6433-3c0b-4ef9-bb79-f70dfe3321b5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:32.761425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6433-3c0b-4ef9-bb79-f70dfe3321b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:32.795254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:32.806651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-19fc6433-3c0b-4ef9-bb79-f70dfe3321b5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:32.808611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-19fc6433-3c0b-4ef9-bb79-f70dfe3321b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.897247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a8b8b-689f-468e-b5ea-36ad8ef9d8d5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:32.914086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1579/3136] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:32.927087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:32.927995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:32.929218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:32.953205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:32.958269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:32.966666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1580/3137] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:32.971702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:32.983913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08910e11-f618-4c9e-909b-cad07c68acbe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.005445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.011517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.012171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.012745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.013753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:33.014381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.016764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.042124 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1581/3138] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:33.045892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.050604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:33.118961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.119751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.119941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.120209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.129955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:33.175927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.182081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.218509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1558/3139] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:33.220888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.277407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24db925-c385-4355-b055-8380cba0b8fc service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.291127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.291881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.292210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.292490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.293206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.300766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.399027 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1559/3140] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:33 2022] POST /identity/v3/projects => generated 359 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:33.400786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.417088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466adb4-3fa1-443b-8a8f-84bacbfc2049 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.506307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364610-3bf0-422a-8585-d24f149c39a8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.512063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.513107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.513641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.513828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.514713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.518034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.554660 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1560/3141] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:33 2022] POST /identity/v3/users => generated 280 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:33.558751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.598400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6031df-591f-4334-8de4-b51ad93689c9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.613932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.616140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.616465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.616768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.619800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.624746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.664269 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1561/3142] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:33.668967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.701293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c900-6ef5-4b94-9f22-2c13fb44abad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.712821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.718588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.718827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.719646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.720599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.723850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.735907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:33.756922 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1562/3143] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:33.759717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:33.784142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f0f8-05e0-4c5b-b6e3-46446d67b8af admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:33.796578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.802101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.812974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.813579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] PATH_INFO: `/v3/projects/330e9bdb34654285bddff7425e1a281b/users/db4baff8910e4cb38ea594fb9b29a2bf/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.842666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e9bdb34654285bddff7425e1a281b, user_id=db4baff8910e4cb38ea594fb9b29a2bf, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:33.845860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed5c6-321e-4ac8-bb8c-1552141d218e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:33.865315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:33.873890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:33.875039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.875501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.875856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.887332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:33.890068 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1563/3144] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:33 2022] PUT /identity/v3/projects/330e9bdb34654285bddff7425e1a281b/users/db4baff8910e4cb38ea594fb9b29a2bf/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:59:33.903365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a6fb-be80-471d-9815-3d8ea0d5a7c4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:33.903811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a6fb-be80-471d-9815-3d8ea0d5a7c4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:33.904277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a6fb-be80-471d-9815-3d8ea0d5a7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:33.986288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-13b7a6fb-be80-471d-9815-3d8ea0d5a7c4 None None] MFA Rules not processed for user `db4baff8910e4cb38ea594fb9b29a2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:33.991131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13b7a6fb-be80-471d-9815-3d8ea0d5a7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:34.100234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1564/3145] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:34.123980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:34.125918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:34.160937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1582/3146] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 1118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:34.185255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:34.187021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:34.187494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:34.242325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:34.246340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:34.418095 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1565/3147] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:34.673137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:34.675307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:34.697408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:34.698188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d798d-a092-46ba-ba96-79f2663c1fcc service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:34.882245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:34.883226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:34.883637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:34.884009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] PATH_INFO: `/v3/projects/ead50a31ce9d4d108bcc8f2d8844ac39` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:34.886282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead50a31ce9d4d108bcc8f2d8844ac39)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:34.888321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:34.893853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ec26-5623-439d-afe7-27a33f81906b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:34.912660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:34.913351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:34.913642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:34.913922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:34.938744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:34.947357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:34.976208 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1566/3148] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:59:35.011660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'request_id': 'req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.044856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'request_id': 'req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.052972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'request_id': 'req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.066246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:35.084759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693bd99-d09d-467e-abc1-ce64b9117131 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:35.097983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] The token cache is being invalidate because project ead50a31ce9d4d108bcc8f2d8844ac39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:35.097983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.097983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-40c4f5c1-6846-48a9-b4ea-4cf6cff3aeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.103775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1583/3149] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:34 2022] DELETE /identity/v3/projects/ead50a31ce9d4d108bcc8f2d8844ac39 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:35.110168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8466-28d2-4ee7-881a-401b7ad4a196 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.110549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8466-28d2-4ee7-881a-401b7ad4a196 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.110950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8466-28d2-4ee7-881a-401b7ad4a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.135864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:35.178824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e5bc8466-28d2-4ee7-881a-401b7ad4a196 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:35.180400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e5bc8466-28d2-4ee7-881a-401b7ad4a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:35.193659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:35.267757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:35.269048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.269447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.269835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] PATH_INFO: `/v3/users/db4baff8910e4cb38ea594fb9b29a2bf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.272116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4baff8910e4cb38ea594fb9b29a2bf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:35.274466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:35.416894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4baff8910e4cb38ea594fb9b29a2bf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.430605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1584/3150] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:35.432492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b559d6-f92b-43f7-b18c-2a07c4988225 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.433329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b559d6-f92b-43f7-b18c-2a07c4988225 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.433329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b559d6-f92b-43f7-b18c-2a07c4988225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.435300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4baff8910e4cb38ea594fb9b29a2bf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.457857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-23b559d6-f92b-43f7-b18c-2a07c4988225 None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:35.459343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23b559d6-f92b-43f7-b18c-2a07c4988225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:35.461851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4baff8910e4cb38ea594fb9b29a2bf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.464837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4baff8910e4cb38ea594fb9b29a2bf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.466748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15416ed8-da6f-4f67-8815-94ce5026420f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4baff8910e4cb38ea594fb9b29a2bf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:35.494233 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1567/3151] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:35 2022] DELETE /identity/v3/users/db4baff8910e4cb38ea594fb9b29a2bf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:35.495710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.496068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.496416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.538005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:35.539426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:35.607428 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1585/3152] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:35.609967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.611239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.611741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.640797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:35.643848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:35.692543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1568/3153] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:35.693336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:35.716352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b762-19ea-4877-8c98-43cbcde6a738 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:35.727454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:35.728143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.728453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.732252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.733076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:35.733392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:35.738374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:35.764689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1569/3154] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:35.769124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:35.784805 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1586/3155] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:35.792537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4450be0-fcc6-4ec3-bb99-d4fef0c33557 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:35.807085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:35.808672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:35.809239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:35.810337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:35.814357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:35.820596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:35.825927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:35.829377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:35.989845 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1570/3156] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:35 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:36.003035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.009467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:36.069692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1edd-1726-40e1-bc5e-7fdf901ab699 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.107264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:36.120001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa88199-d205-4c55-a2c0-1c0299e6e2a8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.126081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.126961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.127353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.128436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.129288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.131358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.160770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1571/3157] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:36 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:36.164721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.177335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a27f93-48ca-4c19-af31-fd1ec36f0d33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.183187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.184078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.184523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.184948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.185850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.187703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.202716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1572/3158] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:59:36.207873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.238897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.239855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.240166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.242455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.265892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e67e9-f7b1-413a-9460-c113037b9236 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.274327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.275971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.295000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.298716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.300074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.300491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.310731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.312578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda5a58-4189-49a0-b2e0-430622efbe13 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.327604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1587/3159] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:36.347514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1573/3160] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:36.352166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.362972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807f0f-d72a-47f3-a8a8-4aefb52c9a70 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.382329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.383308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.383593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.383882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] PATH_INFO: `/v3/projects/e11392205e814f46be92aa13f9e7dcfe/users/69effad76345477987af68f55c90e2e1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.421704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11392205e814f46be92aa13f9e7dcfe, user_id=69effad76345477987af68f55c90e2e1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.424736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab99b7-2734-4442-9106-fb1630fe7cc2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.464961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.464961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.465333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.467319 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1588/3161] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:36 2022] PUT /identity/v3/projects/e11392205e814f46be92aa13f9e7dcfe/users/69effad76345477987af68f55c90e2e1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:36.496708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:36.498356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:36.610498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37febb1-517a-458a-bb9a-8501300a7128 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.610815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37febb1-517a-458a-bb9a-8501300a7128 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.611611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37febb1-517a-458a-bb9a-8501300a7128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.671834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f37febb1-517a-458a-bb9a-8501300a7128 None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:36.673892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f37febb1-517a-458a-bb9a-8501300a7128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:36.677754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1574/3162] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:36.705799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.717642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:36.786276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1589/3163] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:59:36.835073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.835379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.835618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.883381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] MFA Rules not processed for user `1c2fbc5cb7934f25bfa96539a603a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:36.884680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:36.887588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7775cc-b1ae-419d-8b50-e8090a38a775 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.893965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.895078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.895583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.896091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.904901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1590/3164] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:36.908589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.937413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e995b8d-b093-4c67-a418-d54796944996 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:36.943424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:36.945492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:36.970410 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1575/3165] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:36.979684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09e192-e062-44ad-b1c0-9a6442843f49 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:36.986282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:36.987598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:36.988088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:36.988577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] PATH_INFO: `/v3/users/1c2fbc5cb7934f25bfa96539a603a20f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:36.990703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2fbc5cb7934f25bfa96539a603a20f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:36.995432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:37.119787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2fbc5cb7934f25bfa96539a603a20f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:37.121277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2fbc5cb7934f25bfa96539a603a20f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:37.148248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2fbc5cb7934f25bfa96539a603a20f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:37.183493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2fbc5cb7934f25bfa96539a603a20f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:37.194554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2fbc5cb7934f25bfa96539a603a20f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:37.207196 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1591/3166] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:36 2022] DELETE /identity/v3/users/1c2fbc5cb7934f25bfa96539a603a20f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:37.212014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:37.212256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:37.212496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:37.250438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:37.251877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:37.275775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:37.431076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1576/3167] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:37.480040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:37.489029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:37.523473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:37.817542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9c1a-7596-4131-a9d0-78a6e4015ef0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:37.849182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:37.849879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:37.869120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:37.869415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:37.892084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:37.893599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:37.908675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1592/3168] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:38.061677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:38.063124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:38.277643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdcc7c-f225-4258-a430-1d4c592c1e7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:38.322864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:38.323802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:38.324254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:38.324910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:38.330360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:38.360645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:38.362282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:38.406238 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1577/3169] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:40.039724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:40.041463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:40.084950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4508fe-19ad-4e15-abf9-44bcae1de7be service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:40.121038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:40.122125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.122414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.122686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] PATH_INFO: `/v3/projects/5bc003f45965400d8bc55f9c1ed4cb34` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:40.132404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc003f45965400d8bc55f9c1ed4cb34)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:40.134885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:40.331208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc003f45965400d8bc55f9c1ed4cb34', 'request_id': 'req-e2175a28-bc3b-4d3b-9734-1251d5101b93'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.333729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:40.335843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:40.360104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc003f45965400d8bc55f9c1ed4cb34', 'request_id': 'req-e2175a28-bc3b-4d3b-9734-1251d5101b93'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.369946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307dae-1fcd-4f2d-aeb6-dc1109c94634 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:40.379599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc003f45965400d8bc55f9c1ed4cb34', 'request_id': 'req-e2175a28-bc3b-4d3b-9734-1251d5101b93'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.418497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] The token cache is being invalidate because project 5bc003f45965400d8bc55f9c1ed4cb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:40.418953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.419912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e2175a28-bc3b-4d3b-9734-1251d5101b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.427680 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1593/3170] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:40 2022] DELETE /identity/v3/projects/5bc003f45965400d8bc55f9c1ed4cb34 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:40.435275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e8-6df3-43d5-a9e3-df00d187c305 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.435722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e8-6df3-43d5-a9e3-df00d187c305 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.436957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073122e8-6df3-43d5-a9e3-df00d187c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:40.510916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-073122e8-6df3-43d5-a9e3-df00d187c305 None None] MFA Rules not processed for user `78f952da089344fcbff6d88ab464e50a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:40.512350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-073122e8-6df3-43d5-a9e3-df00d187c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:40.541121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:40.543261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.543726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.544167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] PATH_INFO: `/v3/projects/330e9bdb34654285bddff7425e1a281b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:40.546477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=330e9bdb34654285bddff7425e1a281b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:40.552489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:40.664687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:40.675935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330e9bdb34654285bddff7425e1a281b', 'request_id': 'req-fd520997-d4aa-467a-a4ac-16a97392dd2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.697698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330e9bdb34654285bddff7425e1a281b', 'request_id': 'req-fd520997-d4aa-467a-a4ac-16a97392dd2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.704715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330e9bdb34654285bddff7425e1a281b', 'request_id': 'req-fd520997-d4aa-467a-a4ac-16a97392dd2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.706691 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1594/3171] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:40.723213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a31e7-e108-40ad-bcea-23aa88763e50 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.726501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a31e7-e108-40ad-bcea-23aa88763e50 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.727628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a31e7-e108-40ad-bcea-23aa88763e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:40.739086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] The token cache is being invalidate because project 330e9bdb34654285bddff7425e1a281b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:40.739398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.745070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd520997-d4aa-467a-a4ac-16a97392dd2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:40.751730 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1578/3172] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:40 2022] DELETE /identity/v3/projects/330e9bdb34654285bddff7425e1a281b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:40.751730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580d3a-93cb-4fd5-9111-dc29c8117080 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.751730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580d3a-93cb-4fd5-9111-dc29c8117080 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.751730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580d3a-93cb-4fd5-9111-dc29c8117080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:40.785712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-af1a31e7-e108-40ad-bcea-23aa88763e50 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:40.787460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af1a31e7-e108-40ad-bcea-23aa88763e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:40.793592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4a580d3a-93cb-4fd5-9111-dc29c8117080 None None] MFA Rules not processed for user `78f952da089344fcbff6d88ab464e50a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:40.796508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a580d3a-93cb-4fd5-9111-dc29c8117080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:40.831701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:40.978945 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1579/3173] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:40.984787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f544ce-de22-4f3d-b0e2-8f475fc76fef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:40.985146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f544ce-de22-4f3d-b0e2-8f475fc76fef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:40.985261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f544ce-de22-4f3d-b0e2-8f475fc76fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.026282 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1595/3174] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:41.044452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-87f544ce-de22-4f3d-b0e2-8f475fc76fef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:41.045723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87f544ce-de22-4f3d-b0e2-8f475fc76fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:41.049651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.050229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.050229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.102370 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1580/3175] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:41.103889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.104182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.106995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.129568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:41.135973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:41.158927 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1596/3176] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:41.162797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.189313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:41.190625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:41.194246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf03d4-cacb-4983-a33a-fa3b12647228 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:41.206111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:41.209616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.209914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.210203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.213004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:41.213252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:41.220964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1581/3177] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:41.221093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:41.221199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.228606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:41.267617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1597/3178] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:41.270275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.299321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d541ce-603a-4bc8-a04a-6d3dddb2a134 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:41.321909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:41.322630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.322926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.323215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.323968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:41.324280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:41.325957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:41.364544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1598/3179] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:41.365564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.394257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37e15-67c4-4eed-bbd9-aba016488831 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:41.417020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:41.417755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.418112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.418397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.419117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:41.438281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:41.571382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516e150-1aca-4a0f-a2c0-620131263c26 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:41.574249 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1599/3180] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:41 2022] POST /identity/v3/projects => generated 397 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:41.576298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.790892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd738-8221-4ca2-8591-c31dd77ec61b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:41.794827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:41.804341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:41.804341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.804341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.804972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.808698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:41.808698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:41.816582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:41.816582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:41.817515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:41.817515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:41.825467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:41.908288 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1600/3181] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:41 2022] POST /identity/v3/projects => generated 379 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:41.909538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:41.972385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:41.974076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.017392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1582/3182] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:42.018383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.042062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:42.049214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a3ba-ea1e-4dae-817d-4e7c387fb0e1 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.070413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4ae8a-a75c-4806-ad1f-51fb1b010e2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.085365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.112140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.116869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.117390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.118511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.121760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.183261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1601/3183] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:41 2022] POST /identity/v3/users => generated 299 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:42.187197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.199588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476fbe8-3698-4ce3-ae65-cc4f38e7715f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.211958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.212850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.213156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.213776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.214891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.217130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.229252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.230251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.230635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.231099 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1602/3184] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:42.234202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.235028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.235387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.237248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.260719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec8e7-02fc-430f-a836-90bf9c24cdf2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.274364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.276522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.278665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.280441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.282075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.285008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.302374 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1583/3185] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:42 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:42.306063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.325588 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1603/3186] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:42.330233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.330601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07480a1f-80a4-42e1-950d-6955bba071da admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.336044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.336808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.337094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.337493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.338228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.340511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.349322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76c260-4b23-4de5-9179-c557de782c43 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.353104 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1584/3187] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:42.357883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.368147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.369271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.371983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.373538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] PATH_INFO: `/v3/projects/27b6256b931e4f67bd0795961bb29b4e/users/7e42634d85d14429b9779efa8bb84f8f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.377201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9487f-0b28-4993-9aed-bc32a640ae9f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.387821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.394272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.395009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.395473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.396717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.398653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.414241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1585/3188] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:59:42.419583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.423105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b6256b931e4f67bd0795961bb29b4e, user_id=7e42634d85d14429b9779efa8bb84f8f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.430474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3a4b1-b5fc-4492-89c3-ed87978b5c11 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.434551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b647b8-7f4c-4e6e-91d3-c7ab72b85c4f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.443195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.444642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.445247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.445711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] PATH_INFO: `/v3/projects/e2076d2f07d34d44b9431dc1e9e78e14/users/259fbe1886a644c28632dc5c8a3c3568/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.465368 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1604/3189] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:42 2022] PUT /identity/v3/projects/27b6256b931e4f67bd0795961bb29b4e/users/7e42634d85d14429b9779efa8bb84f8f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:59:42.467813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.468220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.468653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.470997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2076d2f07d34d44b9431dc1e9e78e14, user_id=259fbe1886a644c28632dc5c8a3c3568, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.474297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a77a1-e9a7-4ecb-b60e-643bf0cda40f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.499639 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1586/3190] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 20:59:42 2022] PUT /identity/v3/projects/e2076d2f07d34d44b9431dc1e9e78e14/users/259fbe1886a644c28632dc5c8a3c3568/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:42.505283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.505781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.506251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.519533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:42.525263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:42.560017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:42.564010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:42.659342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1605/3191] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:42.691298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:42.718473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.721154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:42.745968 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1587/3192] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:42.834228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a296aa-e3c5-4eba-9722-7c34a75354ec None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:42.844764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:42.845612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:42.846006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:42.848988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:42.887763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:42.889279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:42.945597 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1606/3193] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:59:42.977377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:42.993234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a19e3-07c8-4db8-aa66-f6fc4ca48e9f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:43.002809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:43.003828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:43.004952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:43.007043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:43.029701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:43.034977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:43.064786 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1588/3194] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:52.914511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=80,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:53.052977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=13 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:55.543316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:55.545011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:55.584300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdbad-f83b-4032-a9a0-a46ff98f3202 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:55.629211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:55.630124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:55.635452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:55.637925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] PATH_INFO: `/v3/users/39e82edaa30d418d96ea37f942d62755` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:55.647586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e82edaa30d418d96ea37f942d62755)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:55.649792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:55.886125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e82edaa30d418d96ea37f942d62755'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:55.887702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e82edaa30d418d96ea37f942d62755'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:55.929213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e82edaa30d418d96ea37f942d62755'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:55.970459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e82edaa30d418d96ea37f942d62755'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:55.981535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e82edaa30d418d96ea37f942d62755'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:55.999204 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1607/3195] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:55 2022] DELETE /identity/v3/users/39e82edaa30d418d96ea37f942d62755 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:56.501887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:56.518344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c115-b741-4556-96a7-10a598513fd5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:56.651679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:56.652651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:56.652935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:56.653208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] PATH_INFO: `/v3/projects/6a2d8b5c82f44807b9d01252ea17cff9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:56.656842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2d8b5c82f44807b9d01252ea17cff9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:56.660862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:56.775340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2d8b5c82f44807b9d01252ea17cff9', 'request_id': 'req-b9a3e845-848c-4f01-a108-ee2bca4c35e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:56.796351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2d8b5c82f44807b9d01252ea17cff9', 'request_id': 'req-b9a3e845-848c-4f01-a108-ee2bca4c35e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:56.810913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2d8b5c82f44807b9d01252ea17cff9', 'request_id': 'req-b9a3e845-848c-4f01-a108-ee2bca4c35e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:56.834342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] The token cache is being invalidate because project 6a2d8b5c82f44807b9d01252ea17cff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:56.835054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:56.836363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b9a3e845-848c-4f01-a108-ee2bca4c35e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:56.840623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1589/3196] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:56 2022] DELETE /identity/v3/projects/6a2d8b5c82f44807b9d01252ea17cff9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:56.845902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:56.847415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:56.884122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73068-48f4-426a-a13d-9b265ee99b1a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:57.005164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:57.007789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:57.008218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:57.009237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] PATH_INFO: `/v3/users/51a5cf4eee334f3a968c1a9c0714fd5b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:57.011376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a5cf4eee334f3a968c1a9c0714fd5b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:57.016859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:57.120921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a5cf4eee334f3a968c1a9c0714fd5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:57.122201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a5cf4eee334f3a968c1a9c0714fd5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:57.132479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a5cf4eee334f3a968c1a9c0714fd5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:57.167171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a5cf4eee334f3a968c1a9c0714fd5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:57.170518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:57.186292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a5cf4eee334f3a968c1a9c0714fd5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:57.196623 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1608/3197] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:59:56 2022] DELETE /identity/v3/users/51a5cf4eee334f3a968c1a9c0714fd5b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:58.836487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:58.837442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:58.837825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:58.858420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:58.859758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:58.981782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1590/3198] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 20:59:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:58.996843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:58.999302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:59.089542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:59.089542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:59.137330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baed-9e23-49ef-b785-08ac5c258d54 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:59.148878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:59.149882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.150574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.150983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.163849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:59.167057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7009f-825c-4dba-b3a9-360adbc8e385 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:59.191054 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1609/3199] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 20:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 20:59:59.194671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:59.246747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52b09-6974-423c-8609-08a5dc433322 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:59.269144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:59.270045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.270326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.270602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] PATH_INFO: `/v3/projects/7d99037fd2544f06bdf82a76531e35d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.271976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d99037fd2544f06bdf82a76531e35d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:59.273969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:59.380457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d99037fd2544f06bdf82a76531e35d3', 'request_id': 'req-32d928eb-4222-4a0e-999a-2e675e3ce002'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:59.393852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d99037fd2544f06bdf82a76531e35d3', 'request_id': 'req-32d928eb-4222-4a0e-999a-2e675e3ce002'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:59.416358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d99037fd2544f06bdf82a76531e35d3', 'request_id': 'req-32d928eb-4222-4a0e-999a-2e675e3ce002'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:59.464665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] The token cache is being invalidate because project 7d99037fd2544f06bdf82a76531e35d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:59:59.465067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:59.466360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-32d928eb-4222-4a0e-999a-2e675e3ce002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:59:59.473246 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1591/3200] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:59 2022] DELETE /identity/v3/projects/7d99037fd2544f06bdf82a76531e35d3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:59:59.474946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.475419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.478683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.529172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:59.532962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:59.674153 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1610/3201] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:59.682177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.682739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.683217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.718795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:59:59.721029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:59:59.767548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1592/3202] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:59:59.774061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:59.802636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26061-88a4-42d4-9845-20b40df3d078 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:59.833209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:59.834199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.835065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.837202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.839241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:59:59.839762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:59.842655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:59.882954 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1611/3203] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 20:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:59:59.884287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:59.896602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c035bf7-05ff-4d5d-8448-d7d8109a9b84 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:59:59.911846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:59:59.912641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:59:59.913102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:59:59.913476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:59:59.914277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:59:59.917212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:59:59.961723 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1593/3204] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 20:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:59:59.963019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:59:59.978310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc66e8-e0ba-4cd7-93af-68bfd61b59c9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.075762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.077715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:00.084762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.085165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.085316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.085602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.086315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.088268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.125120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:00.131868 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1612/3205] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 20:59:59 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:00.135757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.159517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98d9ea-c5ea-4c1d-ab97-81efcc6ea209 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.170976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.171700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.171983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.172267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.173043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.174785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.180256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedabaa-5537-4e7a-a86d-cfe864b9a027 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.186252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.187435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.187730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.188727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.191274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:00.200055 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1613/3206] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:00:00.204102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.209086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.210750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.225619 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1594/3207] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:00:00.228666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37eae-be6b-483b-989f-147b1641ec4e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.235987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.236716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.237006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.237361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.238100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.239746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ebf19-b923-45b8-bfc3-7456dc644ba6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.265158 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1614/3208] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:00.269712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.285417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab7673-eca7-4c4e-8c2d-c371bf4936b4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.314987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.317261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.317842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.318268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] PATH_INFO: `/v3/projects/efa91ea7b5594fdb9700999e51c0a3e3/users/d2012ddfbcf1467f94cdd03f70dc8e79/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.319817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.320296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.321381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.360578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] MFA Rules not processed for user `dbd8d82d694941b58fa2d18311ea5785`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:00.363064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:00.372804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa91ea7b5594fdb9700999e51c0a3e3, user_id=d2012ddfbcf1467f94cdd03f70dc8e79, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.376039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc16d0b-400d-46ce-8f5f-c65916dde929 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.405403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1595/3209] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:00 2022] PUT /identity/v3/projects/efa91ea7b5594fdb9700999e51c0a3e3/users/d2012ddfbcf1467f94cdd03f70dc8e79/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:00.416860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.417154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.417431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.452075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] MFA Rules not processed for user `d2012ddfbcf1467f94cdd03f70dc8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:00.454965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:00.468684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:00.470520 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1615/3210] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:00.609702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1596/3211] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:00.615165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.627649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb047-1e0d-4908-9f77-3338b83cd6f7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:00.736610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:00.740192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:00.740853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:00.741847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:00.743755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:00.749729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:00.853154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1616/3212] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:00 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:00.856625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:00.875275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352606bb-6ba4-49c0-8ec4-a2b6eb57b9f8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:01.005111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:01.005863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.008064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.008363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.009298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:01.012243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:01.047795 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1597/3213] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:00 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:01.049119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:01.064056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e47b-137c-4529-b174-034c30b776ab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:01.080733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:01.081471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.081757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.082035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.082782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:01.084454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:01.115557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1617/3214] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:01.116263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:01.131224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b92801-c159-46bb-a1fc-261a0a044b08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:01.137889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:01.139273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.139628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.140015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] PATH_INFO: `/v3/projects/9951e5af52644ec6bc296071f6716cce/users/6729f8099957469f9d8dec848c138208/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.161076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9951e5af52644ec6bc296071f6716cce, user_id=6729f8099957469f9d8dec848c138208, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:01.164077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:01.187292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1598/3215] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:01 2022] PUT /identity/v3/projects/9951e5af52644ec6bc296071f6716cce/users/6729f8099957469f9d8dec848c138208/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:01.188564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:01.201254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc041-5dcd-4db6-a61c-9d205e41b3e8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:01.269470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:01.279980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:01.281175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.281898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.282390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.284695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:01.287261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba50bc2-edb5-4f56-be3b-e03f80307dca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:01.304629 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1618/3216] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:01.308258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:01.322524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059c226-edce-43de-b44d-5a4561afc9e9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:01.331024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:01.333000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.333547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.334086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] PATH_INFO: `/v3/projects/9951e5af52644ec6bc296071f6716cce/users/6729f8099957469f9d8dec848c138208/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.338165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9951e5af52644ec6bc296071f6716cce, user_id=6729f8099957469f9d8dec848c138208, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:01.342098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b716e-a519-42bf-9c85-81bf712ef9cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:01.373509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.374185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.374776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.386075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1599/3217] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:01 2022] PUT /identity/v3/projects/9951e5af52644ec6bc296071f6716cce/users/6729f8099957469f9d8dec848c138208/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:01.418968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] MFA Rules not processed for user `6729f8099957469f9d8dec848c138208`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:01.421132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:01.544007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184622c2-89ca-418b-ace5-fca69cbe592e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:01.544515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184622c2-89ca-418b-ace5-fca69cbe592e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:01.545223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184622c2-89ca-418b-ace5-fca69cbe592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:01.545433 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1619/3218] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:01.585989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-184622c2-89ca-418b-ace5-fca69cbe592e None None] MFA Rules not processed for user `d2012ddfbcf1467f94cdd03f70dc8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:01.592641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-184622c2-89ca-418b-ace5-fca69cbe592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:01.762023 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1600/3219] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:03.385611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:03.389281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:03.567680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782f07b-e0dc-47f5-a318-cd696328545a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:03.585292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:03.587634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:03.589355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:03.589918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:03.609863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:03.614091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:03.636048 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1620/3220] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:06.292947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffe4ff-e8a2-4f9a-aefa-f8e41502f70a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:06.292947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffe4ff-e8a2-4f9a-aefa-f8e41502f70a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:06.293559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffe4ff-e8a2-4f9a-aefa-f8e41502f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:06.299477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:06.353616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-38ffe4ff-e8a2-4f9a-aefa-f8e41502f70a None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:06.354905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-38ffe4ff-e8a2-4f9a-aefa-f8e41502f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:06.553700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1601/3221] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:07.708559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:07.728059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d672a7-9907-4a69-8195-dfb80b43ef44 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:07.743631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:07.744368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:07.744701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:07.747137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:07.770686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:07.774783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d85bb-b717-4c1c-80f3-45369c0dc681 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:07.803912 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1621/3222] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:10.457681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:10.458213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:10.458213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:10.530232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:10.534622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:10.715217 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1602/3223] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:10.728087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894ebe-6e9a-44d2-a055-5d3db01157dc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:10.728672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894ebe-6e9a-44d2-a055-5d3db01157dc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:10.728672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894ebe-6e9a-44d2-a055-5d3db01157dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:10.774980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a894ebe-6e9a-44d2-a055-5d3db01157dc None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:10.776766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a894ebe-6e9a-44d2-a055-5d3db01157dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:10.802903 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1622/3224] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:11.273227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:11.295353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1c1e5-cc44-43ad-8803-4c20bc7da25e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:11.305900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:11.306322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:11.306615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:11.306893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:11.327067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:11.328795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f78595-5512-491f-9772-dba82a8dbbab service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:11.332687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:11.333199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:11.333670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:11.370586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1603/3225] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:11.398421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:11.399581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:11.504113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:11.605905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1623/3226] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:11.617821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755cdb-8c21-4275-8e6d-8fcbfe41dca5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:11.619084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755cdb-8c21-4275-8e6d-8fcbfe41dca5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:11.619880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755cdb-8c21-4275-8e6d-8fcbfe41dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:11.663753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9d755cdb-8c21-4275-8e6d-8fcbfe41dca5 None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:11.665403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9d755cdb-8c21-4275-8e6d-8fcbfe41dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:11.688712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1604/3227] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:14.851738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:14.869764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5fcf-5e8c-45f2-b197-3e767592457c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:14.879169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:14.880320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:14.880883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:14.881415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:14.901971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:14.904137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:14.929770 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1624/3228] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:15.990360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:15.990880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:15.990963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:16.083054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:16.084315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:16.114419 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1605/3229] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:24.916982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=19 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:26.036481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=75 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:26.922695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:26.924463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:27.151690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592856-7d80-4a9f-ba90-0ec5c6a41ec2 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:27.165963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:27.167497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:27.169238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:27.169631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] PATH_INFO: `/v3/users/e9c6e12528ea4760bed65f994df57783` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:27.171773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c6e12528ea4760bed65f994df57783)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:27.177021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:27.254692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c6e12528ea4760bed65f994df57783'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:27.255713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c6e12528ea4760bed65f994df57783'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:27.266861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c6e12528ea4760bed65f994df57783'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:27.280641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c6e12528ea4760bed65f994df57783'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:27.288974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c6e12528ea4760bed65f994df57783'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:27.296535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1625/3230] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:26 2022] DELETE /identity/v3/users/e9c6e12528ea4760bed65f994df57783 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:27.932569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:27.952471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa30c-b5af-4d3a-90fe-2d3725dff7c7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:28.065150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:28.065830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:28.066115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:28.066414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:28.068412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:28.073289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:28.075907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:28.164200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:28.165872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:28.179661 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1606/3231] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:28.188487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69112d24-4a60-4f8b-a7b8-350a1b8a1213 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:28.196452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:28.197403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:28.197625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:28.197905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] PATH_INFO: `/v3/projects/c8850e182ca148cb99d4eb414eb7c08d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:28.199127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8850e182ca148cb99d4eb414eb7c08d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:28.201286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:28.232134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:28.265521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8850e182ca148cb99d4eb414eb7c08d', 'request_id': 'req-9751322b-dd25-418d-816b-78bcffd42d12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.276688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8850e182ca148cb99d4eb414eb7c08d', 'request_id': 'req-9751322b-dd25-418d-816b-78bcffd42d12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.293818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8850e182ca148cb99d4eb414eb7c08d', 'request_id': 'req-9751322b-dd25-418d-816b-78bcffd42d12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.321342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] The token cache is being invalidate because project c8850e182ca148cb99d4eb414eb7c08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:28.321708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.322495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9751322b-dd25-418d-816b-78bcffd42d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.327264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1626/3232] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:28 2022] DELETE /identity/v3/projects/c8850e182ca148cb99d4eb414eb7c08d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:28.328648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:28.343246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a13af-7094-4ff0-91cc-7579dfff8c9c service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:28.432727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:28.433991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:28.434377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:28.434737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] PATH_INFO: `/v3/users/a9f3260e3ee44ff49fdde7cb320e1b89` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:28.436133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f3260e3ee44ff49fdde7cb320e1b89)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:28.438867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:28.491582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:28.507613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f3260e3ee44ff49fdde7cb320e1b89'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.518627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f3260e3ee44ff49fdde7cb320e1b89'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.538677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f3260e3ee44ff49fdde7cb320e1b89'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.539490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f3260e3ee44ff49fdde7cb320e1b89'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.540293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f3260e3ee44ff49fdde7cb320e1b89'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:28.560520 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1607/3233] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:28 2022] DELETE /identity/v3/users/a9f3260e3ee44ff49fdde7cb320e1b89 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:28.822399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b8a3-7a22-46a9-b5b6-f0cfb78781ad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:28.822754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b8a3-7a22-46a9-b5b6-f0cfb78781ad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:28.823132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b8a3-7a22-46a9-b5b6-f0cfb78781ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:28.854887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fe76b8a3-7a22-46a9-b5b6-f0cfb78781ad None None] MFA Rules not processed for user `d2012ddfbcf1467f94cdd03f70dc8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:28.857539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe76b8a3-7a22-46a9-b5b6-f0cfb78781ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:28.914698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:28.916176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:28.969422 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1627/3234] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:29.074267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6bcf5-d68f-49ad-86a7-b90204a5064a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.081473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.084559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.084978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.085342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] PATH_INFO: `/v3/projects/a6d83afa5cc64025a9815a30ea1456a4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.087293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d83afa5cc64025a9815a30ea1456a4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.090344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.167754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d83afa5cc64025a9815a30ea1456a4', 'request_id': 'req-27b91386-f8a8-4ad8-81fd-d0168c812df6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:29.178327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d83afa5cc64025a9815a30ea1456a4', 'request_id': 'req-27b91386-f8a8-4ad8-81fd-d0168c812df6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:29.205351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d83afa5cc64025a9815a30ea1456a4', 'request_id': 'req-27b91386-f8a8-4ad8-81fd-d0168c812df6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:29.232299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] The token cache is being invalidate because project a6d83afa5cc64025a9815a30ea1456a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:29.232628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:29.234877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-27b91386-f8a8-4ad8-81fd-d0168c812df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:29.244661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.246944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.247428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.255040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1608/3235] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:28 2022] DELETE /identity/v3/projects/a6d83afa5cc64025a9815a30ea1456a4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:29.273364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:29.274726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:29.357769 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1628/3236] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:29.365826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.366191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.366647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.389590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:29.391279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:29.399433 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1609/3237] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:29.403451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.419101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594e27-6125-41f7-aa9e-b309cd613275 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.424765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.425505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.425793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.426598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.427352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:29.427711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.434934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.452477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1629/3238] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:29.454126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.465556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034ebe0-4051-478d-b646-1bd1236d15f8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.471396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.472197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.472638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.473044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.473850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.475863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcce5e8-6907-470f-90c8-97ebaeb7ec8b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.506066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1610/3239] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:29.510043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.520501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a29e-c0c3-4e8f-a85a-6d327f2dffb4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.567317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:29.588245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248354a-cc09-413a-b4f7-17e3cfe09d53 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.588667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.588798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248354a-cc09-413a-b4f7-17e3cfe09d53 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.589471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248354a-cc09-413a-b4f7-17e3cfe09d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.590093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.590466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.591115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.592584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.594489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.623209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7248354a-cc09-413a-b4f7-17e3cfe09d53 None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:29.625878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7248354a-cc09-413a-b4f7-17e3cfe09d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:29.626977 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1630/3240] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:29.628392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.651901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff8a1-a828-4e44-a155-a8b7c6553535 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.660877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.661767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.662136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.662517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.663534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.665732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.678463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:29.683299 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1631/3241] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:29.684396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.697201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632727-e3f0-497b-974a-28e9f37122df admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.702957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.704753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.705103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.705437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.706294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.708009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.732876 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1632/3242] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:29.739507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:29.754030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7424668-2afc-4f5d-846d-203d5fff3f2b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:29.766309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:29.767411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.767704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.768094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] PATH_INFO: `/v3/projects/b6874cd662564b6998b67510cd951f1d/users/6ba49adcc6584465b0a6414e54170384/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.787774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6874cd662564b6998b67510cd951f1d, user_id=6ba49adcc6584465b0a6414e54170384, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:29.791017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:29.807496 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1611/3243] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:29.821947 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1633/3244] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:29 2022] PUT /identity/v3/projects/b6874cd662564b6998b67510cd951f1d/users/6ba49adcc6584465b0a6414e54170384/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:29.826150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:29.826445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:29.826737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:29.877186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] MFA Rules not processed for user `6ba49adcc6584465b0a6414e54170384`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:29.881593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:30.003943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1612/3245] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:30.004269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.206636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4cf6a-5055-42ed-9b43-7b9cd41a5b68 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.212856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.213752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.214374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.214601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.215493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.217778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a14e8-493d-4efc-b53f-2b22aafebee5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:30.268391 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1634/3246] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:30 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:30.269378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.286477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.286934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.287231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.290107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb3a73-19c5-4aed-9bf3-9162e5aa729a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.354449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:30.360846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:30.386522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.387714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.388246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.388769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.389802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.392670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:30.438056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1613/3247] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:30 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:30.441943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.464351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4260ac8-305c-4987-9dbb-084b84f539c4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.478808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.481747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.482064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.482345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.483090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.486782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:30.517640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1614/3248] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:30.522736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.547466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635015a-c170-44c7-a8cb-d7f599f049dc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.562639 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1635/3249] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:30.567885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.569003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.569284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.570278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] PATH_INFO: `/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac/users/1544e80c60d0442aa51268f6fbecd610/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.611199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18eb604a43fc4924b6b1ba6f320a2aac, user_id=1544e80c60d0442aa51268f6fbecd610, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.621796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f80ba-33a3-4932-840d-bf1eed20c73a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:30.658220 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1615/3250] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:30 2022] PUT /identity/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac/users/1544e80c60d0442aa51268f6fbecd610/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:30.661069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.681082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351ab0-ad24-43b7-bc8b-429074db58c1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.746432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d4db-e6e8-4ddf-b172-8021ed257f63 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.747049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d4db-e6e8-4ddf-b172-8021ed257f63 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.747469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d4db-e6e8-4ddf-b172-8021ed257f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.750684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:30.755066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:30.788102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af07d4db-e6e8-4ddf-b172-8021ed257f63 None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:30.789672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af07d4db-e6e8-4ddf-b172-8021ed257f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:30.870553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.871731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.872119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.872525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.873457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.878962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:30.904550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1636/3251] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:30.909629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:30.938853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e4aa-b987-454b-8707-6150d5f1d036 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:30.944239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1616/3252] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:30.952965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:30.953906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.954175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.954449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] PATH_INFO: `/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac/users/1544e80c60d0442aa51268f6fbecd610/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.956932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18eb604a43fc4924b6b1ba6f320a2aac, user_id=1544e80c60d0442aa51268f6fbecd610, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:30.976337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557549ec-c5a8-40ad-b3ea-e5561c949679 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:30.977075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557549ec-c5a8-40ad-b3ea-e5561c949679 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:30.977075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557549ec-c5a8-40ad-b3ea-e5561c949679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:30.980217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a9df-7bef-49d8-9727-804d3ea948e8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:31.005904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1637/3253] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:30 2022] PUT /identity/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac/users/1544e80c60d0442aa51268f6fbecd610/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:31.007966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:31.008254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:31.008557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:31.021632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-557549ec-c5a8-40ad-b3ea-e5561c949679 None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:31.023157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-557549ec-c5a8-40ad-b3ea-e5561c949679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:31.042607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] MFA Rules not processed for user `1544e80c60d0442aa51268f6fbecd610`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:31.044056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:31.245808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1617/3254] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:31.253212 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1638/3255] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:31.282179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:31.282632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:31.282740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:31.289884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:31.291399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:31.330861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] MFA Rules not processed for user `7e42634d85d14429b9779efa8bb84f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:31.332472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:31.358177 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1618/3256] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:31.466133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3224-9d11-4f2e-9a02-1fc5e32fb2a2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:31.478950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:31.480584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:31.480986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:31.481397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:31.495315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:31.497316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97fb07-14f4-4e55-94bc-a1a2072f0d74 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:31.511503 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1639/3257] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:32.684556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:32.878822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7425b-038c-481a-b5a0-dced18a4c1da None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:32.896266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:32.897482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:32.898111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:32.898557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] PATH_INFO: `/v3/users/6ba49adcc6584465b0a6414e54170384` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:32.900279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba49adcc6584465b0a6414e54170384)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:32.905980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:33.029971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba49adcc6584465b0a6414e54170384'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:33.032398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:33.046572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba49adcc6584465b0a6414e54170384'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:33.088120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba49adcc6584465b0a6414e54170384'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:33.089490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba49adcc6584465b0a6414e54170384'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:33.090304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba49adcc6584465b0a6414e54170384'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:33.113600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:33.114042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:33.114300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:33.116359 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1619/3258] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:32 2022] DELETE /identity/v3/users/6ba49adcc6584465b0a6414e54170384 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:33.140637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:33.142403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:33.150827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:33.274829 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1640/3259] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:33.338686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:33.340804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:33.467389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c11e4-6120-4d0e-8c11-18e1f19fe042 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:33.478057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:33.478804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:33.479142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:33.479423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:33.502413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:33.503938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:33.532304 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1620/3260] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:34.833893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:34.837071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:34.866084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeddfb-60d5-4983-8dad-862027114c93 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:34.872916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:34.874591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:34.875083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:34.875643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] PATH_INFO: `/v3/projects/b6874cd662564b6998b67510cd951f1d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:34.877677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6874cd662564b6998b67510cd951f1d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:34.880595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:34.952953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6874cd662564b6998b67510cd951f1d', 'request_id': 'req-07d695e9-8c6f-452b-8b76-db948194126e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:34.963142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6874cd662564b6998b67510cd951f1d', 'request_id': 'req-07d695e9-8c6f-452b-8b76-db948194126e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:34.985695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6874cd662564b6998b67510cd951f1d', 'request_id': 'req-07d695e9-8c6f-452b-8b76-db948194126e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.006971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] The token cache is being invalidate because project b6874cd662564b6998b67510cd951f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:35.007433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.008285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.011070 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1641/3261] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:34 2022] DELETE /identity/v3/projects/b6874cd662564b6998b67510cd951f1d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:35.014669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:35.027121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b0a4d-d817-4a4d-a763-c44331e2930b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:35.126123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:35.127556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:35.128310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:35.128841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] PATH_INFO: `/v3/users/1544e80c60d0442aa51268f6fbecd610` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:35.130411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1544e80c60d0442aa51268f6fbecd610)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:35.133305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:35.206593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1544e80c60d0442aa51268f6fbecd610'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.218155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1544e80c60d0442aa51268f6fbecd610'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.234078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:35.235631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1544e80c60d0442aa51268f6fbecd610'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.237035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1544e80c60d0442aa51268f6fbecd610'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.238062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1544e80c60d0442aa51268f6fbecd610'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.259111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1621/3262] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:35 2022] DELETE /identity/v3/users/1544e80c60d0442aa51268f6fbecd610 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:35.472813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:35.474749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:35.529380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d695e9-8c6f-452b-8b76-db948194126e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:35.665656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:35.667660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:35.667959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:35.668237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] PATH_INFO: `/v3/users/da55b52fd3b54e549d9de4b92b76f6ee` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:35.671486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da55b52fd3b54e549d9de4b92b76f6ee)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:35.673884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:35.741332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:35.802467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da55b52fd3b54e549d9de4b92b76f6ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.805063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da55b52fd3b54e549d9de4b92b76f6ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.847576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da55b52fd3b54e549d9de4b92b76f6ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.888378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da55b52fd3b54e549d9de4b92b76f6ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.905376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da55b52fd3b54e549d9de4b92b76f6ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:35.917094 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1642/3263] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:35 2022] DELETE /identity/v3/users/da55b52fd3b54e549d9de4b92b76f6ee => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:36.688030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:36.690197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:36.723790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0f2e-f86a-41c2-86b9-306381636106 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:36.727203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:36.729193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:36.851056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:36.852161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e867-4dd4-4597-9140-aacbf4929e6b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:36.854208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:36.854795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:36.855367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] PATH_INFO: `/v3/projects/ffbad622c26749aebba510fde1cb72c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:36.857565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbad622c26749aebba510fde1cb72c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:36.858403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:36.859314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:36.859601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:36.859884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] PATH_INFO: `/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:36.861126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:36.861229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18eb604a43fc4924b6b1ba6f320a2aac)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:36.863631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:36.928336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18eb604a43fc4924b6b1ba6f320a2aac', 'request_id': 'req-669d7e80-d966-44e2-ad72-c6659a22f53d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:36.941494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18eb604a43fc4924b6b1ba6f320a2aac', 'request_id': 'req-669d7e80-d966-44e2-ad72-c6659a22f53d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:36.952531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18eb604a43fc4924b6b1ba6f320a2aac', 'request_id': 'req-669d7e80-d966-44e2-ad72-c6659a22f53d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:36.969560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] The token cache is being invalidate because project 18eb604a43fc4924b6b1ba6f320a2aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:36.970063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:36.971114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669d7e80-d966-44e2-ad72-c6659a22f53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:36.973118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1643/3264] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:36 2022] DELETE /identity/v3/projects/18eb604a43fc4924b6b1ba6f320a2aac => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:36.981358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023e37-49ea-43ed-9c4b-9e6c6d1b2f77 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:36.982199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023e37-49ea-43ed-9c4b-9e6c6d1b2f77 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:36.983883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023e37-49ea-43ed-9c4b-9e6c6d1b2f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.001479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbad622c26749aebba510fde1cb72c0', 'request_id': 'req-fd5f861b-db6a-4e68-9833-10dcd0f723c7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:37.015847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e9023e37-49ea-43ed-9c4b-9e6c6d1b2f77 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:37.018676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e9023e37-49ea-43ed-9c4b-9e6c6d1b2f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:37.025439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbad622c26749aebba510fde1cb72c0', 'request_id': 'req-fd5f861b-db6a-4e68-9833-10dcd0f723c7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:37.040219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbad622c26749aebba510fde1cb72c0', 'request_id': 'req-fd5f861b-db6a-4e68-9833-10dcd0f723c7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:37.068174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] The token cache is being invalidate because project ffbad622c26749aebba510fde1cb72c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:37.068485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:37.071066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fd5f861b-db6a-4e68-9833-10dcd0f723c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:37.074377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1622/3265] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:36 2022] DELETE /identity/v3/projects/ffbad622c26749aebba510fde1cb72c0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:37.079325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911661cf-6b08-47c1-8e08-26856d0381ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.079622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911661cf-6b08-47c1-8e08-26856d0381ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.079907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911661cf-6b08-47c1-8e08-26856d0381ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.115422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:37.127501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-911661cf-6b08-47c1-8e08-26856d0381ec None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:37.128376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-911661cf-6b08-47c1-8e08-26856d0381ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:37.148216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1644/3266] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:37.150649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1623/3267] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:37.156620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.156916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.158838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.159774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.159774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.160000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.186931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:37.188275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:37.209232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:37.209232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:37.209510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1624/3268] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:37.216581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.244730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1645/3269] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:37.245608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.248916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ee78a-e085-47ac-b7dd-f1977626e94f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.255411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.256516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.256947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.257387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.258190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:37.259007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.260622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.271304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2901301-f6c3-4d01-ab57-df7b5971aebc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.276924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.278365 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1625/3270] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:37.280134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.280585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.281008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.283005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:37.283460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.286311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.297319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.300142 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1646/3271] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:37.306072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.323235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8e231-dd1e-4567-8aee-bb36dd561287 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.329137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5b23-a658-41aa-94de-119144978d92 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.350753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.350753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.350753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.350753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.351254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.351254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.362244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.362934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.363246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.363517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.364259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.371709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.394413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1626/3272] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:37.399352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.436205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1647/3273] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:37.436840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.461638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:37.517217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034dda8-3ad8-4d3c-b32a-f6bc3ba34fd1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.584369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacec51-5bf2-45cd-bbe3-91b20e559e15 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.597590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.598937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.599528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.599957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.602011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.603046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.603427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.603819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.604987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.614263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.615578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.618121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.683483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1627/3274] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:37.688344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.708909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1648/3275] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:37.711618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.736289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a568bc2-1019-47cb-8262-ad24d86d257b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.745001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.745839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.746241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.746616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.748153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.752980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46a9-33b0-49d4-b003-ced50a314e56 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.758746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.759701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.760146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.760496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.761325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.762975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.765197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.778174 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1649/3276] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:37.780960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.791939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1628/3277] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:37.798718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42847a6e-272c-4827-8705-34c63b7a9bba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.802222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.804515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.808665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.808665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.808665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.808665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.808665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.827215 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1650/3278] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:37.833923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007abe-1e17-41e6-b644-c5eae2824286 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.834817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.850127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733b1ab-6870-4a2c-a788-290df1818fff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.857732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.857732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.857732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.857732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.858202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.860019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.871871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.874343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.874789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.875256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] PATH_INFO: `/v3/projects/be089af3908046bcb8edda4db7de5990/users/2e9a6a3df28646bcb379e1af13ce7ffa/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.888988 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1629/3279] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:37.891576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:37.912771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb01df-c129-43cf-9f98-9e0ea9c122ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:37.917319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be089af3908046bcb8edda4db7de5990, user_id=2e9a6a3df28646bcb379e1af13ce7ffa, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.918127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:37.919919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.920324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.920731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] PATH_INFO: `/v3/projects/aafb900b1c204df0901e23985c6106b4/users/809740815755475dbba764e4fd0166ab/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.923352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6db7d-fd00-45ec-807c-47c18b2ab7e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.941038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafb900b1c204df0901e23985c6106b4, user_id=809740815755475dbba764e4fd0166ab, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:37.943764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a6bef-0350-4522-bcb7-7de03bf499d5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:37.973544 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1630/3280] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:37 2022] PUT /identity/v3/projects/aafb900b1c204df0901e23985c6106b4/users/809740815755475dbba764e4fd0166ab/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:37.976461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c98576-3198-49d8-83b1-957227d883be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.976926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c98576-3198-49d8-83b1-957227d883be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.977341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c98576-3198-49d8-83b1-957227d883be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:37.979852 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1651/3281] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:37 2022] PUT /identity/v3/projects/be089af3908046bcb8edda4db7de5990/users/2e9a6a3df28646bcb379e1af13ce7ffa/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:37.990804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:37.991262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:37.991728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:38.032747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-86c98576-3198-49d8-83b1-957227d883be None None] MFA Rules not processed for user `809740815755475dbba764e4fd0166ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:38.034604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86c98576-3198-49d8-83b1-957227d883be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.069924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] MFA Rules not processed for user `2e9a6a3df28646bcb379e1af13ce7ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:38.073523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.113144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1631/3282] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:38.127749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c98576-3198-49d8-83b1-957227d883be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:38.130550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86c98576-3198-49d8-83b1-957227d883be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.165267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:38.165452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:38.253860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c98576-3198-49d8-83b1-957227d883be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:38.257884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:38.258362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:38.258647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:38.258937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:38.279395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:38.280908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6d0de-856c-43e2-8afc-8c2e8c4a3588 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:38.305414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1632/3283] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:38.337453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1652/3284] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:38.458197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:38.458947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:38.459401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:38.483619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:38.490477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.533317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:38.535258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.607213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1633/3285] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:38.633400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:38.637246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:38.663659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ed1e-688e-4a38-a16e-410593a09405 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:38.674534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:38.675232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:38.675516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:38.675848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:38.693702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:38.696561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:38.713328 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1653/3286] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:38.755893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729134a0-79a6-4b98-93e1-0c9e7f5025c1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:38.762327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:38.763011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:38.763496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:38.763999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:38.773913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:38.775543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:38.810971 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1634/3287] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:00:40.354790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:40.362526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:40.480186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a19b1-2b3e-4209-b78a-4696d7b87076 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:40.484901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73057b21-5812-4548-926f-4565d202692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:40.485915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057b21-5812-4548-926f-4565d202692a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:40.486200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057b21-5812-4548-926f-4565d202692a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:40.486530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057b21-5812-4548-926f-4565d202692a admin admin] PATH_INFO: `/v3/users/78f952da089344fcbff6d88ab464e50a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:40.488034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73057b21-5812-4548-926f-4565d202692a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f952da089344fcbff6d88ab464e50a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:40.490026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73057b21-5812-4548-926f-4565d202692a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:40.553443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73057b21-5812-4548-926f-4565d202692a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f952da089344fcbff6d88ab464e50a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:40.554119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73057b21-5812-4548-926f-4565d202692a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f952da089344fcbff6d88ab464e50a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:40.564410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73057b21-5812-4548-926f-4565d202692a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f952da089344fcbff6d88ab464e50a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:40.571264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:40.594363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73057b21-5812-4548-926f-4565d202692a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f952da089344fcbff6d88ab464e50a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:40.606304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73057b21-5812-4548-926f-4565d202692a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f952da089344fcbff6d88ab464e50a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:40.616462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1654/3288] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:40 2022] DELETE /identity/v3/users/78f952da089344fcbff6d88ab464e50a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:40.971112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:40.987376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da479-fbcf-4547-8b11-6587d8b390bc service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.093922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:41.113983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.115511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.115932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.116596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] PATH_INFO: `/v3/projects/9fe2cfca1b434e0ca5e91e22cb9da9e2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.118285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe2cfca1b434e0ca5e91e22cb9da9e2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.120879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.199080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'request_id': 'req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:41.215763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'request_id': 'req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:41.225566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'request_id': 'req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:41.255456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] The token cache is being invalidate because project 9fe2cfca1b434e0ca5e91e22cb9da9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:41.255971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:41.264393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab9ed9b0-ea2d-4bc5-afbd-26b0084137b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:41.266202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1635/3289] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:40 2022] DELETE /identity/v3/projects/9fe2cfca1b434e0ca5e91e22cb9da9e2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:41.271107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.271441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.271685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.304951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:41.306191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:41.451583 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1655/3290] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:41.460475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.461085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.461518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.498903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:41.500689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:41.519903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1636/3291] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:41.524762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.535963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee75cf-5ef4-4188-8a02-8aeb3a398bc9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.552543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.553243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.553528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.553806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.554565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:41.555819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.556969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.586239 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1656/3292] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:41.591007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.600522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa02497-f9c0-40c0-a922-175a3b3b2244 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.622701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.623584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.623871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.624146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.624972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.627750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.701903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1637/3293] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:41 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:41.706622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.718822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2867a2-1488-4281-b737-e8dec079d9bd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.782444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.783162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.783479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.784099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.784895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.787044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.823751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1657/3294] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:41 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:41.828807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.848381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e9cba-0e5f-4e30-84c6-e2abdd18a711 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.855571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.856917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.857407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.857916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.858937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.861104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.877589 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1638/3295] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:41.881477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.912073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d08f-f53f-44a1-ad4e-307e6688eaa1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.920403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.921239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.921600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.921952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:41.922765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:41.925953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0f09-06b6-499f-b294-136e17f47af7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:41.952604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1658/3296] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:41.956268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:41.967046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6121a-d8f4-4853-bf30-af967c0d4055 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:41.978791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:41.979730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:41.980018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:41.980297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] PATH_INFO: `/v3/projects/34a5d7e92e264a74a4be3ad4014a80ff/users/19dae0cdb1d54229ac38a3a9b68f7625/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.019255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a5d7e92e264a74a4be3ad4014a80ff, user_id=19dae0cdb1d54229ac38a3a9b68f7625, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:42.022102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:42.053091 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1639/3297] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:41 2022] PUT /identity/v3/projects/34a5d7e92e264a74a4be3ad4014a80ff/users/19dae0cdb1d54229ac38a3a9b68f7625/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:42.056520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:42.056520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:42.056520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.091375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:42.093146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:42.139647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:42.167507 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1659/3298] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:42.178550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:42.180297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:42.253295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591483a-6cb3-47b8-b243-364a6528c4ff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:42.259959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:42.260723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:42.261067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:42.261834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.277484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:42.279441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7682e-a583-4983-a0de-9dae43b0f5cb service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:42.304937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1640/3299] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:42.309863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:42.311852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:42.331222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdea36-51ea-4ef0-af67-ff4fb6149fdc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:42.342451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:42.343493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:42.348912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:42.349377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] PATH_INFO: `/v3/users/2e9a6a3df28646bcb379e1af13ce7ffa` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.351129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9a6a3df28646bcb379e1af13ce7ffa)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:42.358509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:42.469180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9a6a3df28646bcb379e1af13ce7ffa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:42.470024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9a6a3df28646bcb379e1af13ce7ffa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:42.488840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9a6a3df28646bcb379e1af13ce7ffa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:42.509783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9a6a3df28646bcb379e1af13ce7ffa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:42.520702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9a6a3df28646bcb379e1af13ce7ffa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:42.533148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1660/3300] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:42 2022] DELETE /identity/v3/users/2e9a6a3df28646bcb379e1af13ce7ffa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:42.537621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:42.538014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:42.538214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.574858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:42.577503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:42.607507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:42.718027 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1641/3301] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:42.758882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:42.761136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:42.933250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76e359-3329-41b2-b99c-a1b25e84779a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:42.937118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:42.937766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:42.938057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:42.938341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:42.968980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:42.970464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb814e4f-5717-4657-b100-ac9e778b3137 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:42.992244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1661/3302] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:44.191987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.196346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:44.226120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1530447-9c36-41a3-9e32-2f68cfaf3381 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.234125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.235447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.236179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.236800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] PATH_INFO: `/v3/projects/be089af3908046bcb8edda4db7de5990` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.238706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be089af3908046bcb8edda4db7de5990)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.241592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:44.321011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be089af3908046bcb8edda4db7de5990', 'request_id': 'req-d252caa9-4684-447d-9de2-0e55c797bd21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:44.335521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be089af3908046bcb8edda4db7de5990', 'request_id': 'req-d252caa9-4684-447d-9de2-0e55c797bd21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:44.345039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be089af3908046bcb8edda4db7de5990', 'request_id': 'req-d252caa9-4684-447d-9de2-0e55c797bd21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:44.375571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] The token cache is being invalidate because project be089af3908046bcb8edda4db7de5990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:44.376041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:44.377062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d252caa9-4684-447d-9de2-0e55c797bd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:44.379202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1642/3303] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:44 2022] DELETE /identity/v3/projects/be089af3908046bcb8edda4db7de5990 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:44.384394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.384947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.384947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.416412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:44.417673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:44.506246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:44.533526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.534273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.534568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.539526 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1662/3304] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:44.558835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:44.560176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:44.576801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.584462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1643/3305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:44.590368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279c9f8-d1e7-4977-8f2f-d779ccbb032e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.602663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.604848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.605136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.605414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.608325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:44.609479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.614608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:44.653305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.664615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1663/3306] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:44.669876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c2e41-543e-4fd4-8667-982e52cf0a2b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.676265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.676971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.677894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.677894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.678258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.680546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:44.737153 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1644/3307] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:44 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:44.742252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.759332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396905f-c760-4977-a150-114bfe578c79 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.830633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.831828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.832712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.833105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.833974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.836039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:44.867804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1664/3308] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:44 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:44.883721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.909914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572c52-50e6-4e30-83b2-457701526ddd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.916173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.917126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.917522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.917910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.918782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.920759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:44.950216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1645/3309] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:44.951721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:44.972906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75b698-6061-4921-9f11-36a51bffbca5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:44.992289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:44.993055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:44.993339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:44.993613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:44.994364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:44.997121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f2e7b-254e-4d5e-8b0a-c5d7d6ca3ef4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:45.020729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1665/3310] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:45.025759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:45.065315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0cf35-05de-4439-984a-6080c37d73c2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:45.088179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:45.094643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:45.096491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:45.099739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] PATH_INFO: `/v3/projects/24229e7471a5460390be1ff110c3135a/users/db5eee4a92a04af99fd16cbbdfe15e6a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:45.148662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24229e7471a5460390be1ff110c3135a, user_id=db5eee4a92a04af99fd16cbbdfe15e6a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:45.157182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:45.197075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1646/3311] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:45 2022] PUT /identity/v3/projects/24229e7471a5460390be1ff110c3135a/users/db5eee4a92a04af99fd16cbbdfe15e6a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:45.200763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87575-0b43-4e02-b487-b76268edafb5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:45.201049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87575-0b43-4e02-b487-b76268edafb5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:45.201330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87575-0b43-4e02-b487-b76268edafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:45.302281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a8c87575-0b43-4e02-b487-b76268edafb5 None None] MFA Rules not processed for user `db5eee4a92a04af99fd16cbbdfe15e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:45.312553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a8c87575-0b43-4e02-b487-b76268edafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:45.489935 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1666/3312] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:45.699538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:45.705689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:45.795324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:45.886416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c725192-84b5-4514-8210-5ba78d694915 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:45.902772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:45.903460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:45.903744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:45.904025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:45.925630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:45.927439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ead5d-d959-4429-824a-1c0e42ed57fe service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:45.946370 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1647/3313] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:46.129594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:46.129885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:46.130336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:46.195802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:46.197096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:46.320317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:46.332898 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1667/3314] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:46.834319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:46.835112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:46.835552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:46.853554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:46.889638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:46.890915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.001692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f331a3-61bb-41e6-bbf5-2f07d97b50de None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:47.007957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:47.009371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.010018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.010520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] PATH_INFO: `/v3/users/db5eee4a92a04af99fd16cbbdfe15e6a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:47.012089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5eee4a92a04af99fd16cbbdfe15e6a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:47.014353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:47.029077 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1648/3315] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:47.045431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:47.047079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.096266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5eee4a92a04af99fd16cbbdfe15e6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.097054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5eee4a92a04af99fd16cbbdfe15e6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.117356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5eee4a92a04af99fd16cbbdfe15e6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.134604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5eee4a92a04af99fd16cbbdfe15e6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.145433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de33508e-97ca-4546-8a31-2e7e89e0f321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5eee4a92a04af99fd16cbbdfe15e6a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.154046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1668/3316] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:46 2022] DELETE /identity/v3/users/db5eee4a92a04af99fd16cbbdfe15e6a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:47.158634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.159220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.159681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:47.194193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:47.198191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.227194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2483f-b77a-42ca-a191-4476d49fb19f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:47.334624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1669/3317] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:47.356110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:47.357396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.357969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.358403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:47.360808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.384173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:47.398248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:47.400776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.509432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:47.523178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:47.528408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:47.552691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1649/3318] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:00:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:00:47.597869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba955-b424-4163-a8fa-8d5bc3514ab0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:47.602978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:47.604596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.604962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.605351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:47.628214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:47.630234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181e44f-8663-4a9a-a2a2-d6372e2bea99 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:47.643273 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1670/3319] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:47.766028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:47.767682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:47.784970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd0d0-4938-4d5a-856c-1b8a6ccbe9a6 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:47.791730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:47.792697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.793133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.793599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] PATH_INFO: `/v3/users/809740815755475dbba764e4fd0166ab` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:47.795636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809740815755475dbba764e4fd0166ab)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:47.798267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:47.884383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809740815755475dbba764e4fd0166ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.897675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809740815755475dbba764e4fd0166ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.916974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809740815755475dbba764e4fd0166ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.917723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809740815755475dbba764e4fd0166ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.918611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809740815755475dbba764e4fd0166ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:47.958427 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1650/3320] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:47 2022] DELETE /identity/v3/users/809740815755475dbba764e4fd0166ab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:47.960089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:47.960619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:47.963879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:48.000750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:48.002852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:48.217922 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1671/3321] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:48.249659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:48.251206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:48.387618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329201ea-64a8-425b-a7f5-b81ae45c49c9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:48.399159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:48.399845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:48.400340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:48.400862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:48.420613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:48.422259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243287a-056d-4742-a0c0-4b56a2271319 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:48.441753 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1651/3322] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:49.125839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.127773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.142765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91075-d25d-4149-8810-e5cb8f353675 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:49.150919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:49.152008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.153037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.153366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] PATH_INFO: `/v3/projects/24229e7471a5460390be1ff110c3135a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.155223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24229e7471a5460390be1ff110c3135a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:49.157682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:49.240018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24229e7471a5460390be1ff110c3135a', 'request_id': 'req-75d43389-0c71-40a9-9432-28c1115e90f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.269975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24229e7471a5460390be1ff110c3135a', 'request_id': 'req-75d43389-0c71-40a9-9432-28c1115e90f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.285645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24229e7471a5460390be1ff110c3135a', 'request_id': 'req-75d43389-0c71-40a9-9432-28c1115e90f6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.309897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] The token cache is being invalidate because project 24229e7471a5460390be1ff110c3135a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:49.310470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.311369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75d43389-0c71-40a9-9432-28c1115e90f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.313778 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1672/3323] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:49 2022] DELETE /identity/v3/projects/24229e7471a5460390be1ff110c3135a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:49.318595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.319533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.320114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.351339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:49.355534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.401928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:49.483926 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1652/3324] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:49.492098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.492261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.492636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.516981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:49.518623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.535927 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1673/3325] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:49.536791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.547170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa144-63f2-4cd9-bc72-778cfa1593b9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:49.554254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:49.555467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.555955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.556467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.557419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:49.557932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:49.560712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:49.587162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1653/3326] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:00:49.592187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.619424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f43bc0-11f6-4c2d-9769-732f4735c052 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:49.628637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:49.629412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.629671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.629953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.630666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:49.633556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:49.655009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.657077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.687196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919751-99bb-4fa0-a57e-c211dd3d494b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:49.695764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:49.696728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.697052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.697276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] PATH_INFO: `/v3/users/7e42634d85d14429b9779efa8bb84f8f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.700214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e42634d85d14429b9779efa8bb84f8f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:49.702934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:49.708509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1674/3327] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:49 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:49.716231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.751863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:49.824411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e42634d85d14429b9779efa8bb84f8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.842932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e42634d85d14429b9779efa8bb84f8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.865733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f699ea-71eb-4f6f-997b-e6bd35c7d5c4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:49.872912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e42634d85d14429b9779efa8bb84f8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.874667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e42634d85d14429b9779efa8bb84f8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.875575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e42634d85d14429b9779efa8bb84f8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:49.878886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:49.880550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:49.880839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:49.881119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:49.883980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:49.889289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:49.891734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1654/3328] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:49 2022] DELETE /identity/v3/users/7e42634d85d14429b9779efa8bb84f8f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:49.924542 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1675/3329] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:49 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:49.928764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.931276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.953536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:49.955356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:49.990102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8ad3-a7b1-4b87-a938-36bfec4913a0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.041731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194c2e0-0712-471b-aee6-955a4e63b73a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.055362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.056611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.058707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.059202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.060965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.064073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.094684 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1655/3330] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:50.097446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.098606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.099646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.099986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.100387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] PATH_INFO: `/v3/projects/aafb900b1c204df0901e23985c6106b4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.102343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafb900b1c204df0901e23985c6106b4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.105109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.118253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a477c-ba78-4663-832c-acf9046b2577 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.131511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.132347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.132877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.133256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.134086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.135950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.174674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1656/3331] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:50.175867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.188762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f700c79-8cd8-4e45-8c16-5e131e6b1dbd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.194640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.196222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.196691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.197118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] PATH_INFO: `/v3/projects/aa04ed2c6ea14438b506a2b7f4e3f377/users/5a80f9c350664a839bdada41c1973b1e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.201616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:50.221919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa04ed2c6ea14438b506a2b7f4e3f377, user_id=5a80f9c350664a839bdada41c1973b1e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.225829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.258191 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1657/3332] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:50 2022] PUT /identity/v3/projects/aa04ed2c6ea14438b506a2b7f4e3f377/users/5a80f9c350664a839bdada41c1973b1e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:50.265311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafb900b1c204df0901e23985c6106b4', 'request_id': 'req-9211a9f7-e99b-49a9-9420-74532aff4d38'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.296166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafb900b1c204df0901e23985c6106b4', 'request_id': 'req-9211a9f7-e99b-49a9-9420-74532aff4d38'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.318543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafb900b1c204df0901e23985c6106b4', 'request_id': 'req-9211a9f7-e99b-49a9-9420-74532aff4d38'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.332261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.336138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.354143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] The token cache is being invalidate because project aafb900b1c204df0901e23985c6106b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:50.354908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.356364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9211a9f7-e99b-49a9-9420-74532aff4d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.359897 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1676/3333] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:49 2022] DELETE /identity/v3/projects/aafb900b1c204df0901e23985c6106b4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:50.364044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5f-d3b7-4d3a-ae2b-41b5f3de70d4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.366374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5f-d3b7-4d3a-ae2b-41b5f3de70d4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.366947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2114c5f-d3b7-4d3a-ae2b-41b5f3de70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.421931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c764-f0f8-497f-80aa-2a6953b9a85f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.429127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.430834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.431517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.431962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] PATH_INFO: `/v3/projects/27b6256b931e4f67bd0795961bb29b4e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.434282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b6256b931e4f67bd0795961bb29b4e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.436925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.443091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d2114c5f-d3b7-4d3a-ae2b-41b5f3de70d4 None None] MFA Rules not processed for user `5a80f9c350664a839bdada41c1973b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.457735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d2114c5f-d3b7-4d3a-ae2b-41b5f3de70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.536396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:50.546219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b6256b931e4f67bd0795961bb29b4e', 'request_id': 'req-66c847cf-86ff-4e22-8b66-72bd15cca1cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.557834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b6256b931e4f67bd0795961bb29b4e', 'request_id': 'req-66c847cf-86ff-4e22-8b66-72bd15cca1cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.566899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b6256b931e4f67bd0795961bb29b4e', 'request_id': 'req-66c847cf-86ff-4e22-8b66-72bd15cca1cc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.592192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] The token cache is being invalidate because project 27b6256b931e4f67bd0795961bb29b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:50.592790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.594869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c847cf-86ff-4e22-8b66-72bd15cca1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:50.603857 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1658/3334] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:50 2022] DELETE /identity/v3/projects/27b6256b931e4f67bd0795961bb29b4e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:50.603857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3502-6800-4ce5-a024-0b013c887a2e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.603857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3502-6800-4ce5-a024-0b013c887a2e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.603857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3502-6800-4ce5-a024-0b013c887a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.625604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4bbf3502-6800-4ce5-a024-0b013c887a2e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.628560 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1677/3335] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.628728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bbf3502-6800-4ce5-a024-0b013c887a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.628812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ea528-4827-4ed1-9dc7-833080a107f7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.628812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ea528-4827-4ed1-9dc7-833080a107f7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.628812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ea528-4827-4ed1-9dc7-833080a107f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.656556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b39ea528-4827-4ed1-9dc7-833080a107f7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.657929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b39ea528-4827-4ed1-9dc7-833080a107f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.732619 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1659/3336] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.732619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.732619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.732619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.751175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] MFA Rules not processed for user `5a80f9c350664a839bdada41c1973b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.752707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.765780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:50.782858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1678/3337] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.785889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4053d7f-dae1-424e-90b6-5ec04edf85e5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.786216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4053d7f-dae1-424e-90b6-5ec04edf85e5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.786496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4053d7f-dae1-424e-90b6-5ec04edf85e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.819176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d4053d7f-dae1-424e-90b6-5ec04edf85e5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.821053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d4053d7f-dae1-424e-90b6-5ec04edf85e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.836221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1679/3338] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.837919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.839006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.839665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.865291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:50.866991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.870030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1660/3339] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.871218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.888786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1680/3340] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:50.892856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.897760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:50.899351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731b3f-14d0-4d00-9bda-6530b7441c91 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.909394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.910216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.910594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.910970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.911789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:50.912162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.914011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.930213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1661/3341] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:50.935419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:50.950906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf736d4-73b1-407d-8f04-36ca26d8393a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:50.958767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:50.959592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:50.959941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:50.960279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:50.961107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:50.961526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:50.963234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:50.986146 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1662/3342] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:50.987133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.015158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5894e-5d34-49ed-8025-c771ebbb3973 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.021323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.022147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.022500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.022848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.023716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.025899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.064290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1663/3343] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:50 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:51.064290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.069656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13fb8f-f70f-4283-a462-68d7c6687685 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.143116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:51.167856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.168856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.169618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.170046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.205475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f373a0-4271-4342-adff-0cd76e2ada33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.211356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.212340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.212821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.213206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.214009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.216867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.286845 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1664/3344] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:51 2022] POST /identity/v3/projects => generated 391 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:51.287466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.304134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.305970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.333388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1681/3345] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:51.336195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.367417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df268-dac2-43eb-ac5c-55f64188c1b4 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.409281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:51.416783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767c2d5-bf7d-4a83-a07c-1cb7e946f90e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.440508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.444412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.452901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.453454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.454510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.457386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.476855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.477752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.478487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.479018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.480395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.483304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.511994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1665/3346] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:51 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:51.513183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.529351 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1682/3347] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:51 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:51.533681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.552862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480d54-c2a5-41b9-8a89-9a79be797e9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.554918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264804f1-07b2-47b0-a22b-2d48bdb6f9ad admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.570032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.570645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.571522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.571855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.572230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.573318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.573812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.574266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.575044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.575708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.577100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.582051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.590457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1683/3348] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:00:51.594964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.601293 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1666/3349] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:51.605751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.621248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf111-78df-44ff-9ef6-98e2e460b5cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.622180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ef4ab-3a00-4d29-b661-32a4d87289a0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.628219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.629302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.629823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.630304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.631524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.634038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.650521 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1667/3350] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:00:51.655215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.655846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.655998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.656560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.656958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.657747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.662092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.670752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5b1e-93c0-413e-9cfb-c7d902604c0a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.678325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.679329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.679870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.680222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] PATH_INFO: `/v3/projects/a62d0abb0b1a4ca8bf61e722ba81b292/users/e1950869fde34fc8b378526e790a77e7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.690467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1684/3351] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:51.692019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:51.702004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62d0abb0b1a4ca8bf61e722ba81b292, user_id=e1950869fde34fc8b378526e790a77e7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.703575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16160-2537-4273-acdb-9c142beef9a1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:51.706286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206f03f-e76e-42c0-98df-887a956f6750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.710724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:51.712002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.712550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.713004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] PATH_INFO: `/v3/projects/b3349ed72f824bcb9d1ce52d238bc870/users/a6a15dadfd0448fab9e84a89173ed7d1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.740562 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1668/3352] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:51 2022] PUT /identity/v3/projects/a62d0abb0b1a4ca8bf61e722ba81b292/users/e1950869fde34fc8b378526e790a77e7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:51.751116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.751867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3349ed72f824bcb9d1ce52d238bc870, user_id=a6a15dadfd0448fab9e84a89173ed7d1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:51.752216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.753303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.754881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d2b9-05c3-4418-8481-80b87345d719 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:51.783450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1685/3353] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:51 2022] PUT /identity/v3/projects/b3349ed72f824bcb9d1ce52d238bc870/users/a6a15dadfd0448fab9e84a89173ed7d1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:51.786766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:51.787061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:51.787336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:51.814077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:51.815495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:51.853314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] MFA Rules not processed for user `e1950869fde34fc8b378526e790a77e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:51.854841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:51.902477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:51.997667 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1669/3354] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:52.016586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1686/3355] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:52.044653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:52.047448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:52.174008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e90ecc-488c-4d05-ba20-14a481f5e02e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:52.186203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:52.189042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:52.189482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:52.190992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:52.208200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:52.210314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:52.227853 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1670/3356] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:52.249190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:52.377022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de88aa1-7782-412c-9fbb-d1cfc7b78995 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:52.384334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:52.385281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:52.385709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:52.386246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:52.397254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:52.399322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:52.412728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1687/3357] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:54.150059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:54.152179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:54.193535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f3717-a664-4b08-9436-c28449f5bea0 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:54.224374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:54.227056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:54.227343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:54.227634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] PATH_INFO: `/v3/users/dbd8d82d694941b58fa2d18311ea5785` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:54.244841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd8d82d694941b58fa2d18311ea5785)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:54.253208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:54.335368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:54.362349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd8d82d694941b58fa2d18311ea5785'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:54.374202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd8d82d694941b58fa2d18311ea5785'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:54.398412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd8d82d694941b58fa2d18311ea5785'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:54.399525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd8d82d694941b58fa2d18311ea5785'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:54.400852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5c4ba6b7-9148-4ebd-a263-87c7490997d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd8d82d694941b58fa2d18311ea5785'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:54.421930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1671/3358] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:54 2022] DELETE /identity/v3/users/dbd8d82d694941b58fa2d18311ea5785 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:54.901637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:54.917692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cbdc-76d7-4d6e-9eae-4cfc7153631b service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.042941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.044415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.045277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.045698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] PATH_INFO: `/v3/projects/ca77764a1f5e436db2f6436a02b2fc24` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.047689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca77764a1f5e436db2f6436a02b2fc24)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.052312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:55.118906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca77764a1f5e436db2f6436a02b2fc24', 'request_id': 'req-3bf62f9d-3add-442d-827a-e2d522cde759'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:55.130798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca77764a1f5e436db2f6436a02b2fc24', 'request_id': 'req-3bf62f9d-3add-442d-827a-e2d522cde759'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:55.137754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:55.139975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca77764a1f5e436db2f6436a02b2fc24', 'request_id': 'req-3bf62f9d-3add-442d-827a-e2d522cde759'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:55.163633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] The token cache is being invalidate because project ca77764a1f5e436db2f6436a02b2fc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:55.163945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:55.165160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bf62f9d-3add-442d-827a-e2d522cde759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:55.171799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1688/3359] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:54 2022] DELETE /identity/v3/projects/ca77764a1f5e436db2f6436a02b2fc24 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:55.173729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.174656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.175195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.198118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:55.199470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:55.346841 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1672/3360] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:00:55.356494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.357068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.357525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.404924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:55.406206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:55.419893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1689/3361] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:55.424318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:55.440946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeca94b-5124-44c9-abd2-b8f0fd736cda None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.450873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.451882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.452271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.452757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.454069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:55.454491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.458185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:55.482626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:55.484828 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1673/3362] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:55.494964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cad2b-11c0-4e48-9840-82d89bb71b6f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.502395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.506256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.507079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.507466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.508263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.512852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:55.575257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1690/3363] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:55 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:55.576865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:55.593296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49920dc-00af-4fa0-b66d-73af836e17a2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.784616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.791047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.791362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.792901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.796942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.802198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:55.856802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1674/3364] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:55 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:00:55.859373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:55.886515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa62b-49bb-48da-96cf-3ddb9dfa4c2f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.905927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.908047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.909634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.910601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.914317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.927459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:55.960283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1691/3365] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:55.960960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:55.978050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248c705-de39-4ce6-a405-edeec5d1a8fb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:55.993004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:55.993713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:55.993997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:55.994331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:55.995077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:55.996767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f59374-6f4c-4475-8bb8-2958fb31db7f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:56.020504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1675/3366] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:56.036220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:56.072386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd028925-a72c-4d28-b4c0-e35081b39eac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:56.102521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:56.103076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:56.103362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:56.107470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] PATH_INFO: `/v3/projects/13f32fd4885a4850996d1208dc1bcbba/users/18b8e3ac2c484ae49e678ef734b52e99/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:56.161650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f32fd4885a4850996d1208dc1bcbba, user_id=18b8e3ac2c484ae49e678ef734b52e99, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:56.165835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:56.199894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1692/3367] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:56 2022] PUT /identity/v3/projects/13f32fd4885a4850996d1208dc1bcbba/users/18b8e3ac2c484ae49e678ef734b52e99/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:56.205084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:56.205934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:56.206223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:56.240783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:56.242856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:56.252835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:56.365715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1676/3368] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:56.413272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:56.415314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:56.507752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fa73-f8a4-409f-8502-ea34816a3717 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:56.513008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:56.513687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:56.513972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:56.516337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:56.530130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:56.531525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ce1fa-e6b5-411d-84d9-f1ccfb9c475f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:56.537125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:56.538619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:56.575018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85f58-be4d-4aae-87a1-333982c9fc50 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:56.580638 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1693/3369] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:56.586333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:56.587403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:56.587691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:56.587971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] PATH_INFO: `/v3/users/e1950869fde34fc8b378526e790a77e7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:56.593311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1950869fde34fc8b378526e790a77e7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:56.595507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:56.702703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1950869fde34fc8b378526e790a77e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:56.725675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1950869fde34fc8b378526e790a77e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:56.750587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1950869fde34fc8b378526e790a77e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:56.751801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1950869fde34fc8b378526e790a77e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:56.752740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1950869fde34fc8b378526e790a77e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:56.789606 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1677/3370] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:00:56 2022] DELETE /identity/v3/users/e1950869fde34fc8b378526e790a77e7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:00:56.796667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:56.797247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:56.797745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:56.859249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:56.860947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:56.985370 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1694/3371] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:57.014881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:57.018885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:57.189517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c20c4-73a1-43c2-a06c-015fe80e66ff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:57.203097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:57.203809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:57.204096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:57.204380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:57.239758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:57.241643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e6030-eecf-4a45-924f-c2fcdbec78a9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:57.263459 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1678/3372] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:58.405960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:58.407622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:58.434372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a77e2c-0a67-49ae-9ab6-4ce5d1127ca4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:58.440005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:58.441342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:58.441853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:58.442543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] PATH_INFO: `/v3/projects/a62d0abb0b1a4ca8bf61e722ba81b292` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:58.445078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62d0abb0b1a4ca8bf61e722ba81b292)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:58.448691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:58.493735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:58.526624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62d0abb0b1a4ca8bf61e722ba81b292', 'request_id': 'req-c0eac00f-c690-44af-bcf5-938dd23aface'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:58.535499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62d0abb0b1a4ca8bf61e722ba81b292', 'request_id': 'req-c0eac00f-c690-44af-bcf5-938dd23aface'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:58.541582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62d0abb0b1a4ca8bf61e722ba81b292', 'request_id': 'req-c0eac00f-c690-44af-bcf5-938dd23aface'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:58.553514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] The token cache is being invalidate because project a62d0abb0b1a4ca8bf61e722ba81b292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:00:58.553932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:58.555052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c0eac00f-c690-44af-bcf5-938dd23aface admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:00:58.556333 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1695/3373] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:58 2022] DELETE /identity/v3/projects/a62d0abb0b1a4ca8bf61e722ba81b292 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:58.561698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:58.562162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:58.562254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:58.590541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:58.593829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:58.621895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:58.691581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1679/3374] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:58.693416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:58.693710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:58.693989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:58.715758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:58.717195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:58.729272 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1696/3375] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:58.730500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:58.742142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c68b-11c6-4838-ba23-e8c4dd24a932 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:58.747167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:58.748548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:58.749084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:58.749368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:58.750133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:00:58.750443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:58.752246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:58.770958 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1680/3376] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:00:58.775594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:58.786842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b596-e164-4bf2-82d2-751c7ba2cc4e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:58.791823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:58.792606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:58.792907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:58.793218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:58.794008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:58.796474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:58.861934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1697/3377] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:00:58 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:58.862170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:58.873929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a869-14f8-4c95-83c4-bfc9ce7b3548 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:59.008414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:59.009527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.010167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.010616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.011489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:59.014161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:59.049491 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1681/3378] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:00:58 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:00:59.053280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:59.066040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4678-325f-4683-a393-930d98f65472 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:59.078894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:59.080545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.081449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.082281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.086056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:59.087814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:59.121952 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1698/3379] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:59.123070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:59.140335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dbda-2d26-4bf3-9662-3e8e49a58dbe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:59.165387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:59.166231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.166492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.166871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.167551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:59.180799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ffa4c-e157-4e98-b005-98ccd60778b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:59.216793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1682/3380] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:00:59.218214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:59.234201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce3368-9beb-4572-8e23-ddaa9e04238f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:59.244764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:59.246065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.246542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.246958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] PATH_INFO: `/v3/projects/7f998f8bc87c4e009254746816812231/users/f9abc0f22f944a95a70b23e50bafdccb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.296118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f998f8bc87c4e009254746816812231, user_id=f9abc0f22f944a95a70b23e50bafdccb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:59.300129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:59.336188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1699/3381] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:00:59 2022] PUT /identity/v3/projects/7f998f8bc87c4e009254746816812231/users/f9abc0f22f944a95a70b23e50bafdccb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:00:59.340457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb876-8db8-47a4-8c54-8e4e8bee6057 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.340762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb876-8db8-47a4-8c54-8e4e8bee6057 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.341038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923eb876-8db8-47a4-8c54-8e4e8bee6057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.363737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-923eb876-8db8-47a4-8c54-8e4e8bee6057 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:00:59.365465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-923eb876-8db8-47a4-8c54-8e4e8bee6057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:59.453814 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1683/3382] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:00:59.489011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:00:59.490944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:00:59.562313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65900f72-8431-4140-b973-42ba7d309260 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:00:59.566444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:00:59.567269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:00:59.567719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:00:59.568169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:00:59.578655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:00:59.580385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab90758-815e-48fe-8ef1-7f363e5eb0d5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:00:59.596911 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1700/3383] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:00.800133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:00.800133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:00.800133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:00.855524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] MFA Rules not processed for user `19dae0cdb1d54229ac38a3a9b68f7625`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:00.856966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:00.909789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:01.015384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1684/3384] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:01.026131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:01.027283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:01.027706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:01.054998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] MFA Rules not processed for user `19dae0cdb1d54229ac38a3a9b68f7625`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:01.056708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:01.068766 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1701/3385] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:01.077214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:01.079181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:01.203901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca6036-579b-45b9-a055-7c60227b2297 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:01.213620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:01.214809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:01.215096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:01.215372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:01.226630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:01.228668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dba11e-6aa9-44e0-b372-5807f0f9f47b service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:01.240112 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1685/3386] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:04.432468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:04.434651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:04.478802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626d282-796e-450d-bbcc-862b9bcaf402 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:04.497066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:04.499818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:04.500114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:04.500396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] PATH_INFO: `/v3/users/d2012ddfbcf1467f94cdd03f70dc8e79` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:04.513705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2012ddfbcf1467f94cdd03f70dc8e79)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:04.516080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:04.621617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:04.637456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2012ddfbcf1467f94cdd03f70dc8e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:04.638697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2012ddfbcf1467f94cdd03f70dc8e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:04.656012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2012ddfbcf1467f94cdd03f70dc8e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:04.695221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2012ddfbcf1467f94cdd03f70dc8e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:04.717818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2012ddfbcf1467f94cdd03f70dc8e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:04.735909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:04.736823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:04.737310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:04.739604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1702/3387] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:01:04 2022] DELETE /identity/v3/users/d2012ddfbcf1467f94cdd03f70dc8e79 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:04.775672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:04.779024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:04.978725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1686/3388] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:04.995198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:04.996983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:05.110800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635394-3e11-4c7e-9b43-26e709ddaf47 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:05.115831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:05.116766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:05.116980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:05.117264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:05.131031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:05.132864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:05.156909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1703/3389] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:05.942630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:05.944127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:05.971610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52cfc5-f8d7-4aaa-9738-ba38ba5dc15e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:05.978365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:05.979324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:05.979611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:05.979954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] PATH_INFO: `/v3/projects/efa91ea7b5594fdb9700999e51c0a3e3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:05.984089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa91ea7b5594fdb9700999e51c0a3e3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:05.986760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:06.074240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:06.083257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa91ea7b5594fdb9700999e51c0a3e3', 'request_id': 'req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.097543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa91ea7b5594fdb9700999e51c0a3e3', 'request_id': 'req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.106268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa91ea7b5594fdb9700999e51c0a3e3', 'request_id': 'req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.132667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] The token cache is being invalidate because project efa91ea7b5594fdb9700999e51c0a3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:01:06.132964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.136943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.140791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1687/3390] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:05 2022] DELETE /identity/v3/projects/efa91ea7b5594fdb9700999e51c0a3e3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:06.145096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:06.161096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc6af-660a-49c1-986e-6323a84642c4 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:06.309654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:06.310719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:06.311111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:06.311768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] PATH_INFO: `/v3/users/6729f8099957469f9d8dec848c138208` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:06.313800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6729f8099957469f9d8dec848c138208)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:06.316765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:06.489167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6729f8099957469f9d8dec848c138208'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.491193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6729f8099957469f9d8dec848c138208'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.532285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6729f8099957469f9d8dec848c138208'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.570247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:06.623886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6729f8099957469f9d8dec848c138208'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.656331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98048265-2025-4425-b877-dee0c226f0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6729f8099957469f9d8dec848c138208'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:06.688369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1704/3391] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:01:06 2022] DELETE /identity/v3/users/6729f8099957469f9d8dec848c138208 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:07.201469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:07.203828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:07.230062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd993f-c047-4c82-82c6-25f2f6e49cfa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:07.372012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:07.372941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:07.373568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:07.374117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] PATH_INFO: `/v3/projects/9951e5af52644ec6bc296071f6716cce` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:07.376643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9951e5af52644ec6bc296071f6716cce)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:07.379224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:07.454075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9951e5af52644ec6bc296071f6716cce', 'request_id': 'req-b12e0e6f-7e8b-469e-b000-69d23de17045'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:07.465002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9951e5af52644ec6bc296071f6716cce', 'request_id': 'req-b12e0e6f-7e8b-469e-b000-69d23de17045'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:07.479629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9951e5af52644ec6bc296071f6716cce', 'request_id': 'req-b12e0e6f-7e8b-469e-b000-69d23de17045'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:07.507968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] The token cache is being invalidate because project 9951e5af52644ec6bc296071f6716cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:01:07.508595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:07.510322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b12e0e6f-7e8b-469e-b000-69d23de17045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:07.513050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1688/3392] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:07 2022] DELETE /identity/v3/projects/9951e5af52644ec6bc296071f6716cce => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:07.519227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:07.519695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:07.519917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:07.570325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:07.574069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:07.746426 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1705/3393] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:07.747766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:07.748183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:07.748558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:07.798292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:07.800328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:07.834460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:07.848042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1689/3394] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:07.852787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5b8b-c87e-4e7a-9ad1-53e258b3cb04 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:07.869338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:07.870191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:07.870571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:07.871006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:07.871877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:01:07.872278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:07.874146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:07.915894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:07.923768 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1706/3395] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:01:07.929830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade4639-34c3-44d4-86cd-21596e7ac928 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:07.934854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:07.936075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:07.936813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:07.937418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:07.938207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:07.941225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.007511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:08.016405 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1690/3396] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:01:07 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:08.020373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8232-204f-4094-9291-403e961441d7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:08.163846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:08.165039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.165463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.165876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.167383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:08.170511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.214719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:08.231158 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1707/3397] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:01:08 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:08.239040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232814b-9f80-4a0d-b5a5-76f94ed94a0a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:08.245668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:08.249239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.249707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.250154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.251188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:08.256791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.285243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:08.293462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1691/3398] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:01:08.302231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa7b1c-a1f3-4fa1-93bb-f9a67d33abf1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:08.340922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:08.342200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.342200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.342200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.353497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:08.355715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e96d0-f278-4392-a8cf-19a8b91bf5a9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.383796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:08.398024 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1708/3399] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:01:08.398354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd45a-7fe6-479c-a16e-fe8fa2a05e79 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:08.405149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:08.406062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.406343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.407187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] PATH_INFO: `/v3/projects/b5e11266f1884df8b0f27ebc2f4133d8/users/5d3257db63ed4bf0861abc735c1e83ee/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.443628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e11266f1884df8b0f27ebc2f4133d8, user_id=5d3257db63ed4bf0861abc735c1e83ee, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:08.447420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.463700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:08.479909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1692/3400] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:01:08 2022] PUT /identity/v3/projects/b5e11266f1884df8b0f27ebc2f4133d8/users/5d3257db63ed4bf0861abc735c1e83ee/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:01:08.490711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ca6d-1b18-4fbd-9c09-00483cdb7390 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.495279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ca6d-1b18-4fbd-9c09-00483cdb7390 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.498165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ca6d-1b18-4fbd-9c09-00483cdb7390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.559538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-41a6ca6d-1b18-4fbd-9c09-00483cdb7390 None None] MFA Rules not processed for user `5d3257db63ed4bf0861abc735c1e83ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:08.561599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41a6ca6d-1b18-4fbd-9c09-00483cdb7390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:08.608928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:08.685437 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1709/3401] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:08.689933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:08.881034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08c89d-de34-4b86-a524-ced0b397aa81 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:08.895499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:08.896204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.896525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.896806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.897504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:08.899442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:08.963200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8b53-89a8-429b-b5b5-eb53acf5206f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:08.963572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8b53-89a8-429b-b5b5-eb53acf5206f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:08.963882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e8b53-89a8-429b-b5b5-eb53acf5206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:08.968379 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1693/3402] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:01:08 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:08.972886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.005795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5d8e8b53-89a8-429b-b5b5-eb53acf5206f None None] MFA Rules not processed for user `18b8e3ac2c484ae49e678ef734b52e99`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:09.007076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d8e8b53-89a8-429b-b5b5-eb53acf5206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:09.123824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b74f-8fb7-4cc4-b396-fe3c34ee1b40 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.144390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.145116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.145399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.145675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.146585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.148347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.165372 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1710/3403] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:09.167348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.167884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.168270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.198800 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1694/3404] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:01:08 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:09.199701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.209362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] MFA Rules not processed for user `18b8e3ac2c484ae49e678ef734b52e99`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:09.210769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:09.232580 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1711/3405] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:09.249183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dacd-1caf-4b98-b35a-a536b6a28a85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.252848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.254629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:09.262255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.263492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.263822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.264091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.264869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.271595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.294303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1695/3406] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:01:09.295349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.319918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7bfe1-2d1e-471b-9226-1c5f16ac2caa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.332691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.333829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.334151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.334472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] PATH_INFO: `/v3/projects/4e758e68d8094b8bb4d528182ef10a3a/users/f6e3d3212ab942feb30bae5b2fd9885d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.375540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e758e68d8094b8bb4d528182ef10a3a, user_id=f6e3d3212ab942feb30bae5b2fd9885d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.378502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.411893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1696/3407] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:01:09 2022] PUT /identity/v3/projects/4e758e68d8094b8bb4d528182ef10a3a/users/f6e3d3212ab942feb30bae5b2fd9885d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:09.412929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.473514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4311-d34c-4d3b-a7f9-877bde293b90 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.505110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:09.556263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06fd6-8b59-4f0b-8046-b31fbc461e85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.566377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:09.582327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.583452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.584152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.584355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.591086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.593106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.593632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.594955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.595578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.596135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.606829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1697/3408] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:01:09.611630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:09.634230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e2d2e-62f6-4cd6-ac17-0970d5073df5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:09.657154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:09.662571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.665551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.667411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] PATH_INFO: `/v3/projects/4e758e68d8094b8bb4d528182ef10a3a/users/f6e3d3212ab942feb30bae5b2fd9885d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.677996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e758e68d8094b8bb4d528182ef10a3a, user_id=f6e3d3212ab942feb30bae5b2fd9885d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.689422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4bec5-7e49-4300-908f-b6776b07482c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.729642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1698/3409] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:01:09 2022] PUT /identity/v3/projects/4e758e68d8094b8bb4d528182ef10a3a/users/f6e3d3212ab942feb30bae5b2fd9885d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:01:09.741605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:09.742176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:09.742605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:09.761255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:09.764905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0422c91-256b-4c06-861c-5a9929f0ea3b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:09.782736 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1712/3410] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:09.831983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] MFA Rules not processed for user `f6e3d3212ab942feb30bae5b2fd9885d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:09.833296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:10.092451 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1699/3411] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:01:10.103328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f907-b36a-48bd-9ef8-0cc7efa18d9e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:10.103618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f907-b36a-48bd-9ef8-0cc7efa18d9e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:10.103898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f907-b36a-48bd-9ef8-0cc7efa18d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:10.142542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2913f907-b36a-48bd-9ef8-0cc7efa18d9e None None] MFA Rules not processed for user `5d3257db63ed4bf0861abc735c1e83ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:10.144123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2913f907-b36a-48bd-9ef8-0cc7efa18d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:10.229349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1713/3412] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:10.241082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:10.242564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:10.336044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da576-02ed-49e8-b7aa-e55ae98f6d03 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:10.342873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:10.343565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:10.343850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:10.344127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:10.354494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:10.357523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ccfb2-65eb-42b2-a507-08e03d9a7de1 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:10.367883 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1700/3413] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:12.174415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:12.174854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:12.175170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:12.277233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] MFA Rules not processed for user `a6a15dadfd0448fab9e84a89173ed7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:12.284785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:12.597652 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1714/3414] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:12.611646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674ecd-812c-47b1-ae8b-34d58a5e19a3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:12.612755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674ecd-812c-47b1-ae8b-34d58a5e19a3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:12.613256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95674ecd-812c-47b1-ae8b-34d58a5e19a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:12.664516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-95674ecd-812c-47b1-ae8b-34d58a5e19a3 None None] MFA Rules not processed for user `a6a15dadfd0448fab9e84a89173ed7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:12.680805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-95674ecd-812c-47b1-ae8b-34d58a5e19a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:12.727819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1701/3415] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:12.911580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:12.944146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd7285-c396-4ac0-84bf-2922ac1f7c19 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:12.974860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:12.975546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:12.975824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:12.976095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:13.030080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:13.039097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210cf28-826a-4aa2-8d0c-3d22d20613bd service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:13.103720 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1715/3416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:01:15.796782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:15.797310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:15.797310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:15.858550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] MFA Rules not processed for user `a6a15dadfd0448fab9e84a89173ed7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:15.860121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:15.903963 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1702/3417] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:01:17.290554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9492e8-ce03-401d-813e-7b4eded31c5d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:17.291067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9492e8-ce03-401d-813e-7b4eded31c5d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:17.291171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9492e8-ce03-401d-813e-7b4eded31c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:17.344303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:17.352726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bd9492e8-ce03-401d-813e-7b4eded31c5d None None] MFA Rules not processed for user `f9abc0f22f944a95a70b23e50bafdccb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:17.354005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd9492e8-ce03-401d-813e-7b4eded31c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:17.544372 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1716/3418] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:19.469838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:19.499320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b325b-e9dc-401c-aaf7-1f93e4b7bbe8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:19.509584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:19.510279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:19.510562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:19.510842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:19.541627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:19.543482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af34eab-e1f4-469c-871d-832e1f397f8c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:19.574965 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1703/3419] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:21.025307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dbdbb-a8ac-4551-86b1-9717e1d89679 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:21.027798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dbdbb-a8ac-4551-86b1-9717e1d89679 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:21.028534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dbdbb-a8ac-4551-86b1-9717e1d89679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:21.102836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8f5dbdbb-a8ac-4551-86b1-9717e1d89679 None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:21.104215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f5dbdbb-a8ac-4551-86b1-9717e1d89679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:21.284810 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1717/3420] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:24.637215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:24.637770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:24.637770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:24.639428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1704/3421] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:01:24.652019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1704-383d-4e3b-a96b-eb9c9dfa7996 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:24.652855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1704-383d-4e3b-a96b-eb9c9dfa7996 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:24.653357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1704-383d-4e3b-a96b-eb9c9dfa7996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:24.689156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e46e1704-383d-4e3b-a96b-eb9c9dfa7996 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:24.693177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e46e1704-383d-4e3b-a96b-eb9c9dfa7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:24.908624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1718/3422] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:24.956405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:24.961280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:24.984377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:25.004659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dded77-a9b9-4438-a91d-295ba4aa3410 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:25.017099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:25.017946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:25.019392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:25.019775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:25.051048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:25.053551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a689517-ac3f-450f-b926-962fb2cd6598 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:25.094837 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1705/3423] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:25.724662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a02-c9cd-4f10-85e8-ec7bac4c8833 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:25.725168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a02-c9cd-4f10-85e8-ec7bac4c8833 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:25.725249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a02-c9cd-4f10-85e8-ec7bac4c8833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:25.746597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-73e96a02-c9cd-4f10-85e8-ec7bac4c8833 None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:25.747622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73e96a02-c9cd-4f10-85e8-ec7bac4c8833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:25.771389 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1719/3424] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:26.572415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:26.572915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:26.573011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:26.601531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] MFA Rules not processed for user `f9abc0f22f944a95a70b23e50bafdccb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:26.603363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:26.618504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1706/3425] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:30.583867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:30.584501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:30.584501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:30.605282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:30.606625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:30.666748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:30.703812 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1720/3426] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:30.717172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:30.719840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:30.860509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c52882-fd19-40ff-a2c7-1fcfc36fa86f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:30.867466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:30.868150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:30.868470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:30.868741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:30.879639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:30.881569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba42ed-b602-4f6c-91ce-2c5c757e89fa service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:30.893846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1707/3427] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:01:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:40.493761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:40.510184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947380b0-5ba3-4619-8053-9a0009af33a8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:40.517665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:40.518634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:40.519121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:40.519594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:40.536945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:40.542719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bae7d-dad3-4e18-8d58-d57d951106d6 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:40.587621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1721/3428] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:40.888741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=39 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:41.718438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:41.718729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:41.719216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:41.721471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1708/3429] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:01:41.739321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:41.741651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:41.742497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:41.782974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:41.784772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:41.786729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:41.788753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:41.800068 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1722/3430] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:41.868963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:41.871315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:41.920362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85cd1d-d8db-4cd9-a286-9ba9efbbdcc9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:41.924133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946458-5e98-43c5-8d76-5221352f8c96 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:41.931700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:41.932891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:41.933346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:41.933762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] PATH_INFO: `/v3/users/19dae0cdb1d54229ac38a3a9b68f7625` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:41.936373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dae0cdb1d54229ac38a3a9b68f7625)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:41.939121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:41.964017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:41.967320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:41.972881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:41.976511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:42.003489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:42.005266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb412ec-91be-4a0d-a4d2-3d702f1bbea6 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:42.028275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1723/3431] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:42.040490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dae0cdb1d54229ac38a3a9b68f7625'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:42.060487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dae0cdb1d54229ac38a3a9b68f7625'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:42.078139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dae0cdb1d54229ac38a3a9b68f7625'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:42.079064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dae0cdb1d54229ac38a3a9b68f7625'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:42.079750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-63443227-c590-487d-9eeb-c0d01b6d2571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dae0cdb1d54229ac38a3a9b68f7625'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:42.097291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1709/3432] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:01:41 2022] DELETE /identity/v3/users/19dae0cdb1d54229ac38a3a9b68f7625 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:42.888055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:42.888569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:42.888699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:42.894756 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1724/3433] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:01:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:01:42.901554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:42.902536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:42.902974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:42.927037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:42.928560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.050538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1710/3434] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:43.094224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:43.096762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.131949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328cfd-45e4-445d-b076-51bd5388afcb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:43.138877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:43.141571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.142357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.143269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.176721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:43.177008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:43.178866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210274b-faee-47ea-93f2-d09b56d9733d service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:43.179042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.193963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1725/3435] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:43.218356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:43.329028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c6ff2-9e21-4212-95e2-2fe4fd5f8244 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:43.335799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:43.337374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.337663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.338299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] PATH_INFO: `/v3/projects/34a5d7e92e264a74a4be3ad4014a80ff` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.340185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a5d7e92e264a74a4be3ad4014a80ff)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:43.366877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:43.480309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a5d7e92e264a74a4be3ad4014a80ff', 'request_id': 'req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:43.495933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a5d7e92e264a74a4be3ad4014a80ff', 'request_id': 'req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:43.531767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a5d7e92e264a74a4be3ad4014a80ff', 'request_id': 'req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:43.560936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf09f5-7756-4f9a-b626-429b241699db None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.561218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf09f5-7756-4f9a-b626-429b241699db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.561682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf09f5-7756-4f9a-b626-429b241699db None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.563362 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1726/3436] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:01:43.564327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] The token cache is being invalidate because project 34a5d7e92e264a74a4be3ad4014a80ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:01:43.565936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:43.571011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cc9d1e-c92e-4421-9cba-7029d4f58c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:43.575171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1711/3437] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:43 2022] DELETE /identity/v3/projects/34a5d7e92e264a74a4be3ad4014a80ff => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:43.576646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2012f-d0da-4953-bbfd-44fe65ece4a9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.577145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2012f-d0da-4953-bbfd-44fe65ece4a9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.577616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2012f-d0da-4953-bbfd-44fe65ece4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.580400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.583344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.583727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.625223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2ef2012f-d0da-4953-bbfd-44fe65ece4a9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:43.626773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ef2012f-d0da-4953-bbfd-44fe65ece4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.626883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:43.628629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.773467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1712/3438] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:43.801749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:43.823407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.854461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1727/3439] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:01:43.856016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.856311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.856623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.892727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:43.911484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117334fe-cfab-4c9f-9574-d8abdd1895be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:43.918685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:43.920096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.920390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.920731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.924417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:43.927851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:43.941379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:43.943641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:43.958432 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1713/3440] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:01:43.962035 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1728/3441] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:43.967074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:43.980538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021271-82d7-45ba-b2e1-14e52d5a0bfd service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:43.986786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:43.987361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:43.987644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:43.987921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:43.988910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:01:43.989079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:43.991552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.014508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.020535 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1714/3442] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:01:44.024690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2c71-c8b1-4ab2-b998-332a67b394ec None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:44.039818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:44.040717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.041006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.041286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.042206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:44.047325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.189497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.205342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1729/3443] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:01:44 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:44.295176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dd3-bb0a-4080-8a15-4039e882bff4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:44.376307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:44.377048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.377441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.377722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.378420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:44.380569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.422589 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1715/3444] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:01:44 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:01:44.423446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.534631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b524c0e-c60b-458c-b2bb-0597b6294979 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:44.545233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:44.546439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.546722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.547168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.548267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:44.550089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.566741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1730/3445] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:01:44.571478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.587413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82282d-5d16-463d-824a-2635773781d8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:44.605805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:44.605805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.605805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.605805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.606229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:44.606229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c645d-d783-4edd-bd76-229a9fb48654 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.629832 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1716/3446] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:01:44.634280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.643398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:44.650543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84dcd-a66e-43f0-9d0b-7501a71c18d7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:44.663315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:44.664325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.664715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.665066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] PATH_INFO: `/v3/projects/58851e54cb214793b2e9ab09d0b3dac6/users/22302e87c7c141829fe04c06684650a5/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.701966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58851e54cb214793b2e9ab09d0b3dac6, user_id=22302e87c7c141829fe04c06684650a5, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:44.707292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:44.749588 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1731/3447] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:01:44 2022] PUT /identity/v3/projects/58851e54cb214793b2e9ab09d0b3dac6/users/22302e87c7c141829fe04c06684650a5/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:44.751348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:44.751776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:44.752152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:44.782176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:44.787134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:44.929973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1717/3448] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:44.942959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:44.949463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:45.155584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9e1e-a77b-4826-8692-7af17eb05727 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:45.168893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:45.169667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:45.170131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:45.171661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:45.200890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:45.202425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:45.227563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1732/3449] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:46.952321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:46.959308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:47.094709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76988-b406-4ebc-ae04-c5bad8d90f6d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:47.114020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:47.115034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:47.115624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:47.117768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:47.126168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:47.322276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:47.324047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:47.351225 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1718/3450] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:49.838386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:49.843988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:49.870579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f92c5d-169f-4f7e-a781-958536c70d60 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:49.880963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:49.881866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:49.882147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:49.882421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] PATH_INFO: `/v3/users/18b8e3ac2c484ae49e678ef734b52e99` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:49.883695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b8e3ac2c484ae49e678ef734b52e99)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:49.886014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:50.027233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b8e3ac2c484ae49e678ef734b52e99'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:50.027963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b8e3ac2c484ae49e678ef734b52e99'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:50.046450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b8e3ac2c484ae49e678ef734b52e99'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:50.095320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b8e3ac2c484ae49e678ef734b52e99'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:50.115809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b8e3ac2c484ae49e678ef734b52e99'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:50.145171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1733/3451] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:01:49 2022] DELETE /identity/v3/users/18b8e3ac2c484ae49e678ef734b52e99 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:50.254459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:50.265977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f5fc-24db-4c95-9dd6-556e806a8218 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:50.368518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:50.369937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:50.370216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:50.371404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:50.376036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:50.508101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:50.509705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147747d8-65dd-4c43-b49c-b71938b45d58 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:50.572118 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1719/3452] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:50.994182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:50.996820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:51.191210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:51.200029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bff953-3c2a-49bf-8423-2d92f568c8bb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:51.210891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:51.212579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.213007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.213363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] PATH_INFO: `/v3/projects/13f32fd4885a4850996d1208dc1bcbba` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.216781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f32fd4885a4850996d1208dc1bcbba)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:51.219301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:51.309848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc857a-eb4b-499d-ba43-e0d9ae56cc2c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.311416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc857a-eb4b-499d-ba43-e0d9ae56cc2c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.312015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc857a-eb4b-499d-ba43-e0d9ae56cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.329490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f32fd4885a4850996d1208dc1bcbba', 'request_id': 'req-f2915472-6828-491e-a637-d3790a34b30d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:51.342639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fdfc857a-eb4b-499d-ba43-e0d9ae56cc2c None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:51.344832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fdfc857a-eb4b-499d-ba43-e0d9ae56cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:51.352111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f32fd4885a4850996d1208dc1bcbba', 'request_id': 'req-f2915472-6828-491e-a637-d3790a34b30d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:51.353587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:51.362308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f32fd4885a4850996d1208dc1bcbba', 'request_id': 'req-f2915472-6828-491e-a637-d3790a34b30d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:51.388266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] The token cache is being invalidate because project 13f32fd4885a4850996d1208dc1bcbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:01:51.388597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:51.389293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2915472-6828-491e-a637-d3790a34b30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:01:51.396468 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1734/3453] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:50 2022] DELETE /identity/v3/projects/13f32fd4885a4850996d1208dc1bcbba => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:51.398286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.398881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.399043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.463080 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1720/3454] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:51.534015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:51.535681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:51.687415 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1735/3455] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:51.687602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.687602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.687793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.724977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:51.726601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:51.746336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:51.768098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1721/3456] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:51.770098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b33be-a133-44cb-ac67-dfebebe69019 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:51.777060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:51.777763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.778051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.778333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.779657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:01:51.779657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:51.784310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:51.797936 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1736/3457] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:01:51.800565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:51.833214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da3524-f54a-4577-bea0-7b9e41033852 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:51.840381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:51.841601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:51.841887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:51.842165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:51.842869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:51.845346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:51.920885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:51.921371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1722/3458] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:01:51 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:51.934291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fab77-faad-4d13-854b-6784ed64bc49 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:52.000156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:52.023346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:52.024325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.024790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.025224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.026140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:52.028276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:52.062341 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1737/3459] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:01:51 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:01:52.065092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:52.078116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bdcf1-8f8b-4213-8fb9-513c18f46bef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:52.088790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:52.090541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.091027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.091504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.092624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:52.099055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:52.119452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1723/3460] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:01:52.123829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:52.139516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597ef0-4cc3-4726-8384-46c8de719f7a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:52.155031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:52.156458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.156993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.157674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.158613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:52.169800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b5c68-191f-415f-8d3d-0f51bd04e143 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:52.201746 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1738/3461] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:01:52.205804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:52.221330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a883-c2b9-464d-ab20-0eba7d9bd21e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:52.232626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:52.233890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.234365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.234622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] PATH_INFO: `/v3/projects/663694278b344fe7896f524fac12ffcc/users/1253f8908e434038b07f5e2ed7d15d30/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.274725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=663694278b344fe7896f524fac12ffcc, user_id=1253f8908e434038b07f5e2ed7d15d30, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:52.276820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:52.302869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1724/3462] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:01:52 2022] PUT /identity/v3/projects/663694278b344fe7896f524fac12ffcc/users/1253f8908e434038b07f5e2ed7d15d30/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:01:52.307872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acc7b-a880-4c9a-937c-c411b7c8aeea None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.308200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acc7b-a880-4c9a-937c-c411b7c8aeea None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.308512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acc7b-a880-4c9a-937c-c411b7c8aeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.339182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b62acc7b-a880-4c9a-937c-c411b7c8aeea None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:52.341385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b62acc7b-a880-4c9a-937c-c411b7c8aeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:52.421352 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1739/3463] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:01:52.445106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:52.447703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:52.610869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44493-d144-4fde-a089-85361e6a3f5a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:52.615110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:52.616306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:52.616777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:52.617244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:52.629692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:52.632241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce252d-456c-4953-9ef5-b82fb2b85789 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:52.645430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1725/3464] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:55.583707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:55.584120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:55.584120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:55.643948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] MFA Rules not processed for user `22302e87c7c141829fe04c06684650a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:55.646266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:55.796185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1740/3465] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:55.798505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a920bb-4e8a-4946-9c73-0356eb153f58 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:55.799009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a920bb-4e8a-4946-9c73-0356eb153f58 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:55.799009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a920bb-4e8a-4946-9c73-0356eb153f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:55.832815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36a920bb-4e8a-4946-9c73-0356eb153f58 None None] MFA Rules not processed for user `22302e87c7c141829fe04c06684650a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:55.834135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36a920bb-4e8a-4946-9c73-0356eb153f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:55.847915 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1726/3466] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:01:56.060858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:56.062300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:56.171545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:56.238035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb008c94-2af4-4646-8a28-0dc4bc4c1c88 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:56.253614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:56.256577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:56.256957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:56.257239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:56.279864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:56.282065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:56.311360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1741/3467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:56.420572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:56.420872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:56.421138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:56.447146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:01:56.448371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:56.518304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:56.565590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1727/3468] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:01:56.566062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:56.567570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:56.749876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e3ca-4934-41f0-9e2a-c1da202f7f4b service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:56.767052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:56.768204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:56.768676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:56.769364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:56.803705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:56.805891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:56.829879 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1742/3469] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:01:57.628959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:57.633495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:57.801700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d77a-aca7-43f8-9284-65d002caa5ab None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:57.820477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:57.821543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:57.821976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:57.822594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:57.828272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:57.861835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:57.863562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:57.882414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1728/3470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:01:58.327458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:58.370469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e9b2c-77e1-4b40-9a10-a92060791fc4 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:58.392038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:58.392738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:58.393023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:58.393297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:58.401574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:58.419478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:58.423755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0371538-87b9-4a75-a811-ac79c3cc6abf service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:58.448234 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1743/3471] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:01.859595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:01.873044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893852-7d29-4d9f-8a47-1db4d9896207 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:01.877293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:01.878254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:01.878662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:01.879075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:01.891282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:01.903294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:01.904800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:01.914471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1729/3472] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:03.607683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b636-aa32-46ff-9b0d-d47eb4ef4045 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:03.608260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b636-aa32-46ff-9b0d-d47eb4ef4045 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:03.608260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b636-aa32-46ff-9b0d-d47eb4ef4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:03.644466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8913b636-aa32-46ff-9b0d-d47eb4ef4045 None None] MFA Rules not processed for user `1253f8908e434038b07f5e2ed7d15d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:03.645824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8913b636-aa32-46ff-9b0d-d47eb4ef4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:03.766822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1744/3473] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:03.773672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:03.799092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbfa00-0f00-47a6-850d-6ad8b35d39b1 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:03.809093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:03.810140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:03.810690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:03.811190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:03.827696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:03.831900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb59f5-b244-42b1-a7cc-2f14f8483cae service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:03.852270 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1730/3474] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:04.259840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:04.260325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:04.260809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:04.295717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] MFA Rules not processed for user `1253f8908e434038b07f5e2ed7d15d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:04.297083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:04.315253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1745/3475] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:13.434006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296c81-75f0-4820-b2a2-eff5fb3fce15 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:13.434855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296c81-75f0-4820-b2a2-eff5fb3fce15 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:13.435200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296c81-75f0-4820-b2a2-eff5fb3fce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:13.466363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-58296c81-75f0-4820-b2a2-eff5fb3fce15 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:13.468023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-58296c81-75f0-4820-b2a2-eff5fb3fce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:13.484728 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1731/3476] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:13.505145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:13.521190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d87f3d-4a47-4dce-8503-2e8e2369ce42 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:13.526685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:13.527540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:13.527884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:13.528262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:13.540715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:13.542894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:13.552896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1746/3477] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:14.106192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7199c-23bb-400f-a4a6-527c1ebe6450 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:14.106718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7199c-23bb-400f-a4a6-527c1ebe6450 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:14.107129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7199c-23bb-400f-a4a6-527c1ebe6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:14.145442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8cd7199c-23bb-400f-a4a6-527c1ebe6450 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:14.148175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8cd7199c-23bb-400f-a4a6-527c1ebe6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:14.160262 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1732/3478] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:14.185986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:14.206272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec816a9-e74d-49ae-9c64-9fab07ac2f61 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:14.221336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:14.229541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:14.229826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:14.230109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:14.252872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:14.254914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:14.278531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1747/3479] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:15.609733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adccc7-8368-41d2-bd9b-da5bcb3329a4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:15.610613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adccc7-8368-41d2-bd9b-da5bcb3329a4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:15.611541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adccc7-8368-41d2-bd9b-da5bcb3329a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:15.633922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e9adccc7-8368-41d2-bd9b-da5bcb3329a4 None None] MFA Rules not processed for user `5d3257db63ed4bf0861abc735c1e83ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:15.635952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e9adccc7-8368-41d2-bd9b-da5bcb3329a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:15.776299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1733/3480] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:24.267496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:25.211294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:25.247614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95667bc-687c-416c-9415-d1ce270d9cbe service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:25.258151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:25.258736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:25.259694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:25.260133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:25.262429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:25.314022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:25.315651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:25.329700 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1748/3481] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:02:25.753274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:25.997193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:25.997500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:25.997817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:26.021641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:26.023062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:26.032140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1734/3482] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:26.047591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:26.061960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409438-8127-4f66-9d9a-c5586644e1de service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:26.067490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:26.068148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:26.068584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:26.068884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:26.081456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:26.083471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:26.093958 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1749/3483] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:28.693689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:28.710827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f4a49-78ca-49d2-82b7-6dab58cff2cf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:28.720695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:28.721351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:28.721631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:28.721906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:28.724122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:28.742113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:28.745044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:28.761668 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1735/3484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:30.729854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:30.731769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:30.758746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee95de7-e68c-414a-9a34-5d5bb38e51c9 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:30.773896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:30.774875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:30.775348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:30.775776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:30.780218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:30.811078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:30.812774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252851c-86a9-4432-980f-fc81377aebda service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:30.835022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1750/3485] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:33.066995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:33.069207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:33.086620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0cdb9-60a7-41c3-b83c-3a321adde648 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:33.092673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:33.093685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:33.093968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:33.094272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] PATH_INFO: `/v3/users/5a80f9c350664a839bdada41c1973b1e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:33.095616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a80f9c350664a839bdada41c1973b1e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:33.098140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:33.160151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a80f9c350664a839bdada41c1973b1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:33.169151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a80f9c350664a839bdada41c1973b1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:33.184962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a80f9c350664a839bdada41c1973b1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:33.185733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a80f9c350664a839bdada41c1973b1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:33.186378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a80f9c350664a839bdada41c1973b1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:33.201727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1736/3486] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:02:33 2022] DELETE /identity/v3/users/5a80f9c350664a839bdada41c1973b1e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:02:33.207272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:33.207797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:33.208016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:33.227641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:33.229534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:33.305409 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1751/3487] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:33.338405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:33.341169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:33.471745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206345-b528-4f38-bcbc-e206859afbd8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:33.477725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:33.478645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:33.478998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:33.479369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:33.491311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:33.493089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d679e-86ad-4901-a535-dca80090b671 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:33.506213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1737/3488] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:33.888486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:33.894871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:33.925726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e485-ca01-4a2a-9dd5-6c5933698394 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:33.935311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:33.936702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:33.937178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:33.938261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] PATH_INFO: `/v3/projects/aa04ed2c6ea14438b506a2b7f4e3f377` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:33.939962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa04ed2c6ea14438b506a2b7f4e3f377)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:33.943226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.050266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'request_id': 'req-75906daf-9caa-48b3-98e6-0caa9a38f06f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:34.061147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'request_id': 'req-75906daf-9caa-48b3-98e6-0caa9a38f06f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:34.073703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'request_id': 'req-75906daf-9caa-48b3-98e6-0caa9a38f06f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:34.092268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] The token cache is being invalidate because project aa04ed2c6ea14438b506a2b7f4e3f377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:02:34.092603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:34.095328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75906daf-9caa-48b3-98e6-0caa9a38f06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:34.105092 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1752/3489] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:33 2022] DELETE /identity/v3/projects/aa04ed2c6ea14438b506a2b7f4e3f377 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:02:34.106677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.107157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.116100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.169276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:34.170667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:34.232062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:34.270464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1738/3490] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:34.279448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.279989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.279989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.299823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:34.301096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:34.309911 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1753/3491] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:34.315031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.326261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1754-bbbe-4ea5-807a-813bda340a18 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.332043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.332911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.333289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.333658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.334478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:02:34.334873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.336900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.351286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1739/3492] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:02:34.356061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.366941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4773b-bfa6-4ad2-94f0-f808533e60d7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.371932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.372637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.372926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.373198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.374079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.376294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.391365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:34.413467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1754/3493] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:02:34 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:02:34.414722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.428247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e0b4-3859-4214-be94-5880f8a6e37d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.505347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.506504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.507023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.507155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.507988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.510337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.540788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1740/3494] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:02:34 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:02:34.545445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.566701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27d926-85d5-4e0c-8e94-c355ebedabbe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.574029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.574832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.575187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.575525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.576541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.578588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.594663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1755/3495] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:02:34.598090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.610188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb2406-5ec2-4dad-9aeb-11c1b0cd42af admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.616387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.616975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.617329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.617676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.618484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.620889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153c5fc-a5ac-4917-8627-5f440c499e01 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.636469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1741/3496] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:02:34.638695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.652261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5149a10-b2eb-48a8-b758-6f8cba0f99ba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.658979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.660405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.660975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.661288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] PATH_INFO: `/v3/projects/c08f52307dc24b5bacaea02af2fe64da/users/e6fb1f340fc243f4ae0f4f11f90c1f5d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.685291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08f52307dc24b5bacaea02af2fe64da, user_id=e6fb1f340fc243f4ae0f4f11f90c1f5d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.688411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.706154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1756/3497] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:02:34 2022] PUT /identity/v3/projects/c08f52307dc24b5bacaea02af2fe64da/users/e6fb1f340fc243f4ae0f4f11f90c1f5d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:02:34.719158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cce7-b459-4e27-bc6f-b0de127a10d9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.719524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cce7-b459-4e27-bc6f-b0de127a10d9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.719777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cce7-b459-4e27-bc6f-b0de127a10d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.756162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-05f8cce7-b459-4e27-bc6f-b0de127a10d9 None None] MFA Rules not processed for user `e6fb1f340fc243f4ae0f4f11f90c1f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:34.757381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-05f8cce7-b459-4e27-bc6f-b0de127a10d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:34.856810 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1742/3498] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:34.873340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:34.875238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:34.951251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819ee39-4f84-4579-9dd6-71b8d81df9b7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:34.956736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:34.958011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:34.958315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:34.958605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:34.970704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:34.972181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7016db-27c1-4787-bf4a-b972fccd9988 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:34.985637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1757/3499] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:36.069065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0bc5-2133-457f-a152-a73934934989 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:36.069517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0bc5-2133-457f-a152-a73934934989 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:36.069645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0bc5-2133-457f-a152-a73934934989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:36.090153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-587f0bc5-2133-457f-a152-a73934934989 None None] MFA Rules not processed for user `1253f8908e434038b07f5e2ed7d15d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:36.091818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-587f0bc5-2133-457f-a152-a73934934989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:36.133186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54941-3dfa-45bd-8d8d-0234bdc6866f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:36.134244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54941-3dfa-45bd-8d8d-0234bdc6866f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:36.134749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db54941-3dfa-45bd-8d8d-0234bdc6866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:36.151574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:36.161929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9db54941-3dfa-45bd-8d8d-0234bdc6866f None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:36.163611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9db54941-3dfa-45bd-8d8d-0234bdc6866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:36.184524 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1743/3500] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:36.259786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1758/3501] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:36.274854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f0bc5-2133-457f-a152-a73934934989 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:36.276597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-587f0bc5-2133-457f-a152-a73934934989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:36.372099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f0bc5-2133-457f-a152-a73934934989 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:36.378048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:36.378752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:36.379098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:36.379413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:36.389420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:36.391215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:36.403784 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1744/3502] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:37.458486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61aeb9-7257-45cc-82c9-1f100dcc4eeb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:37.458486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61aeb9-7257-45cc-82c9-1f100dcc4eeb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:37.458486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61aeb9-7257-45cc-82c9-1f100dcc4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:37.479676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1a61aeb9-7257-45cc-82c9-1f100dcc4eeb None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:37.481320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1a61aeb9-7257-45cc-82c9-1f100dcc4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:37.491467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1759/3503] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:37.506434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:37.520804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f21fa-c7ea-4817-af3a-1f20ed9e8b36 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:37.528407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:37.529527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:37.530220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:37.530649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:37.543324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:37.546620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:37.573833 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1745/3504] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:02:38.128979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8788-61b3-4196-b273-e36ce3aeb041 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:38.129553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8788-61b3-4196-b273-e36ce3aeb041 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:38.130020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8788-61b3-4196-b273-e36ce3aeb041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:38.151403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c6eb8788-61b3-4196-b273-e36ce3aeb041 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:38.153063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c6eb8788-61b3-4196-b273-e36ce3aeb041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:38.168825 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1760/3505] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:38.210245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:38.228870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f3793-53d5-44d4-984a-796e0d69e9e0 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:38.239425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:38.240386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:38.240863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:38.241382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:38.257075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:38.262351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:38.273020 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1746/3506] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:40.351492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093b65-9b4c-431a-9101-cad3d6567e58 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:40.352532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093b65-9b4c-431a-9101-cad3d6567e58 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:40.352961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093b65-9b4c-431a-9101-cad3d6567e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:40.393127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-51093b65-9b4c-431a-9101-cad3d6567e58 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:40.397367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-51093b65-9b4c-431a-9101-cad3d6567e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:40.428050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1761/3507] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:40.441149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:40.464090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccabc-03d2-41fc-9c8d-8a4d5c6261eb service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:40.478828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:40.481122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:40.482337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:40.483769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:40.508172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:40.514813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535999f1-2841-4cd3-ab2f-db778070373a service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:40.540509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1747/3508] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:41.427252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52565cb-6e24-4481-a8da-b0be0916e4a3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:41.428122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52565cb-6e24-4481-a8da-b0be0916e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:41.428695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52565cb-6e24-4481-a8da-b0be0916e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:41.468095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a52565cb-6e24-4481-a8da-b0be0916e4a3 None None] MFA Rules not processed for user `e6fb1f340fc243f4ae0f4f11f90c1f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:41.472936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a52565cb-6e24-4481-a8da-b0be0916e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:41.507164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1762/3509] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:02:42.404455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:42.405744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:42.405744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:42.462473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] MFA Rules not processed for user `e6fb1f340fc243f4ae0f4f11f90c1f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:42.465971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:42.489286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1748/3510] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:43.533933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:43.535641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:43.536112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:43.579589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:43.583655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:43.621896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1763/3511] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:43.644915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:43.669986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff7d1f-e1ff-4a64-8b98-692a9d91b2da None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:43.678501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:43.688125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:43.688334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:43.688646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:43.703342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:43.705052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb89e-29ca-413b-9a59-15baf1d1b7de service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:43.725888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1749/3512] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:44.152086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:44.154008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:44.256297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:44.400269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59079eb5-7e5d-4b67-ba4b-9e7510db137b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:44.422921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:44.426614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:44.435288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:44.438803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:44.444164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:44.475050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:44.479405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066579-4a3d-451b-9778-a6260c584223 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:44.507637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1764/3513] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:44.833502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:44.834669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:44.837658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:44.839933 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1750/3514] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:02:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:02:44.849375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:44.850305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:44.850780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:45.043210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:45.062021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:45.417165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1765/3515] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:45.451201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:45.454182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:45.507773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b26ef-7008-492b-bcc2-9aea8fb6f5f0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:45.525640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:45.531862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:45.532908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:45.534391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:45.581446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:45.586405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:45.623956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1751/3516] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:02:47.681199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:47.684274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:47.901852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c680a-e320-4800-8c5d-50ee403539c3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:47.914214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:47.915713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:47.916982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:47.917665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] PATH_INFO: `/v3/users/22302e87c7c141829fe04c06684650a5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:47.920793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22302e87c7c141829fe04c06684650a5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:47.923914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:48.043675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:48.053636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22302e87c7c141829fe04c06684650a5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:48.055165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22302e87c7c141829fe04c06684650a5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:48.078858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22302e87c7c141829fe04c06684650a5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:48.110630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22302e87c7c141829fe04c06684650a5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:48.123588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-75f9803b-9d51-4604-9909-1ab7b1a4be4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22302e87c7c141829fe04c06684650a5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:48.146223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1766/3517] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:02:47 2022] DELETE /identity/v3/users/22302e87c7c141829fe04c06684650a5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:02:49.000307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:49.016574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041260-993d-4ffb-8cad-c63fff0c78e4 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:49.230434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:49.231627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:49.232088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:49.232827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] PATH_INFO: `/v3/projects/58851e54cb214793b2e9ab09d0b3dac6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:49.235222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58851e54cb214793b2e9ab09d0b3dac6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:49.237635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:49.250778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:49.375619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58851e54cb214793b2e9ab09d0b3dac6', 'request_id': 'req-caa6c0a6-2054-4a76-8327-159d7f6cb718'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:49.420094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58851e54cb214793b2e9ab09d0b3dac6', 'request_id': 'req-caa6c0a6-2054-4a76-8327-159d7f6cb718'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:49.428784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58851e54cb214793b2e9ab09d0b3dac6', 'request_id': 'req-caa6c0a6-2054-4a76-8327-159d7f6cb718'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:49.454406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] The token cache is being invalidate because project 58851e54cb214793b2e9ab09d0b3dac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:02:49.457061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:49.458114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-caa6c0a6-2054-4a76-8327-159d7f6cb718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:02:49.466714 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1752/3518] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:48 2022] DELETE /identity/v3/projects/58851e54cb214793b2e9ab09d0b3dac6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:02:49.469057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:49.469861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:49.469861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:49.548290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:49.554938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:49.866350 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1767/3519] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:49.874469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:49.874756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:49.876292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:49.930324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:49.933118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:49.951879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:49.963435 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1753/3520] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:49.971411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877dd5f-0904-43d9-8bb1-d58365e75ec2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:49.980596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:49.981627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:49.982064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:49.982443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:49.983456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:02:49.983922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:49.990063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.033348 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1768/3521] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:02:50.038280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:50.052633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5bd6a-f1d9-417e-9d1d-f6c8766f9e64 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:50.070756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:50.071892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.073184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.074624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.077150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:50.082551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.189038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1754/3522] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:02:50 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:02:50.193161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:50.214074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999dcb-eb17-4836-9f18-e77d0157891d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:50.384897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:50.385716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.387937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.388389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.389242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:50.393330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.468587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:50.469890 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1769/3523] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:02:50 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:02:50.480734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab2ea2-f530-4045-9d34-334fff0bd89a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:50.496215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:50.496819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.497112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.497392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.498201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:50.499952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.522008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:50.529165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1755/3524] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:02:50.533831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da629db-766f-46e2-9ed0-9fb36e333cb8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:50.540310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:50.541230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.541815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.541815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.543064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:50.555779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3582a1-652b-4821-8b45-9307ab62ac1d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.573897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:50.579714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1770/3525] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:02:50.586004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1fdd3-4292-417f-94c3-858d5f1f5a19 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:50.610380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:50.610380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.610380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.610380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] PATH_INFO: `/v3/projects/408c3cf59a3e4e43a254940e52e0b1d9/users/32beeb99fc614d37b25cb2d397f3f58f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.644596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408c3cf59a3e4e43a254940e52e0b1d9, user_id=32beeb99fc614d37b25cb2d397f3f58f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:50.647681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:50.676651 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1756/3526] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:02:50 2022] PUT /identity/v3/projects/408c3cf59a3e4e43a254940e52e0b1d9/users/32beeb99fc614d37b25cb2d397f3f58f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:02:50.682289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46287f7-5570-4320-a534-d68c77f46d4b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:50.682591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46287f7-5570-4320-a534-d68c77f46d4b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:50.682938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46287f7-5570-4320-a534-d68c77f46d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:50.722042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b46287f7-5570-4320-a534-d68c77f46d4b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:02:50.723375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b46287f7-5570-4320-a534-d68c77f46d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:50.787140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:50.881732 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1771/3527] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:02:50.998011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:02:51.000724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:02:51.161217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0f0d3-4df7-4305-9a35-7203fa5f47b8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:02:51.172636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:02:51.173712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:02:51.174132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:02:51.174678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:02:51.213008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:02:51.216547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07818f8-124e-4bc9-89e7-b6093a8249e6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:02:51.249331 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1757/3528] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:00.859798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=15 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:01.234644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:05.970421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:05.971030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:05.971030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:06.037878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] MFA Rules not processed for user `32beeb99fc614d37b25cb2d397f3f58f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:06.044006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:06.272719 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1772/3529] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:12.905157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf63e-29c5-4c3c-87cc-1d66c03adc47 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:12.905651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf63e-29c5-4c3c-87cc-1d66c03adc47 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:12.905803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf63e-29c5-4c3c-87cc-1d66c03adc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:12.935604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-85fdf63e-29c5-4c3c-87cc-1d66c03adc47 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:12.945163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-85fdf63e-29c5-4c3c-87cc-1d66c03adc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:13.043941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:13.045924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:13.054354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1758/3530] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:13.256491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84291bb-7316-4cfb-892c-860cd3499fba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:13.265997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:13.267087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:13.267429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:13.267890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:13.284898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:13.286847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:13.309891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1773/3531] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:03:15.215187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560ffd-6f91-4252-8101-49c963d262bd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:15.215705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560ffd-6f91-4252-8101-49c963d262bd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:15.215825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560ffd-6f91-4252-8101-49c963d262bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:15.249061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dc560ffd-6f91-4252-8101-49c963d262bd None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:15.250495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc560ffd-6f91-4252-8101-49c963d262bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:15.270169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1759/3532] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:15.285378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:15.298664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246da81-3e07-4801-b6d4-6234a931c145 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:15.310352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:15.312202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:15.312488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:15.313324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:15.319760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:15.320946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:15.321258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:15.345060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:15.353013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:15.366599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:15.370578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:15.377408 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1774/3533] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:15.392082 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1760/3534] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 25 21:03:15.408900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:15.430482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffe92-f9f2-4101-8268-c0f5054ac067 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:15.445948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:15.446626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:15.446928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:15.447333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:15.468066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:15.473518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90650d-d436-4e41-b264-cf6708d1d26f service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:15.494796 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1775/3535] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:15.708631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:15.764228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76152d-7474-414b-87f9-6461875a7e6e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:15.792018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:15.793096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:15.794547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:15.800038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] PATH_INFO: `/v3/users/32beeb99fc614d37b25cb2d397f3f58f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:15.811499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32beeb99fc614d37b25cb2d397f3f58f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:15.814663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:15.997209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32beeb99fc614d37b25cb2d397f3f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:16.021101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32beeb99fc614d37b25cb2d397f3f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:16.077739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32beeb99fc614d37b25cb2d397f3f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:16.082044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32beeb99fc614d37b25cb2d397f3f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:16.084922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32beeb99fc614d37b25cb2d397f3f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:16.144078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1761/3536] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:15 2022] DELETE /identity/v3/users/32beeb99fc614d37b25cb2d397f3f58f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:16.768047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294918-9bd3-48f2-874f-509057ac81c9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:16.769028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294918-9bd3-48f2-874f-509057ac81c9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:16.770572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294918-9bd3-48f2-874f-509057ac81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:16.859056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1b294918-9bd3-48f2-874f-509057ac81c9 None None] MFA Rules not processed for user `a6a15dadfd0448fab9e84a89173ed7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:16.869429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1b294918-9bd3-48f2-874f-509057ac81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:17.083099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:17.117768 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1776/3537] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:17.291079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:17.293391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:17.642059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf33be8-a839-474e-a22a-02c7b1ddb24b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:17.672351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:17.673555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:17.673995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:17.674455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] PATH_INFO: `/v3/projects/408c3cf59a3e4e43a254940e52e0b1d9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:17.680908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=408c3cf59a3e4e43a254940e52e0b1d9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:17.684147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:17.706619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:17.824391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408c3cf59a3e4e43a254940e52e0b1d9', 'request_id': 'req-78ff5873-bca4-4cd0-a073-14d49bd3c91f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:17.847951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408c3cf59a3e4e43a254940e52e0b1d9', 'request_id': 'req-78ff5873-bca4-4cd0-a073-14d49bd3c91f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:17.856299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408c3cf59a3e4e43a254940e52e0b1d9', 'request_id': 'req-78ff5873-bca4-4cd0-a073-14d49bd3c91f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:17.895666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] The token cache is being invalidate because project 408c3cf59a3e4e43a254940e52e0b1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:17.896266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:17.913683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78ff5873-bca4-4cd0-a073-14d49bd3c91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:17.925993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1762/3538] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:17 2022] DELETE /identity/v3/projects/408c3cf59a3e4e43a254940e52e0b1d9 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:17.933527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:17.934399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:17.934399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:17.973513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:17.974912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:18.112040 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1777/3539] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:18.118869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.119157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.119451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.151152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:18.154453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:18.177487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1763/3540] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:18.179006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.192233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17327-7880-4994-b13c-c2775b3b593a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.206383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.209659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.210851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.211859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.215422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:18.219694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.223770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.239917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1778/3541] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:18.243905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.257526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d259d-8060-4b0a-bded-40b72781d6d0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.271495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.272344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.272580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.272856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.273610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.275403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.343302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.343580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1764/3542] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:18 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:18.357101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a6d8-03d9-4898-a9a2-5be00698bc85 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.547528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.548245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.549140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.549140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.549541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.552161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.625074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1779/3543] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:18 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:18.629141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.646362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda965d-f211-4f25-981f-e4b500ae2c6f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.663414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.668349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.669849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.670473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.672569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.677507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.719660 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1765/3544] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:18.720279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.740661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28e9e-c23c-481e-90af-dc4ded0bd162 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.754478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.755202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.755488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.755770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.756545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.763716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9b8b7-eb68-41a5-ab76-b667f6242bc5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.815591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:18.820907 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1780/3545] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:18.831647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2875-8eeb-4f9e-b660-3ce898c2bb9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:18.856767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:18.858019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.858301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.858577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] PATH_INFO: `/v3/projects/7810dbf9b56a4b06afd29ea28b734d9e/users/29487d161d5d4a29a6961662a1b0cd86/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.896193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7810dbf9b56a4b06afd29ea28b734d9e, user_id=29487d161d5d4a29a6961662a1b0cd86, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:18.908961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31527b-9120-45bb-8e54-e52dde09399f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:18.949512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:18.950137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:18.950137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:18.954342 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1766/3546] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:18 2022] PUT /identity/v3/projects/7810dbf9b56a4b06afd29ea28b734d9e/users/29487d161d5d4a29a6961662a1b0cd86/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:18.991706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] MFA Rules not processed for user `29487d161d5d4a29a6961662a1b0cd86`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:18.993350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:19.111040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:19.154568 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1781/3547] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:27.714291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:27.715942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:27.716284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:27.738734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:27.739945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:27.812596 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1767/3548] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:28.073536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:28.075163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.147944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:28.154112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831e3f-9b17-422e-9910-7583d50deca6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:28.159748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:28.160924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.161213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.161496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.163767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.178717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:28.180794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e721ee8-8c24-4a6b-a603-5b33cee39f91 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:28.192663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1782/3549] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:28.204659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:28.235972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc7ad2-f842-4042-9a04-ba0add898651 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:28.240976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:28.241643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.241921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.242194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] PATH_INFO: `/v3/users/29487d161d5d4a29a6961662a1b0cd86` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.244135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29487d161d5d4a29a6961662a1b0cd86)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:28.245403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:28.304595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29487d161d5d4a29a6961662a1b0cd86'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:28.313764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29487d161d5d4a29a6961662a1b0cd86'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:28.335090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29487d161d5d4a29a6961662a1b0cd86'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:28.337559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29487d161d5d4a29a6961662a1b0cd86'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:28.337559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29487d161d5d4a29a6961662a1b0cd86'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:28.352338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1768/3550] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:28 2022] DELETE /identity/v3/users/29487d161d5d4a29a6961662a1b0cd86 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:28.357054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c37e-bd38-4feb-a9ef-5b28c150e6b2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.357447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c37e-bd38-4feb-a9ef-5b28c150e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.357824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c37e-bd38-4feb-a9ef-5b28c150e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.384542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4ab5c37e-bd38-4feb-a9ef-5b28c150e6b2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:28.385711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ab5c37e-bd38-4feb-a9ef-5b28c150e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.489306 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1783/3551] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:28.500160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:28.502482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.626858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eff2c9-bee0-487f-8f0d-d53d85c08979 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:28.633929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:28.634615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.634896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.635173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.653706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:28.655176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:28.670941 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1769/3552] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:28.739854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.740136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.740412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.776261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:28.777936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.859538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:28.872867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe87da-665a-4f33-bfb2-27513659c6d4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:28.881606 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1784/3553] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:28.888254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:28.891156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:28.892529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:28.893473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:28.895879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:28.898474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.900173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:28.920394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:28.923607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:28.949452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1770/3554] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:28.967530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:29.002690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b5452-9d74-4cc9-986a-c6b2268eaa68 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:29.010508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:29.011330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:29.011841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:29.012219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:29.025280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:29.026588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf146c-01b3-47d9-bb66-10af7f5ffeb5 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:29.037259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1785/3555] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:03:29.376943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:29.379235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:29.415917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9612-41b1-4ae6-8ded-471a2f13ea1d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:29.437353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:29.438360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:29.438792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:29.439078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] PATH_INFO: `/v3/projects/7810dbf9b56a4b06afd29ea28b734d9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:29.440577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7810dbf9b56a4b06afd29ea28b734d9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:29.442563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:29.521240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:29.554925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7810dbf9b56a4b06afd29ea28b734d9e', 'request_id': 'req-b5ddc619-330a-46ae-9d26-ba825efd5512'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:29.566422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7810dbf9b56a4b06afd29ea28b734d9e', 'request_id': 'req-b5ddc619-330a-46ae-9d26-ba825efd5512'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:29.575295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7810dbf9b56a4b06afd29ea28b734d9e', 'request_id': 'req-b5ddc619-330a-46ae-9d26-ba825efd5512'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:29.613154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] The token cache is being invalidate because project 7810dbf9b56a4b06afd29ea28b734d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:29.613649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:29.614493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5ddc619-330a-46ae-9d26-ba825efd5512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:29.622344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:29.623424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:29.624039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:29.636051 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1771/3556] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:29 2022] DELETE /identity/v3/projects/7810dbf9b56a4b06afd29ea28b734d9e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:29.658117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:29.660103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:29.793469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1786/3557] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:29.802448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:29.802747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:29.803030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:29.849582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:29.853552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:29.878591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1772/3558] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:29.882886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:29.900551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17da75-7cf8-4bde-b73e-075b63b264c5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:29.918192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:29.919256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:29.919693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:29.920249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:29.931591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:29.932146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:29.934272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:29.957816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1787/3559] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:29.958640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:29.995933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0d6f3-cab1-4730-9ce3-8e188e077955 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:30.010643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:30.011553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.011841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.012126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.013103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:30.015356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:30.084017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:30.084877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1773/3560] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:29 2022] POST /identity/v3/projects => generated 359 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:30.105970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ba5b-b97e-42ef-b703-589dba701f48 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:30.297441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:30.298332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.298718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.299097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.300609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:30.302826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:30.340279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1788/3561] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:30 2022] POST /identity/v3/users => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:30.344415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:30.358276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d903-3324-4dbb-b504-a42cc3448946 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:30.368361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:30.369253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.369649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.370494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.371072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:30.373418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:30.392727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1774/3562] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:30.398670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:30.414138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d60160-0015-4604-90b1-0320d55e6fa5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:30.430900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:30.431784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.432274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.432754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.433899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:30.436116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359627e-de02-4c10-b2c1-0cba02b1da75 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:30.450276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1789/3563] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:30.454543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:30.478997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ffbe-dcd9-4b4e-b56e-7989a59cda8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:30.485542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:30.486681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.487164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.487851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] PATH_INFO: `/v3/projects/5ee63aaccfd649cd91b727b35b4ba10d/users/e268c9a18cf94ccda6cc461159a6e586/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.514015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee63aaccfd649cd91b727b35b4ba10d, user_id=e268c9a18cf94ccda6cc461159a6e586, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:30.517275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:30.568103 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1775/3564] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:30 2022] PUT /identity/v3/projects/5ee63aaccfd649cd91b727b35b4ba10d/users/e268c9a18cf94ccda6cc461159a6e586/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:30.571026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07da6-3488-42d7-9d3a-a54a1d0c5a25 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:30.573918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07da6-3488-42d7-9d3a-a54a1d0c5a25 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:30.574227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07da6-3488-42d7-9d3a-a54a1d0c5a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:30.635168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c1c07da6-3488-42d7-9d3a-a54a1d0c5a25 None None] MFA Rules not processed for user `e268c9a18cf94ccda6cc461159a6e586`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:30.638736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1c07da6-3488-42d7-9d3a-a54a1d0c5a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:30.713920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:30.774582 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1790/3565] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:31.579931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:31.736379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fa63-9c89-4da9-8779-9100758627cb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:31.748371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:31.749370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:31.749650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:31.749925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] PATH_INFO: `/v3/users/e268c9a18cf94ccda6cc461159a6e586` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:31.753223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e268c9a18cf94ccda6cc461159a6e586)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:31.759801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:31.900855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e268c9a18cf94ccda6cc461159a6e586'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:31.913983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e268c9a18cf94ccda6cc461159a6e586'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:31.929275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:31.943221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e268c9a18cf94ccda6cc461159a6e586'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:31.944231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e268c9a18cf94ccda6cc461159a6e586'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:31.946415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c46a75e9-ae3a-448a-bf5d-f8ffd3f974c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e268c9a18cf94ccda6cc461159a6e586'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:31.970139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:31.972120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:31.972621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:31.979657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1776/3566] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:31 2022] DELETE /identity/v3/users/e268c9a18cf94ccda6cc461159a6e586 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:31.985065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:31.985361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:31.985646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:32.009461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:32.015299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:32.034190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:32.036377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:32.188860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1791/3567] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:03:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 25 21:03:32.190705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:32.192573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:32.203890 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1777/3568] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:32.232750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:32.234409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:32.343801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec084d-1d6a-4a32-91a6-f6860ec0b95e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:32.360376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:32.361134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:32.361393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:32.361689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:32.384580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c84f7-7c08-4887-b917-5c0dbc238ef9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:32.384834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:32.386478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886ed4-fad0-4d8c-a7f0-44f9717e9677 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:32.396106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:32.396812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:32.397096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:32.397430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:32.397535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1792/3569] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:32.422497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:32.424789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:32.443088 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1778/3570] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:03:33.010591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:33.011041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:33.011332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:33.039315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:33.041586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:33.060114 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1793/3571] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:33.081472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:33.103953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8201fa6-376a-4215-a887-83b125a9fa1d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:33.110624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:33.112506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:33.112954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:33.113384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:33.130754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:33.132889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41318-da2d-4a3a-93f7-4f4be0bc7107 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:33.149832 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1779/3572] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:03:33.585700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:33.588086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:33.624044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f3fa-76c3-45e1-8471-afa879e9b35e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:33.641732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:33.645522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:33.645821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:33.646107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] PATH_INFO: `/v3/projects/5ee63aaccfd649cd91b727b35b4ba10d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:33.649722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee63aaccfd649cd91b727b35b4ba10d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:33.656358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:33.779447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee63aaccfd649cd91b727b35b4ba10d', 'request_id': 'req-e03220f4-9b9e-4734-b59d-4680ec344215'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:33.787727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:33.802899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee63aaccfd649cd91b727b35b4ba10d', 'request_id': 'req-e03220f4-9b9e-4734-b59d-4680ec344215'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:33.818693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee63aaccfd649cd91b727b35b4ba10d', 'request_id': 'req-e03220f4-9b9e-4734-b59d-4680ec344215'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:33.848481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] The token cache is being invalidate because project 5ee63aaccfd649cd91b727b35b4ba10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:33.848984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:33.850190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e03220f4-9b9e-4734-b59d-4680ec344215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:33.855185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1794/3573] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:33 2022] DELETE /identity/v3/projects/5ee63aaccfd649cd91b727b35b4ba10d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:33.862167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:33.862696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:33.863280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:33.904990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:33.906424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:34.141242 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1780/3574] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:34.142997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.143413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.143652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.173795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:34.177116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:34.203721 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1795/3575] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:34.207881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.219931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdebcc1-753e-44a6-8980-93e9c3c95b65 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.227511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.228722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.229066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.229438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.230411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:34.230971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.232872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.248478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:34.257410 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1781/3576] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:34.261785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.272121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a709a-7a52-4b0e-ac3e-c2a913311895 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.277435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.278384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.278817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.279269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.280116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.282731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.321058 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1796/3577] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:34.322333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.334360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95249b-590c-4baf-b812-cad0b37bf06b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.485029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.485836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.486358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.486733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.487524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.491892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.545520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.554602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1782/3578] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:34 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:34.562817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1837723-31f0-47cb-a6c4-79d54676f599 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.568773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.569594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.570115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.570494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.571338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.573773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.588959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1797/3579] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:34.595538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.607903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583ab11-eeb8-4032-9e6d-fa7c0222cbb6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.616713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.617772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.618344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.618829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.619973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.621726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889efb4-0833-470b-8ea2-2538fb38fc77 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.643789 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1783/3580] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:34.650171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:34.669370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64af1b-5fb4-4413-aafb-c45bb3e957cf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:34.675408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:34.676760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.677225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.677654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] PATH_INFO: `/v3/projects/9422ddacce034aea98d9b2587253be64/users/728d92c5b3be4030af9508f21d31a40c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.708524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9422ddacce034aea98d9b2587253be64, user_id=728d92c5b3be4030af9508f21d31a40c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:34.712112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:34.738050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1798/3581] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:34 2022] PUT /identity/v3/projects/9422ddacce034aea98d9b2587253be64/users/728d92c5b3be4030af9508f21d31a40c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:34.751776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:34.752074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:34.752358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:34.787367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] MFA Rules not processed for user `728d92c5b3be4030af9508f21d31a40c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:34.788994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:34.912656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1784/3582] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:34.915153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.010425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c4979-31ef-4009-934c-df4caabc054b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.023502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.024368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.024963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.025355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.026182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.028286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.070474 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1799/3583] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:35.072703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.093691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d597db-75d0-4fe4-9f42-660e22aee6a4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.218026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.220283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.222157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.222723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.229003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.232572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.251829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:35.262454 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1785/3584] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:35 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:35.267065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.278339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc6c9-d1fb-462e-91f4-ef7a785a8bb2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.284975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.286605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.287201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.287957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.289428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.293777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.305870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1800/3585] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:35.310669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.333886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087bb-c304-44e3-bd01-7f852894aa2f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.339316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.340827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.341112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.341535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] PATH_INFO: `/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d/users/860650855d3849b8b83cd7b253a355df/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.366719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f4063bf7314b46aadf66ffc2e2be1d, user_id=860650855d3849b8b83cd7b253a355df, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.369907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.389893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1786/3586] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:35 2022] PUT /identity/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d/users/860650855d3849b8b83cd7b253a355df/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:35.394215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.406817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e9ac-c6a5-4410-9bb0-f8697475972f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.461031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:35.478134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.478946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.479518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.479981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.480781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.482567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42309e1-2dfe-4590-aa73-099b4319daed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.499562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1801/3587] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:35.503603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.515160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67860b4b-b38f-49b4-a8c0-2c1c7aefae4d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.521096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.522050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.523284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.523284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] PATH_INFO: `/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d/users/860650855d3849b8b83cd7b253a355df/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.524755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f4063bf7314b46aadf66ffc2e2be1d, user_id=860650855d3849b8b83cd7b253a355df, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.528101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.541596 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1787/3588] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:35 2022] PUT /identity/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d/users/860650855d3849b8b83cd7b253a355df/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:03:35.568477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.568834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.569241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.626363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] MFA Rules not processed for user `860650855d3849b8b83cd7b253a355df`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:35.633494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:35.828543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1802/3589] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:35.832955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.847699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bea83-70b0-4340-b8f0-7a6c5978b594 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:35.853931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:35.855514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:35.856412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:35.856930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:35.857890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:35.860239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:35.862254 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.common [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 25 21:03:35.929457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1788/3590] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:35 2022] POST /identity/v3/projects => generated 349 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:35.934055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:35.945616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0776c6-90ee-4f63-8f9e-807d61b9ec4e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.032261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.033307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.034159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.034608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.035665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.037675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.098969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.111558 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1803/3591] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:35 2022] POST /identity/v3/projects => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:36.121000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5673e-66d6-4066-b603-21c4649a88fb tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.274313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.278950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.282277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.282277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/users/728d92c5b3be4030af9508f21d31a40c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.284646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:get_user(user_id=728d92c5b3be4030af9508f21d31a40c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.291560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.301812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.322760 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1789/3592] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:03:36 2022] GET /identity/v3/users/728d92c5b3be4030af9508f21d31a40c => generated 288 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:03:36.324713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ce8c-5d60-4a0d-bb86-d063bdc638d7 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.333836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.335641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.339571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.340606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.341923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.344159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.406564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1804/3593] 10.222.0.39 () {60 vars in 1161 bytes} [Sat Jun 25 21:03:36 2022] POST /identity/v3/credentials => generated 430 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:36.411224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.424895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6751769-b44e-4806-8c42-e93f3ffa5444 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.430904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.432674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.433198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.433734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.437122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.439251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.441505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.444681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.480833 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1790/3594] 10.222.0.39 () {60 vars in 1357 bytes} [Sat Jun 25 21:03:36 2022] PATCH /identity/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20 => generated 437 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:36.481870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.510023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053508e-22aa-4242-8352-ac79acf11120 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.525893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.527144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.529869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.532040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.537090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.542056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.557190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.564913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1805/3595] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 25 21:03:36 2022] GET /identity/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20 => generated 437 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:36.572213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16b4f4-1532-4e74-a483-ea3f7f253dab tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.578713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.585671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.586459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.587125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.595620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.597896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.647361 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1791/3596] 10.222.0.39 () {58 vars in 1337 bytes} [Sat Jun 25 21:03:36 2022] DELETE /identity/v3/credentials/8ab2f3249162fa616077bc9c65ab4eca1263e184ac8012660920c1be02630e20 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:36.653665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.668605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68b34-010d-4fd0-b368-17af0f328ebe tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.682272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.684475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.684900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.685285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.687152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.694286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.735210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1806/3597] 10.222.0.39 () {60 vars in 1161 bytes} [Sat Jun 25 21:03:36 2022] POST /identity/v3/credentials => generated 431 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:36.739018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.759669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166e34-e4e4-4489-a0ca-b03058440c18 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.771629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.772457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.773010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.773520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.774465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.777230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.833626 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1792/3598] 10.222.0.39 () {60 vars in 1161 bytes} [Sat Jun 25 21:03:36 2022] POST /identity/v3/credentials => generated 431 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:36.837615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:36.856943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe230-95a7-40f7-aed0-b84b3a842d28 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:36.878877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:36.880360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:36.880958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:36.881357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:36.883098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.884958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.938751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.940811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.957335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:36.960095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:36.980761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1807/3599] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 21:03:36 2022] GET /identity/v3/credentials => generated 947 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:36.994882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:37.015072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151f89-8568-45e8-864d-ee461c5e1c5d tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:37.037194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:37.038400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:37.038858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:37.039289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials/83a8b747d6ddced36766789418c05c154512b21cc9580a6afc4090c9993db394` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:37.042969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=83a8b747d6ddced36766789418c05c154512b21cc9580a6afc4090c9993db394)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:37.044829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:37.102654 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1793/3600] 10.222.0.39 () {58 vars in 1337 bytes} [Sat Jun 25 21:03:36 2022] DELETE /identity/v3/credentials/83a8b747d6ddced36766789418c05c154512b21cc9580a6afc4090c9993db394 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:37.106978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:37.122958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbf1a1-c785-4b7f-b2b7-e26842fc74b2 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:37.139316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:37.140213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:37.140528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:37.140921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/credentials/28f9fda5ae2ae053fe2ce8b63d612741d135f64779a5f3a54591e58ddcc17a75` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:37.143836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=28f9fda5ae2ae053fe2ce8b63d612741d135f64779a5f3a54591e58ddcc17a75)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:37.145790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:37.164013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:37.175896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1808/3601] 10.222.0.39 () {58 vars in 1337 bytes} [Sat Jun 25 21:03:37 2022] DELETE /identity/v3/credentials/28f9fda5ae2ae053fe2ce8b63d612741d135f64779a5f3a54591e58ddcc17a75 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:37.177478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:37.192063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18314de7-ed6f-4676-85ad-28354a453680 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:37.201274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:37.203461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:37.204239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:37.204746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/projects/b4915b9dc591478fbd40e4cf21b3563f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:37.208160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4915b9dc591478fbd40e4cf21b3563f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:37.212969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:37.272641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:37.288799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4915b9dc591478fbd40e4cf21b3563f', 'request_id': 'req-f5cf86db-e668-4b3e-9dae-5185df80075f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.303882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4915b9dc591478fbd40e4cf21b3563f', 'request_id': 'req-f5cf86db-e668-4b3e-9dae-5185df80075f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.313915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4915b9dc591478fbd40e4cf21b3563f', 'request_id': 'req-f5cf86db-e668-4b3e-9dae-5185df80075f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.328146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] The token cache is being invalidate because project b4915b9dc591478fbd40e4cf21b3563f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:37.328476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.330085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.332005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1794/3602] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:37 2022] DELETE /identity/v3/projects/b4915b9dc591478fbd40e4cf21b3563f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:37.336267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:37.338914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:37.361497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6d1b-fe98-499b-a455-38a0b3f01c53 tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:37.512608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '860650855d3849b8b83cd7b253a355df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01f4063bf7314b46aadf66ffc2e2be1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:37.513391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:37.514019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:37.516000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] PATH_INFO: `/v3/projects/be1f68dfe46d49e7965d3a39721a3c92` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:37.519665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorizing `identity:delete_project(project_id=be1f68dfe46d49e7965d3a39721a3c92)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:37.524862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:37.590278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1f68dfe46d49e7965d3a39721a3c92', 'request_id': 'req-a701a408-7e63-4ff0-a149-175ed616bdff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.606513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1f68dfe46d49e7965d3a39721a3c92', 'request_id': 'req-a701a408-7e63-4ff0-a149-175ed616bdff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.617286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1f68dfe46d49e7965d3a39721a3c92', 'request_id': 'req-a701a408-7e63-4ff0-a149-175ed616bdff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.630875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] The token cache is being invalidate because project be1f68dfe46d49e7965d3a39721a3c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:37.631663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.632003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a701a408-7e63-4ff0-a149-175ed616bdff tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.633934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1809/3603] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:37 2022] DELETE /identity/v3/projects/be1f68dfe46d49e7965d3a39721a3c92 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:37.637662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:37.639223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:37.755329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf86db-e668-4b3e-9dae-5185df80075f tempest-CredentialsTestJSON-1686602961 tempest-CredentialsTestJSON-1686602961-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:37.854887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:37.854887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:37.855066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:37.855605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] PATH_INFO: `/v3/users/728d92c5b3be4030af9508f21d31a40c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:37.858760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728d92c5b3be4030af9508f21d31a40c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:37.861280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:37.939491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728d92c5b3be4030af9508f21d31a40c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.954480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728d92c5b3be4030af9508f21d31a40c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.982710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728d92c5b3be4030af9508f21d31a40c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.983873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728d92c5b3be4030af9508f21d31a40c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:37.984789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-31807d6b-e67e-4fb4-b667-85099f456601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728d92c5b3be4030af9508f21d31a40c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.000564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:38.017964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1795/3604] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:37 2022] DELETE /identity/v3/users/728d92c5b3be4030af9508f21d31a40c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:38.020095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:38.020482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:38.020948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:38.051443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:38.051765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:38.052051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:38.070282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:38.073175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:38.097097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] MFA Rules not processed for user `5d3257db63ed4bf0861abc735c1e83ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:38.098333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:38.205607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1810/3605] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:38.217096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:38.224006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:38.224148 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1796/3606] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:38.281349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:38.326244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f5c4-d382-4004-b876-135f282f6cb6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:38.330048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:38.330842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:38.331675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:38.331675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:38.343435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:38.344974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:38.356062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1811/3607] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:38.591540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:38.593296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:38.610340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508369e-da23-47c3-9535-f4d1a1771ed6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:38.615718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:38.616805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:38.617095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:38.617512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] PATH_INFO: `/v3/users/f9abc0f22f944a95a70b23e50bafdccb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:38.618877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9abc0f22f944a95a70b23e50bafdccb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:38.620982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:38.706245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9abc0f22f944a95a70b23e50bafdccb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.715962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9abc0f22f944a95a70b23e50bafdccb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.736824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9abc0f22f944a95a70b23e50bafdccb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.737660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9abc0f22f944a95a70b23e50bafdccb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.738404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9abc0f22f944a95a70b23e50bafdccb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:38.757431 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1797/3608] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:38 2022] DELETE /identity/v3/users/f9abc0f22f944a95a70b23e50bafdccb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:38.958537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:38.961058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:38.999264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea246b-3b1e-47ea-9194-dd92bf98f1aa service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.085994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.087542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:39.131651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.133307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.134055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.134829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] PATH_INFO: `/v3/projects/9422ddacce034aea98d9b2587253be64` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.150831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9422ddacce034aea98d9b2587253be64)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.153272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.247225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968c78-af63-45ca-81d3-c249e24fde81 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.252959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.254117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.254577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.255009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] PATH_INFO: `/v3/projects/7f998f8bc87c4e009254746816812231` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.256417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f998f8bc87c4e009254746816812231)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.258641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.273644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9422ddacce034aea98d9b2587253be64', 'request_id': 'req-1d50bc78-8d95-4296-b2ec-e911318b917d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.276777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:39.302448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9422ddacce034aea98d9b2587253be64', 'request_id': 'req-1d50bc78-8d95-4296-b2ec-e911318b917d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.323078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f998f8bc87c4e009254746816812231', 'request_id': 'req-68aaa925-05c3-4493-bee7-cc49c49524ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.327834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9422ddacce034aea98d9b2587253be64', 'request_id': 'req-1d50bc78-8d95-4296-b2ec-e911318b917d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.340561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f998f8bc87c4e009254746816812231', 'request_id': 'req-68aaa925-05c3-4493-bee7-cc49c49524ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.359979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f998f8bc87c4e009254746816812231', 'request_id': 'req-68aaa925-05c3-4493-bee7-cc49c49524ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.364283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] The token cache is being invalidate because project 9422ddacce034aea98d9b2587253be64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:39.364839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.365495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1d50bc78-8d95-4296-b2ec-e911318b917d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.372998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] The token cache is being invalidate because project 7f998f8bc87c4e009254746816812231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:39.373378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.374094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.376657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1798/3610] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:39 2022] DELETE /identity/v3/projects/7f998f8bc87c4e009254746816812231 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:03:39.379208 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1812/3610] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:38 2022] DELETE /identity/v3/projects/9422ddacce034aea98d9b2587253be64 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:39.385860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.386394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13c82-1671-4c18-b6b1-6a0bae4b0622 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.387784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:39.390235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13c82-1671-4c18-b6b1-6a0bae4b0622 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.390235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a13c82-1671-4c18-b6b1-6a0bae4b0622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.453491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-51a13c82-1671-4c18-b6b1-6a0bae4b0622 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:39.455864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-51a13c82-1671-4c18-b6b1-6a0bae4b0622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:39.489352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa925-05c3-4493-bee7-cc49c49524ab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.494515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.495401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.495683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.495959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] PATH_INFO: `/v3/users/860650855d3849b8b83cd7b253a355df` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.497418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860650855d3849b8b83cd7b253a355df)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.499848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.550103 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1813/3611] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:39.560113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.560411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.560787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.569575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:39.581514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:39.583188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860650855d3849b8b83cd7b253a355df'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.583920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:39.594145 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1814/3612] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:39.598580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.607306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860650855d3849b8b83cd7b253a355df'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.608389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fbdf5-d3a7-48f5-9bfc-77d9f0e9cde3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.613406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.614086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.614603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.614887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.615624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:39.615941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.617738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.628880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860650855d3849b8b83cd7b253a355df'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.629808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860650855d3849b8b83cd7b253a355df'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.630600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860650855d3849b8b83cd7b253a355df'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:39.638831 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1815/3613] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:39.654412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.656357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:39.660397 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1799/3614] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:39 2022] DELETE /identity/v3/users/860650855d3849b8b83cd7b253a355df => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:39.678928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f257ef-6994-4846-8a6d-c8d2a2a4d54a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.768711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.769598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.769944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.770303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.771106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.773681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.813939 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1816/3615] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:39.818467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.832558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d09872-f95d-490c-8425-0fbd029d74a9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.854871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:39.907519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.908410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.908791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.909133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.910355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.911910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:39.948804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1800/3616] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:39 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:39.949884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:39.964006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ace7-d5d0-4560-8caa-59dd8b36e654 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:39.970849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:39.971663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:39.972013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:39.972356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:39.973750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:39.975666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.005390 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1817/3617] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:40.009422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.022164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6af4-27d8-4b65-ae0b-93f575d59a6b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.035635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.036810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.037292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.037751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.038850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.048090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.067114 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1801/3618] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:40.071267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.082233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d64d-a95e-436c-acfc-b58d2ae8088b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.087509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.087806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.088638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.088926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.089214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] PATH_INFO: `/v3/projects/109c4d190ac748b68b97b317d63a909a/users/f46fff9b561e4959975edfffe24e1397/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.090803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.110229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=109c4d190ac748b68b97b317d63a909a, user_id=f46fff9b561e4959975edfffe24e1397, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.112792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3787d4f-4776-4a09-bb36-eb6ec1aca74f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.122450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a8c7-5503-45fb-a7f9-2879ca7584ec admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.143801 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1818/3619] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:40 2022] PUT /identity/v3/projects/109c4d190ac748b68b97b317d63a909a/users/f46fff9b561e4959975edfffe24e1397/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:03:40.143976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.144903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.145190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.145511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] PATH_INFO: `/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.149888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.152156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.152554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.157819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f4063bf7314b46aadf66ffc2e2be1d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.167551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.191590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:40.192832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.265508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f4063bf7314b46aadf66ffc2e2be1d', 'request_id': 'req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:40.282895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f4063bf7314b46aadf66ffc2e2be1d', 'request_id': 'req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:40.290530 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1819/3620] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:40.291270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f4063bf7314b46aadf66ffc2e2be1d', 'request_id': 'req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:40.297432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.299244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.309658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] The token cache is being invalidate because project 01f4063bf7314b46aadf66ffc2e2be1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:40.310189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:40.311076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2347f0b0-04ff-4cf8-90ed-4cf7c1e3e4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:40.313407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1802/3621] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:40 2022] DELETE /identity/v3/projects/01f4063bf7314b46aadf66ffc2e2be1d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:40.317896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9fd33-ec90-4e6d-820f-a98e73daca13 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.318263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9fd33-ec90-4e6d-820f-a98e73daca13 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.318613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9fd33-ec90-4e6d-820f-a98e73daca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.339339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7be9fd33-ec90-4e6d-820f-a98e73daca13 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:40.341713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7be9fd33-ec90-4e6d-820f-a98e73daca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.353419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:40.379134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81dd2-d699-45a6-97bf-bb9efa27ef6b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.446956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1803/3622] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:40.454981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.455366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.456131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.457716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.459170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.459459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.459731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.475048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.493991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.496995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.500057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:40.501450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:40.512030 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1820/3623] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:03:40.513144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1804/3624] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:40.517810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.529840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63356-f36e-4410-a4d4-2353fe3143b0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.539855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.540712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.541846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.542149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.542896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:40.543210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.548489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.566118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1821/3625] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:40.571047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.582603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5276b12-6e44-4a64-bceb-1e9f56f61d26 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.587428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c661854-8668-4e92-a651-370114282401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.588109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661854-8668-4e92-a651-370114282401 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.588407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661854-8668-4e92-a651-370114282401 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.588695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c661854-8668-4e92-a651-370114282401 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.590067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c661854-8668-4e92-a651-370114282401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.592155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c661854-8668-4e92-a651-370114282401 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.609477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:40.628616 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1805/3626] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:40.630770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.644946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19be9-b173-4a28-b71d-c5f5bfeeeebf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.731702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.732945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.733539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.733921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.736287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.738699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.775171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1822/3627] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:40.779697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c661854-8668-4e92-a651-370114282401 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.790395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c661854-8668-4e92-a651-370114282401 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.795400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.796247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.796646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.796997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.797823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.799515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.822554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.828648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1806/3628] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:40.835036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736163-0ee5-4edf-8401-e677f12ff13b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.842387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.843542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.843999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.844485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.845799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.847482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc40d-14ca-4049-bcfe-0cdfb041e8e1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.859136 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1823/3629] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:40.863481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:40.875440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600069-5eed-4b47-a59c-f1c8670d40b7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:40.882422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:40.883134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.883509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.883884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] PATH_INFO: `/v3/projects/3dea7f29b99b4432a7b673c8a170aefb/users/142221062b4b44fcae4c98d2caed5bd3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.905733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dea7f29b99b4432a7b673c8a170aefb, user_id=142221062b4b44fcae4c98d2caed5bd3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:40.909097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:40.925111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1807/3630] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:40 2022] PUT /identity/v3/projects/3dea7f29b99b4432a7b673c8a170aefb/users/142221062b4b44fcae4c98d2caed5bd3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:40.936177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:40.936599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:40.936849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:40.969022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] MFA Rules not processed for user `142221062b4b44fcae4c98d2caed5bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:40.970578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:41.053025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:41.082416 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1824/3631] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:41.087176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.213444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981179-0e64-4559-89df-bd6c209b2220 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.220155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.220928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.221329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.221611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.222968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.225495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.258198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1808/3632] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:41 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:41.262373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.292321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee029f-d6b0-4440-ad64-b7775b5850b4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.409920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.411788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.413279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.413862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.415001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.421330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.478122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1825/3633] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:41 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:41.483639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.505283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335de33-55e4-4100-8e99-bb196f56cfda admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.511910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.513071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.514093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.514387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.515230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.517027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f30076-bd9c-42bf-918f-81319e8d98f5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.583614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1809/3634] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:41.587839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.610492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b25e-106f-40e0-a503-b3e35b19cdfc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.619446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.620336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.620655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.620939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] PATH_INFO: `/v3/projects/290847f3d8d5440086ef97ce256ebd4d/users/08edf3acc33345819682f859754dd4c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.637773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290847f3d8d5440086ef97ce256ebd4d, user_id=08edf3acc33345819682f859754dd4c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.640101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.640621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.640702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.644387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.670082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:41.671480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:41.672511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1826/3635] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:41 2022] PUT /identity/v3/projects/290847f3d8d5440086ef97ce256ebd4d/users/08edf3acc33345819682f859754dd4c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:41.676631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.769497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1810/3636] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:41.804620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.806615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:41.821418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba71-68b8-4442-aed9-3a17e5a71256 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.837778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.838800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.839186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.839561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.840837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.844011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.873573 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1827/3637] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:41.877820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:41.886949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:41.896196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc376f1-dd31-47af-a1b9-e349da919d4f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:41.913136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:41.914065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.914348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.914626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] PATH_INFO: `/v3/projects/290847f3d8d5440086ef97ce256ebd4d/users/08edf3acc33345819682f859754dd4c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.921608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290847f3d8d5440086ef97ce256ebd4d, user_id=08edf3acc33345819682f859754dd4c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:41.924284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9473e-bab4-4692-9b40-2f3214bdbcc5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:41.944490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1828/3638] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:41 2022] PUT /identity/v3/projects/290847f3d8d5440086ef97ce256ebd4d/users/08edf3acc33345819682f859754dd4c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:41.953655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:41.954142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:41.954714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:41.975816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece32d-0e7b-44a7-b135-c72fadec9276 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.007641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] MFA Rules not processed for user `08edf3acc33345819682f859754dd4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:42.010520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:42.091705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:42.144682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.145350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.145629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.145903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.228777 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1829/3639] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:42.232915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.251463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837700-efa9-4b6b-9e5e-bc52611d7c36 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.262723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.263526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.264491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.265044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.266758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.268466 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:42.268466 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:42.268466 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:42.270280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.284372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.291744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.298601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1830/3640] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:42 2022] POST /identity/v3/services => generated 288 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:42.302509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.323020 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1811/3641] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:42.357528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62cc4b-2815-468f-9764-55538ddbfe0f tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.362984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.363817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.364107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.364382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.365176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.366200 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:42.366200 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:42.366200 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:42.367093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.407734 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-462887097. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:42.407734 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:42.407734 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:42.464355 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1831/3642] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:03:42 2022] POST /identity/v3/endpoints => generated 359 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:42.468905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.483955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf5188-b39f-4736-b6fd-9c542fe810db service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.539999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.541141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.543864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.544348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-462887097` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.545220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-462887097)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.548044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.554646 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1812/3643] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 21:03:42 2022] GET /identity/v3/regions/tempest-region-462887097 => generated 178 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:42.557522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.577176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27775052-f5cc-4298-bc85-878d21aebfe9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.583313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.584075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.584595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.584871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.585606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.587273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.615454 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1832/3644] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:42 2022] POST /identity/v3/services => generated 288 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:42.619837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.649415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d23-e52f-42d3-9ff6-e5e3c0259109 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:42.710088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:42.710777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:42.711067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:42.711352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:42.712112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:42.713191 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:42.713191 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:42.713191 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:42.714095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:42.797234 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-214779636. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:42.797234 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:42.797234 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:42.933332 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1813/3645] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:03:42 2022] POST /identity/v3/endpoints => generated 360 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:42.936944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:42.955983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d191c-dae7-4920-8d5d-0ba0c13315ad tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.005979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.006935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.007253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.007571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-214779636` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.008271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-214779636)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.009861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.017501 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1833/3646] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 21:03:42 2022] GET /identity/v3/regions/tempest-region-214779636 => generated 178 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:43.018630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.038170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6cd5-2414-412d-8948-3f062e8427e0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.049643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.050347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.050631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.050905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.051671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.054188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.104327 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2020692051. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:43.104327 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:43.104327 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:43.106838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:43.174845 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1814/3647] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:03:43 2022] POST /identity/v3/endpoints => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:43.177939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.193972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321050d-8450-4427-960c-188b5ebbacb6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.235030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.236066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.236403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.238565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-2020692051` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.239305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2020692051)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.240610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.256541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1834/3648] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/regions/tempest-region-2020692051 => generated 180 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:43.258137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.277188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16894-933a-4c3b-abb0-74d4654a4318 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.287021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.287719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.288005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.288280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.289257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.290303 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:43.290303 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:43.290303 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:43.291202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.323055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1815/3649] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints => generated 4384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:43.324550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.343801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981781c2-ac67-444f-a79d-d36079b46cc4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.355487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.356595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.356974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.357299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/ceaa6d0f62b946838909ad2270d142df` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.381449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=ceaa6d0f62b946838909ad2270d142df)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.382916 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:43.382916 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:43.382916 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:43.385434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.394062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1835/3650] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints/ceaa6d0f62b946838909ad2270d142df => generated 361 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:03:43.395495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.412476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361133b-f109-4483-8029-fa264aeb5e27 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.425468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.426816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.426816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.427022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/ceaa6d0f62b946838909ad2270d142df` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.433408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ceaa6d0f62b946838909ad2270d142df)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.434479 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:43.434479 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:43.434479 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:43.435407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.466336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ceaa6d0f62b946838909ad2270d142df', 'request_id': 'req-0df18f0d-bb08-47bd-a895-735c3ff52fa5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:43.487584 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1816/3651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:43 2022] DELETE /identity/v3/endpoints/ceaa6d0f62b946838909ad2270d142df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:43.488917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.505029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a78a0-e62c-423c-8a95-103c4eb5f81c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.546952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.547835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.548130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.548417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.550668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.551727 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:43.551727 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:43.551727 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:43.555749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.597646 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1836/3652] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints => generated 4036 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:43.599970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.617045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df18f0d-bb08-47bd-a895-735c3ff52fa5 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.626359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.627262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.627553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.627831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/ceaa6d0f62b946838909ad2270d142df` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.649777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Could not find endpoint: ceaa6d0f62b946838909ad2270d142df.: keystone.exception.EndpointNotFound: Could not find endpoint: ceaa6d0f62b946838909ad2270d142df. Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._iter().one() Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._only_one_row( Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:03:43.693911 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ceaa6d0f62b946838909ad2270d142df. Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:03:43.695034 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:03:43.696026 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ceaa6d0f62b946838909ad2270d142df. Jun 25 21:03:43.696991 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:03:43.701755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1817/3653] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:43 2022] DELETE /identity/v3/endpoints/ceaa6d0f62b946838909ad2270d142df => generated 114 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:03:43.703465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.719654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad464-3298-4575-a458-2296e6f95aa7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.737546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.738680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.739795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.740286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-2020692051` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.741475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2020692051)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.745505 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:43.745505 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:43.745505 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:43.746877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.786274 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2020692051. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:43.786274 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:43.786274 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:43.798480 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1837/3654] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:03:43 2022] DELETE /identity/v3/regions/tempest-region-2020692051 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:43.806122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.819990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269e3d-74ad-4068-b72c-c4af0dbe2066 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.882110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.882988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.882988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.883258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.883966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.893806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.922666 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1818/3655] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints => generated 4036 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:43.924443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.944964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e271-0d7f-4397-99a3-264f9e6921e3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:43.954591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:43.955627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:43.956111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:43.956602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:43.957569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Adding query filter params (service_id=929e9839f9524b0a882ebec271a86929) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:43.958102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:43.960216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:43.982416 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1838/3656] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints?service_id=929e9839f9524b0a882ebec271a86929 => generated 501 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:43.983203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:43.999625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070de9a-56ee-4545-aab8-795bb6a7c1a0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.019814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.020517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.020804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.021084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.021825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Adding query filter params (service_id=2f53ad7e827e42fbaed258041d95769b) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:44.022137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.023797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.067974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.071080 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1819/3657] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:03:43 2022] GET /identity/v3/endpoints?service_id=2f53ad7e827e42fbaed258041d95769b => generated 502 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:03:44.105150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9c30-005f-45e0-9c52-f1179ce64442 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.125288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.126080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.127533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.128032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.134561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:44.135651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.140239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.174396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1839/3658] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 21:03:44 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:44.178799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.191292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088de6e-1e75-4a63-8770-9c2c04fbb360 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.213046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.214187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.214187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.214403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.215391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:44.215705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.217406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.263529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.267038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1820/3659] 10.222.0.39 () {58 vars in 1170 bytes} [Sat Jun 25 21:03:44 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:44.279120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62212b-8990-4c34-8e11-ef317c88d9a4 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.291571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.292271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.292612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.293058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.293803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.295460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.338650 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1840/3660] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:44 2022] POST /identity/v3/services => generated 289 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:44.340003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.353019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34303a-8707-4945-a1ad-b068ea28a69a tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.422607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.423392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.423575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.423821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.424737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.426617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.494862 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-336924900. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:44.494862 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:44.494862 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:44.578487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.579442 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1821/3661] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:03:44 2022] POST /identity/v3/endpoints => generated 359 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:44.584350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:44.597895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecfb0-b687-4cea-b5a3-c7cd8dbd76c9 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.633390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.634262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.634550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.634896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-336924900` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.635747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-336924900)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.637042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.639448 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1841/3662] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 21:03:44 2022] GET /identity/v3/regions/tempest-region-336924900 => generated 178 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:03:44.643757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.658062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836ae-36f0-43a5-a790-cd0a881fe98b tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.677073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.677959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.678241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.678514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/85551245d53942ee9bac6abc66309729` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.685103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=85551245d53942ee9bac6abc66309729)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.687292 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:44.687292 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:44.687292 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:44.688224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.722165 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2108736225. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:44.722165 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:44.722165 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:44.840903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1822/3663] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:03:44 2022] PATCH /identity/v3/endpoints/85551245d53942ee9bac6abc66309729 => generated 364 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:44.843582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.862132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d16b-db38-483f-9fc0-efa4d00fd463 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:44.922795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:44.927073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:44.928416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:44.929071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-2108736225` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:44.929918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2108736225)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:44.942207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:44.947978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1842/3664] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:03:44 2022] GET /identity/v3/regions/tempest-region-2108736225 => generated 180 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:44.952538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:44.975378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a1546-c666-4d31-8831-fee08cc2b0cf tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.005293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.011684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.013709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.014080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/85551245d53942ee9bac6abc66309729` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.035047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=85551245d53942ee9bac6abc66309729)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.041095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.076760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '85551245d53942ee9bac6abc66309729', 'request_id': 'req-64bca954-6419-41eb-aa76-ca04aaac2bd7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:45.117732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1823/3665] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:44 2022] DELETE /identity/v3/endpoints/85551245d53942ee9bac6abc66309729 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.119593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.135261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232aaa-c2b4-4c8c-bacc-dcb379ae34fc tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.176030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.179039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.179333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.179628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-2108736225` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.183818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2108736225)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.185737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.216352 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2108736225. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:45.216352 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:45.216352 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:45.241332 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1843/3666] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/regions/tempest-region-2108736225 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.242876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.269080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca954-6419-41eb-aa76-ca04aaac2bd7 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.308131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.314295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.314732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.315628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-336924900` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.316327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-336924900)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.318051 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:45.318051 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:45.318051 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:45.319402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.333993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:45.376300 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1824/3667] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/regions/tempest-region-336924900 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.381089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.397973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea46fb-779e-4aea-9b65-1a4eb38b920d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.450424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.451488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.451771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.453837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services/ae2e6259da794a21af64be607ddda9a2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.455893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ae2e6259da794a21af64be607ddda9a2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.457409 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:45.457409 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:45.457409 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:45.460626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.528184 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1844/3668] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/services/ae2e6259da794a21af64be607ddda9a2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.535655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.549485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d266a-f8a4-4a03-98e4-3b853affecf2 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.611506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.612495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.612791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.613078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/d54bf89823e14d8689a2b06baf92a944` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.637371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d54bf89823e14d8689a2b06baf92a944)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.641671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.657036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd54bf89823e14d8689a2b06baf92a944', 'request_id': 'req-02385cc5-0980-4fbf-8545-db737ecff7b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:45.685784 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1825/3669] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/endpoints/d54bf89823e14d8689a2b06baf92a944 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.690184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.710411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b049170-89e1-4fa5-ac08-d28719c6f467 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.734861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.736952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.737480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.738033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-214779636` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.741020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-214779636)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.743121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.761328 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-214779636. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:45.761328 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:45.761328 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:45.778881 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1845/3670] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/regions/tempest-region-214779636 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.782717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.798412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385cc5-0980-4fbf-8545-db737ecff7b3 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:45.857869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:45.859433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:45.861792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:45.862089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services/2f53ad7e827e42fbaed258041d95769b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:45.864493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2f53ad7e827e42fbaed258041d95769b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:45.864642 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:45.864642 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:45.864642 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:45.872031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:45.949914 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1826/3671] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/services/2f53ad7e827e42fbaed258041d95769b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:45.955065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:45.985429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45099-549c-43fd-b919-80e58763cdc6 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:46.045433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:46.052222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:46.052804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:46.057479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/endpoints/00055e9d06584a7db3b1f5efcd33fbd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:46.070947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=00055e9d06584a7db3b1f5efcd33fbd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:46.072367 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:46.072367 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:46.072367 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:46.074483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:46.105232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '00055e9d06584a7db3b1f5efcd33fbd9', 'request_id': 'req-a28632eb-fe2c-49ca-869e-693f62f7d656'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.136233 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1846/3672] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:45 2022] DELETE /identity/v3/endpoints/00055e9d06584a7db3b1f5efcd33fbd9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:46.137900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:46.161063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a527ec-a3e6-43db-8648-a488c8c92d1c tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:46.185356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:46.189325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:46.189842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:46.190398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/regions/tempest-region-462887097` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:46.191478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-462887097)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:46.193773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:46.213356 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-462887097. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:03:46.213356 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:03:46.213356 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:46.227826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1827/3673] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:03:46 2022] DELETE /identity/v3/regions/tempest-region-462887097 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:46.229036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:46.248963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28632eb-fe2c-49ca-869e-693f62f7d656 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:46.296984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08edf3acc33345819682f859754dd4c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '290847f3d8d5440086ef97ce256ebd4d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:46.298532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:46.303636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:46.304117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] PATH_INFO: `/v3/services/929e9839f9524b0a882ebec271a86929` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:46.305151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorizing `identity:delete_service(service_id=929e9839f9524b0a882ebec271a86929)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:46.306981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec8acd-9422-4716-90a6-38dabc68342d tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:46.388390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:46.389259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1847/3674] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:46 2022] DELETE /identity/v3/services/929e9839f9524b0a882ebec271a86929 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:46.612876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a47f7-30c6-4f85-90bb-d43a2c9642f0 tempest-EndPointsTestJSON-1408135221 tempest-EndPointsTestJSON-1408135221-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:46.653275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:46.654720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:46.657678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:46.658110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] PATH_INFO: `/v3/users/142221062b4b44fcae4c98d2caed5bd3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:46.668357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] RBAC: Authorizing `identity:delete_user(user_id=142221062b4b44fcae4c98d2caed5bd3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:46.670550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:46.788354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:46.828501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142221062b4b44fcae4c98d2caed5bd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.858354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142221062b4b44fcae4c98d2caed5bd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.885818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142221062b4b44fcae4c98d2caed5bd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.887449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142221062b4b44fcae4c98d2caed5bd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.888184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142221062b4b44fcae4c98d2caed5bd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:46.913672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1828/3675] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:46 2022] DELETE /identity/v3/users/142221062b4b44fcae4c98d2caed5bd3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:46.919292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:46.919686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:46.919897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:46.960787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:46.962051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:47.103360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:47.227698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1848/3676] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:47.249939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:47.251451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:47.372318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168aa8-39a1-43bf-8501-104753ab986d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:47.387415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:47.388345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:47.388758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:47.389140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:47.401676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:47.404976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:47.419703 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1829/3677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:49.162880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:49.166854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:49.211614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7d29b-af20-4797-aef5-52304a0332a6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:49.241432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:49.244538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:49.251247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:49.252036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] PATH_INFO: `/v3/projects/3dea7f29b99b4432a7b673c8a170aefb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:49.261271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dea7f29b99b4432a7b673c8a170aefb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:49.269594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:49.393587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dea7f29b99b4432a7b673c8a170aefb', 'request_id': 'req-36ce84f5-2b0c-422e-bf2f-e4b24f527862'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.412375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dea7f29b99b4432a7b673c8a170aefb', 'request_id': 'req-36ce84f5-2b0c-422e-bf2f-e4b24f527862'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.424638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dea7f29b99b4432a7b673c8a170aefb', 'request_id': 'req-36ce84f5-2b0c-422e-bf2f-e4b24f527862'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.485863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] The token cache is being invalidate because project 3dea7f29b99b4432a7b673c8a170aefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:49.491426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.496954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.500051 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1849/3678] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:49 2022] DELETE /identity/v3/projects/3dea7f29b99b4432a7b673c8a170aefb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:49.504064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:49.526920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721151-0254-4e98-81a9-02458d7a1c04 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:49.709484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:49.711076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:49.711512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:49.711944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] PATH_INFO: `/v3/users/08edf3acc33345819682f859754dd4c6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:49.713828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08edf3acc33345819682f859754dd4c6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:49.716715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:49.830354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08edf3acc33345819682f859754dd4c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.837546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:49.849077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08edf3acc33345819682f859754dd4c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.874812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08edf3acc33345819682f859754dd4c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.879158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08edf3acc33345819682f859754dd4c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.880038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c71de0ad-ce9d-402d-a7b6-1380cc83a262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08edf3acc33345819682f859754dd4c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:49.897430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1830/3679] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:49 2022] DELETE /identity/v3/users/08edf3acc33345819682f859754dd4c6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:51.994563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:51.997047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:52.024658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce84f5-2b0c-422e-bf2f-e4b24f527862 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:52.166004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:52.167017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:52.167258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:52.167479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] PATH_INFO: `/v3/projects/290847f3d8d5440086ef97ce256ebd4d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:52.178053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] RBAC: Authorizing `identity:delete_project(project_id=290847f3d8d5440086ef97ce256ebd4d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:52.181348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:52.317371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290847f3d8d5440086ef97ce256ebd4d', 'request_id': 'req-771ed088-04b8-4fda-b03f-c4604a68437b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:52.336364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290847f3d8d5440086ef97ce256ebd4d', 'request_id': 'req-771ed088-04b8-4fda-b03f-c4604a68437b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:52.343224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:52.346864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290847f3d8d5440086ef97ce256ebd4d', 'request_id': 'req-771ed088-04b8-4fda-b03f-c4604a68437b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:52.365020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] The token cache is being invalidate because project 290847f3d8d5440086ef97ce256ebd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:52.365530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:52.366515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-771ed088-04b8-4fda-b03f-c4604a68437b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:52.368648 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1850/3680] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:51 2022] DELETE /identity/v3/projects/290847f3d8d5440086ef97ce256ebd4d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:52.373282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:52.376903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:52.378321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:52.439134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:52.441435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:52.608944 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1831/3681] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:52.617015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:52.617250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:52.617472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:52.673675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:52.674916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:52.689764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1851/3682] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:52.694150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:52.718515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daeb94-365c-4061-856b-22f0d2dfbefb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:52.740301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:52.741143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:52.741493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:52.741838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:52.742650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:52.743018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:52.746935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:52.783214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1832/3683] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:52.787312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:52.800905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374e1ca-137d-4840-b1af-e51e53710202 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:52.849165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:52.857203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:52.857720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:52.858171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:52.860401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:52.863189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:53.047434 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1852/3684] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:52 2022] POST /identity/v3/projects => generated 369 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:53.049611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:53.068506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320296c7-2f95-474b-ad2c-04ac1714d916 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:53.260539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:53.263485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.263793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.264070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.264989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:53.271155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bd61-86b7-402b-b526-90e737585756 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:53.322737 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1833/3685] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:53 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:53.325335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:53.346901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855621a-5167-4ebd-8867-49ff01f94178 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:53.350341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.350582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.350844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.359403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:53.360502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.361003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.361511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.362456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:53.364309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:53.398076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1853/3686] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:53.399837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:53.417433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7423-5636-450e-8309-84f3cc4ca1e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:53.422778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] MFA Rules not processed for user `f46fff9b561e4959975edfffe24e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:53.426705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:53.429152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:53.430336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.430784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.431355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.432255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:53.435205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:53.463816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1854/3687] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:53.465907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:53.490110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4416a0-e39f-4a4d-835e-112932fc8d8b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:53.499420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:53.500337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.500646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.500925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] PATH_INFO: `/v3/projects/436e563d2590411fa709195d92f94cc7/users/26f16cf153814952abea2a5b8138ff76/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.518844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:53.531926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=436e563d2590411fa709195d92f94cc7, user_id=26f16cf153814952abea2a5b8138ff76, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:53.534769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85136c-4101-4208-8b2a-2e1a2ba8cd8d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:53.568473 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1855/3688] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:53 2022] PUT /identity/v3/projects/436e563d2590411fa709195d92f94cc7/users/26f16cf153814952abea2a5b8138ff76/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:53.597732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1834/3689] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:03:53.650746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.651038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.651388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.698801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] MFA Rules not processed for user `26f16cf153814952abea2a5b8138ff76`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:53.700537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:53.809745 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1856/3690] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:53.814901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:53.836102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf86c4-ebb5-40f7-8302-98e5409cdbbb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:53.970384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:53.971129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:53.971415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:53.971847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:53.973930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:53.982467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.043643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.046638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:54.073634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1835/3691] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:53 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:54.074987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.195940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4736e-dccf-4b69-961a-3f969a52070f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.202224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.203260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.203547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.203836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.204577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.206531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.234121 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1836/3692] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:54 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:54.239299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.241056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:54.276458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96bdac-0922-41cf-8868-82eb5dc32539 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.296639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.296639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.297124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.298762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.299746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.303662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb31650-8002-47f2-8bdf-e0f66a605bbe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.306624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.347514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1837/3693] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:54.351460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.396963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ad76-f17f-45d9-9c02-5f468142897e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.402681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.403597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.403880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.404159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] PATH_INFO: `/v3/projects/e720b68c13724855983e9da1109c3ba3/users/f2569798eef44ec4a6f2aa9fe62f1663/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.462931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e720b68c13724855983e9da1109c3ba3, user_id=f2569798eef44ec4a6f2aa9fe62f1663, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.473554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.512813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.512813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.513099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.514343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.519725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1838/3694] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:54 2022] PUT /identity/v3/projects/e720b68c13724855983e9da1109c3ba3/users/f2569798eef44ec4a6f2aa9fe62f1663/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:54.523653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.558271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:54.609759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.612495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.648002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1857/3695] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:54.663046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74218a8-8040-45d9-9586-d5ef50eea2b2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.676213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.677047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.677424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.677812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.678651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.680404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.712019 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1839/3696] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:03:54.715224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.732636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2955ae-3191-4e34-a55c-e1a98bface15 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.753809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.755561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.756095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.756617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] PATH_INFO: `/v3/projects/e720b68c13724855983e9da1109c3ba3/users/f2569798eef44ec4a6f2aa9fe62f1663/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.760368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e720b68c13724855983e9da1109c3ba3, user_id=f2569798eef44ec4a6f2aa9fe62f1663, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.766138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e22f1-dc24-4149-8fd6-1831cd244251 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:54.784079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:54.786022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:54.793331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1858/3697] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:54 2022] PUT /identity/v3/projects/e720b68c13724855983e9da1109c3ba3/users/f2569798eef44ec4a6f2aa9fe62f1663/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:54.806514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c19c-ffa9-4055-993f-48cd43432dd9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:54.833672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.834083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.834659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.887310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] MFA Rules not processed for user `f2569798eef44ec4a6f2aa9fe62f1663`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:54.890058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:54.988146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:54.989204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:54.989582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:54.989954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] PATH_INFO: `/v3/users/1253f8908e434038b07f5e2ed7d15d30` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:54.991949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1253f8908e434038b07f5e2ed7d15d30)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:54.994236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.042658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1859/3698] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:55.048345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.053404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:55.069913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54509c82-d88b-4100-adf9-14fbefc7da2e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.090127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.091103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.091564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.092045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.093394 ncdv-master-1 devstack@keystone.service[97720]: WARNING oslo_log.versionutils [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.094160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.097630 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.097630 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:55.097630 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:55.098933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.120451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1253f8908e434038b07f5e2ed7d15d30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:55.148698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1253f8908e434038b07f5e2ed7d15d30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:55.160663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1860/3699] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:55 2022] POST /identity/v3/policies => generated 229 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:55.168063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1253f8908e434038b07f5e2ed7d15d30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:55.168944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1253f8908e434038b07f5e2ed7d15d30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:55.169675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1253f8908e434038b07f5e2ed7d15d30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:55.172413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.182217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:55.200304 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1840/3700] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:54 2022] DELETE /identity/v3/users/1253f8908e434038b07f5e2ed7d15d30 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:55.206394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa9b5-7347-40df-afb8-7f3a813c2e14 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.336497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.339446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.340098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.340389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.344859 ncdv-master-1 devstack@keystone.service[97720]: WARNING oslo_log.versionutils [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.347874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=555efbd8dfcf486ba1ad98cab6a6ccb8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.349683 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.349683 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:55.349683 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:55.353187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.412930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1861/3701] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:03:55 2022] PATCH /identity/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8 => generated 236 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:55.417095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.434903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afb897-8b60-42db-a367-32ead2373418 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.445606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.446701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.447188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.447467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.448540 ncdv-master-1 devstack@keystone.service[97719]: WARNING oslo_log.versionutils [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.449238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=555efbd8dfcf486ba1ad98cab6a6ccb8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.450776 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.450776 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:55.450776 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:55.461553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.481912 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1841/3702] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:03:55 2022] GET /identity/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8 => generated 236 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:55.485046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.504285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4215414-c481-437e-9ccc-0472bd8475d4 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.537690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.538775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.539225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.539664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.540686 ncdv-master-1 devstack@keystone.service[97720]: WARNING oslo_log.versionutils [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.541923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=555efbd8dfcf486ba1ad98cab6a6ccb8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.550612 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.550612 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:55.550612 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:55.552203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.583300 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1862/3703] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:55 2022] DELETE /identity/v3/policies/555efbd8dfcf486ba1ad98cab6a6ccb8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:55.588903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.615178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5192d2-f18b-4f85-b6d9-dc4871d014f9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.635615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.636414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.637522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.639074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.641190 ncdv-master-1 devstack@keystone.service[97719]: WARNING oslo_log.versionutils [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.644224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.646220 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.646220 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:55.646220 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:55.650548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.704870 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1842/3704] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:55 2022] POST /identity/v3/policies => generated 230 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:55.707446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.749015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f048-8dff-4551-9d51-a359b770fc46 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.762052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.762709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.763479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.763773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.765153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.767083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.828971 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1863/3705] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:55 2022] POST /identity/v3/policies => generated 229 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:55.830565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.846310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffb417-d8ca-4a53-b5e6-2d0dc7df4d62 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.863768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.865074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.865584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.866242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.867853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.870296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:55.877360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:55.910801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:55.915503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1843/3706] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:03:55 2022] POST /identity/v3/policies => generated 229 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:55.933736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378529-e34e-4a66-94ed-e3ccfbc4066d tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:55.970819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:55.975121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:55.975423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:55.976249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:55.976600 ncdv-master-1 devstack@keystone.service[97720]: WARNING oslo_log.versionutils [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:55.977224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:55.982665 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:55.982665 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:03:55.982665 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:03:55.985984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.016864 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1864/3707] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:03:55 2022] GET /identity/v3/policies => generated 764 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:03:56.018179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:56.047617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddb510-95f8-4773-a69f-6bf52a453cdd tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:56.053843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:56.055042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.055476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.055898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/6cc7b96387bd427699904414caff98b4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.056880 ncdv-master-1 devstack@keystone.service[97719]: WARNING oslo_log.versionutils [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 25 21:03:56.057747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6cc7b96387bd427699904414caff98b4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:56.059138 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:56.059138 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:03:56.059138 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:03:56.060333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.082868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1844/3708] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:56 2022] DELETE /identity/v3/policies/6cc7b96387bd427699904414caff98b4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:56.088079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:56.100727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87282ea1-4318-499b-b980-0b1aa6995a49 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:56.107262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:56.108198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.109023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.109311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/cadf37356f9c46799dc0faa125d1d1a3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.111260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=cadf37356f9c46799dc0faa125d1d1a3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:56.113397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.155263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1865/3709] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:56 2022] DELETE /identity/v3/policies/cadf37356f9c46799dc0faa125d1d1a3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:56.159692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:56.171850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f34e6-9a29-46fd-8047-18ee34ed53c9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:56.177501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2569798eef44ec4a6f2aa9fe62f1663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e720b68c13724855983e9da1109c3ba3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:56.178602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.179111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.179551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] PATH_INFO: `/v3/policies/b257482788244f0285d3e43d3e33d369` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.180874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b257482788244f0285d3e43d3e33d369)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:56.182852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.211194 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1845/3710] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:56 2022] DELETE /identity/v3/policies/b257482788244f0285d3e43d3e33d369 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:56.218390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:56.220712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:56.343382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332119-7e60-47bb-b0df-3c8f9abe92d7 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:56.348988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:56.350331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.350626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.350976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] PATH_INFO: `/v3/users/26f16cf153814952abea2a5b8138ff76` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.352325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f16cf153814952abea2a5b8138ff76)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:56.354426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.422000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:56.450913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f16cf153814952abea2a5b8138ff76'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.452175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f16cf153814952abea2a5b8138ff76'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.472014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f16cf153814952abea2a5b8138ff76'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.515728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f16cf153814952abea2a5b8138ff76'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.559002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:56.562662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:56.591232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c4fa52f-297c-47b1-913f-2c3d6a6f8016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f16cf153814952abea2a5b8138ff76'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.623248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316e13-8556-49f2-a1cf-4e73b39878b9 tempest-PoliciesTestJSON-1569551464 tempest-PoliciesTestJSON-1569551464-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:56.630671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1866/3711] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:56 2022] DELETE /identity/v3/users/26f16cf153814952abea2a5b8138ff76 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:56.640810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3113b-31b9-4925-8c3f-2435679f8294 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.640810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3113b-31b9-4925-8c3f-2435679f8294 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.640810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3113b-31b9-4925-8c3f-2435679f8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.644749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:56.645635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.645916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.646192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] PATH_INFO: `/v3/projects/663694278b344fe7896f524fac12ffcc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.655810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663694278b344fe7896f524fac12ffcc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:56.669825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:56.717724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1ad3113b-31b9-4925-8c3f-2435679f8294 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:56.720326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1ad3113b-31b9-4925-8c3f-2435679f8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:56.869463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1867/3712] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:56.880210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663694278b344fe7896f524fac12ffcc', 'request_id': 'req-87a61590-9a23-4ee6-b154-cd496e8ee403'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.912681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663694278b344fe7896f524fac12ffcc', 'request_id': 'req-87a61590-9a23-4ee6-b154-cd496e8ee403'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.923076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049378f6-33e1-4a53-a109-807bdc1ca838 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:56.923537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049378f6-33e1-4a53-a109-807bdc1ca838 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:56.923963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049378f6-33e1-4a53-a109-807bdc1ca838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:56.925163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663694278b344fe7896f524fac12ffcc', 'request_id': 'req-87a61590-9a23-4ee6-b154-cd496e8ee403'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.957515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-049378f6-33e1-4a53-a109-807bdc1ca838 None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:56.959066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-049378f6-33e1-4a53-a109-807bdc1ca838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:56.984356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] The token cache is being invalidate because project 663694278b344fe7896f524fac12ffcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:56.984746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:56.986825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:57.000573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1846/3713] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:56 2022] DELETE /identity/v3/projects/663694278b344fe7896f524fac12ffcc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:57.004912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.009097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:57.123611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61590-9a23-4ee6-b154-cd496e8ee403 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.130623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.131785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.132116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.132465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.134869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:57.198097 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1868/3714] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:57.199809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.203571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.203992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.226756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:57.229956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.234898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea3b4-4635-4e3b-b2c9-9ac5b2511108 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.252695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1847/3715] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:57.264577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:57.266128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:57.295673 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1869/3716] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:57.299560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.300081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.300581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.345200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:57.348015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:57.365849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1848/3717] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:57.366629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.387832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2273-6366-485a-90d3-18f66c4a382c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.398794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.400177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.400491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.400775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.401522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:03:57.401830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.407314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.447214 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1870/3718] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:03:57.450581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.468572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b4ff-2fee-4f98-a896-4cd07351c5c5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.483080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.483781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.484150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.484333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.485090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.493413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.571832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.572845 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1849/3719] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:03:57 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:03:57.591237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fbfb3-d984-47e5-bbbb-c8806a6aa427 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.657013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:57.770036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.770744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.771025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.771302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.772368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.774477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.810547 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1871/3720] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:03:57 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:03:57.824528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.844630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26a42d-0abf-480f-9e29-415c7a9c8336 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.863793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.865168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.865453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.865800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.877291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.878966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.906306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1850/3721] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:57.906972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.918369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff742f-8976-4026-9f4d-03348bbf3ea6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.932269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.933224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.933935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.934452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:57.935366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:57.937741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631668-4a36-47f1-a07d-6c62fc6ce350 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:57.961430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:57.973263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1872/3722] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:03:57.978231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886d01-b081-48a7-86fc-c1aa0b35592e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:57.984035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:57.986797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:57.987296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:57.987790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] PATH_INFO: `/v3/projects/9a930bf73f9845e6b079820ec7b14906/users/fcef2a65be9443dda5cbe7c3d77d6295/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:58.011807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a930bf73f9845e6b079820ec7b14906, user_id=fcef2a65be9443dda5cbe7c3d77d6295, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:58.015094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:58.108063 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1851/3723] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:03:57 2022] PUT /identity/v3/projects/9a930bf73f9845e6b079820ec7b14906/users/fcef2a65be9443dda5cbe7c3d77d6295/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:58.114177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:58.114764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:58.115223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:58.157680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:03:58.161929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:58.359907 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1873/3724] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:03:58.405107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:58.406971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:58.550123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1923-3a7d-4d9d-bfb0-bdedf3b47c5c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:58.553750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:58.554540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:58.554689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:58.554972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:58.571833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:58.574016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:58.592755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1852/3725] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:03:59.389180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:59.392744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:03:59.424197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b24f-4891-474d-8c42-e484dfc94773 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:59.437821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:59.439056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:59.439547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:59.441261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] PATH_INFO: `/v3/projects/436e563d2590411fa709195d92f94cc7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:59.442772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436e563d2590411fa709195d92f94cc7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:59.448907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:03:59.582527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436e563d2590411fa709195d92f94cc7', 'request_id': 'req-a7fad615-a630-4a1c-93cc-2fa44678c7b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:59.599908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436e563d2590411fa709195d92f94cc7', 'request_id': 'req-a7fad615-a630-4a1c-93cc-2fa44678c7b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:59.614910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436e563d2590411fa709195d92f94cc7', 'request_id': 'req-a7fad615-a630-4a1c-93cc-2fa44678c7b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:59.644059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] The token cache is being invalidate because project 436e563d2590411fa709195d92f94cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:03:59.644335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:59.658096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7fad615-a630-4a1c-93cc-2fa44678c7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:03:59.661126 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1874/3726] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:59 2022] DELETE /identity/v3/projects/436e563d2590411fa709195d92f94cc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:03:59.665067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:03:59.675613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649fa6-f8a3-44e0-abbf-6accbb780e9b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:03:59.962587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:03:59.963797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:03:59.964193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:03:59.964511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] PATH_INFO: `/v3/users/f2569798eef44ec4a6f2aa9fe62f1663` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:03:59.966933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2569798eef44ec4a6f2aa9fe62f1663)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:03:59.981813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:00.099263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:00.141491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2569798eef44ec4a6f2aa9fe62f1663'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:00.177074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2569798eef44ec4a6f2aa9fe62f1663'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:00.242942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2569798eef44ec4a6f2aa9fe62f1663'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:00.247577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2569798eef44ec4a6f2aa9fe62f1663'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:00.250151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2569798eef44ec4a6f2aa9fe62f1663'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:00.298959 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1853/3727] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:03:59 2022] DELETE /identity/v3/users/f2569798eef44ec4a6f2aa9fe62f1663 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:01.463861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6b76-1144-4412-b77e-529f677371c4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:01.464354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6b76-1144-4412-b77e-529f677371c4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:01.464481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6b76-1144-4412-b77e-529f677371c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:01.516660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-94be6b76-1144-4412-b77e-529f677371c4 None None] MFA Rules not processed for user `f46fff9b561e4959975edfffe24e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:01.517733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:01.520245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:01.535138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94be6b76-1144-4412-b77e-529f677371c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:01.611155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:01.674760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1875/3728] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:01.692542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce01152-737a-4e78-9b1a-4b7292f56e71 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:01.709825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:01.717666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:01.718288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:01.718789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] PATH_INFO: `/v3/projects/e720b68c13724855983e9da1109c3ba3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:01.720519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e720b68c13724855983e9da1109c3ba3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:01.723889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:01.865222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e720b68c13724855983e9da1109c3ba3', 'request_id': 'req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:01.881329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e720b68c13724855983e9da1109c3ba3', 'request_id': 'req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:01.901851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e720b68c13724855983e9da1109c3ba3', 'request_id': 'req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:01.959239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] The token cache is being invalidate because project e720b68c13724855983e9da1109c3ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:01.961503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:01.964059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb5084ac-b2ed-4ebc-9a4e-3625ff38ef28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:01.970511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1854/3729] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:01 2022] DELETE /identity/v3/projects/e720b68c13724855983e9da1109c3ba3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:01.975904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:01.976722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:01.977247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.062142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:02.070941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:02.185304 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1876/3730] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:02.194081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.194374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.194658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.237928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:02.239207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:02.275793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1855/3731] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:02.277757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.291689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c15b1-2d10-4a0f-ad06-d549803a82ac None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:02.302179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:02.302826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.303100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.303371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.304104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:02.304406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:02.311154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:02.360508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.360757 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1877/3732] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:02.382236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b894a2-763b-4822-a391-c2bfce275852 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:02.415016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:02.419257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.422997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.423285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.427737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:02.429813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:02.530930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1856/3733] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:02 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:02.534757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.548970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b229ee-88fb-4376-a7e5-ca16649f5366 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:02.731305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:02.736513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.737221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.737661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.738551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:02.740761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:02.782563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1878/3734] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:02 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:02.786791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.800437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b56b4-a2ed-4d72-93a2-ac097a3d61a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:02.809624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:02.809986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.810447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.811078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.811977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:02.813808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:02.852771 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1857/3735] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:02.863279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.882472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085db-2f25-48f9-ba38-b3cbcb43c29a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:02.887855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:02.888651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:02.889407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:02.889954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:02.890830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:02.893493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dcfcb-3b72-49f4-b29a-e198f9512a49 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:02.909214 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1879/3736] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:02.910478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:02.923242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:02.931352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b84fe-f817-43ec-b1f1-a0e1b76ad636 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:03.006353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:03.007936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:03.008223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:03.008525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] PATH_INFO: `/v3/projects/7e7a16e0d56d4e7485067f68eaaf50e6/users/0a854ce8821d4a34b6952cf4454923a0/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:03.049893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7a16e0d56d4e7485067f68eaaf50e6, user_id=0a854ce8821d4a34b6952cf4454923a0, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:03.058439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:03.099906 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1858/3737] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:02 2022] PUT /identity/v3/projects/7e7a16e0d56d4e7485067f68eaaf50e6/users/0a854ce8821d4a34b6952cf4454923a0/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:03.111982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13809cdf-b812-4b47-995f-534d9333707b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:03.112281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13809cdf-b812-4b47-995f-534d9333707b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:03.112610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13809cdf-b812-4b47-995f-534d9333707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:03.196799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13809cdf-b812-4b47-995f-534d9333707b None None] MFA Rules not processed for user `0a854ce8821d4a34b6952cf4454923a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:03.198437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13809cdf-b812-4b47-995f-534d9333707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:03.266195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:03.359770 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1880/3738] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:03.364484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:03.548610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5890-04d7-445a-80a5-f8aace108951 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:03.566930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:03.568852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:03.573089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:03.573793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:03.575210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:03.580005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:03.657690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1859/3739] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:03 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:04:03.661512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13809cdf-b812-4b47-995f-534d9333707b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:03.677963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13809cdf-b812-4b47-995f-534d9333707b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:03.912985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:03.913786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:03.914155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:03.916853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:03.931305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:03.934421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:03.985531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1881/3740] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:03 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:03.987046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:03.999964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2da5e-e362-46a2-8c7a-a8283456b573 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:04.035927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:04.035927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.035927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.035927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.041770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:04.050064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:04.079482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1860/3741] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:04.084864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:04.109295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebd82-d280-458e-960f-b0c38b9bdb61 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:04.132093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:04.133331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.134395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.135007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] PATH_INFO: `/v3/projects/d60cb78ef0b841589bb40696b96dae13/users/6b1e030570bd4c078604d88615a35825/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.175091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60cb78ef0b841589bb40696b96dae13, user_id=6b1e030570bd4c078604d88615a35825, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:04.180542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:04.230624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1882/3742] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:04 2022] PUT /identity/v3/projects/d60cb78ef0b841589bb40696b96dae13/users/6b1e030570bd4c078604d88615a35825/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:04.234620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:04.249272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727117-2716-41de-a179-5b13941a9708 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:04.424326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:04.429256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.431280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.432015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.434440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:04.437766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141579-b5fc-43fc-b3a9-77903c197509 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:04.474985 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1861/3743] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:04.476596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:04.493925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8dcd8-92c7-4d6d-ae0e-79074ce43a08 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:04.506283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:04.507375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.507770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.508152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] PATH_INFO: `/v3/projects/d60cb78ef0b841589bb40696b96dae13/users/6b1e030570bd4c078604d88615a35825/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.513564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60cb78ef0b841589bb40696b96dae13, user_id=6b1e030570bd4c078604d88615a35825, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:04.516330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:04.529593 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1883/3744] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:04 2022] PUT /identity/v3/projects/d60cb78ef0b841589bb40696b96dae13/users/6b1e030570bd4c078604d88615a35825/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:04.539700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.540142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.540563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.607213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] MFA Rules not processed for user `6b1e030570bd4c078604d88615a35825`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:04.609456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:04.710991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:04.777534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1862/3745] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:04.782568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:04.798149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab6ca-f1ba-43fd-8bf6-c0943a3d4dc3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:04.837016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1e030570bd4c078604d88615a35825', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd60cb78ef0b841589bb40696b96dae13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:04.839108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:04.840827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:04.844402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:04.846351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:04.855592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:04.969562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1884/3746] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:04 2022] POST /identity/v3/projects => generated 358 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:04.970957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:05.184647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b5374-2ba5-4d4e-9ca4-8cd5e1b83e38 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:05.370842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a854ce8821d4a34b6952cf4454923a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e7a16e0d56d4e7485067f68eaaf50e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:05.372678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:05.373189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:05.373836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] PATH_INFO: `/v3/projects/aa0213d6c72842f1939fd258dd05fbf3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:05.401853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] RBAC: Authorizing `identity:delete_project(project_id=aa0213d6c72842f1939fd258dd05fbf3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jun 25 21:04:05.436795 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 25 21:04:05.437868 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:04:05.443284 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1863/3747] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:04 2022] DELETE /identity/v3/projects/aa0213d6c72842f1939fd258dd05fbf3 => generated 136 bytes in 473 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:04:05.448280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:05.512743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:05.517181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:05.791645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:05.806967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473857d-1444-4708-8ca4-1b9c6fa6bff0 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:05.835006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b1e030570bd4c078604d88615a35825', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd60cb78ef0b841589bb40696b96dae13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:05.837548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc2c34-d5a7-4cea-befd-38fcfacea105 tempest-ProjectsNegativeTestJSON-1278033159 tempest-ProjectsNegativeTestJSON-1278033159-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:05.847999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:05.852111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:05.852872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] PATH_INFO: `/v3/projects/aa0213d6c72842f1939fd258dd05fbf3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:05.854790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa0213d6c72842f1939fd258dd05fbf3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:05.857178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:05.858702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:05.859240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:05.859538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:05.859823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:05.869762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:05.918388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:05.919907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:05.961959 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1864/3748] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:04:05.981122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0213d6c72842f1939fd258dd05fbf3', 'request_id': 'req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:05.994575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0213d6c72842f1939fd258dd05fbf3', 'request_id': 'req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.004688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0213d6c72842f1939fd258dd05fbf3', 'request_id': 'req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.021662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] The token cache is being invalidate because project aa0213d6c72842f1939fd258dd05fbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:06.022356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.023611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93673e0e-6d4b-43d3-8d57-d60f27ef2d96 tempest-ProjectsNegativeTestJSON-1190160231 tempest-ProjectsNegativeTestJSON-1190160231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.030747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:06.031285 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1885/3749] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:05 2022] DELETE /identity/v3/projects/aa0213d6c72842f1939fd258dd05fbf3 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:06.158592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:06.214156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8009-7ea4-4b74-b062-513911b36632 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:06.340960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:06.344540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:06.344855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:06.345115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] PATH_INFO: `/v3/users/0a854ce8821d4a34b6952cf4454923a0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:06.348188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a854ce8821d4a34b6952cf4454923a0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:06.351295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:06.450010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a854ce8821d4a34b6952cf4454923a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.471349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a854ce8821d4a34b6952cf4454923a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.492976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb924b9-e0f6-419d-9907-d00a6ee6dfff None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:06.493846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb924b9-e0f6-419d-9907-d00a6ee6dfff None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:06.495146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb924b9-e0f6-419d-9907-d00a6ee6dfff None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:06.496717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1886/3750] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:04:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:04:06.511255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:06.512906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:06.513336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:06.514479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a854ce8821d4a34b6952cf4454923a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.517446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a854ce8821d4a34b6952cf4454923a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.520894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ac8caa7-f9f9-41a0-bc23-0f3874689877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a854ce8821d4a34b6952cf4454923a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:06.549287 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1865/3751] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:06 2022] DELETE /identity/v3/users/0a854ce8821d4a34b6952cf4454923a0 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:04:06.553491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:06.553786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:06.554068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:06.580548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:06.587318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:06.592167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:06.593465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:06.782754 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1887/3752] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:06.793286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1866/3753] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:06.814714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:06.819171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:06.843072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afbc5-35e5-4e9d-ae3e-8ce92affe912 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:06.852167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:06.853267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:06.857538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:06.858327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:06.872169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:06.875641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:06.891126 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1888/3754] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:06.990821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:06.992270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:07.002082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:07.176177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32984e-7b92-4bce-8819-4447c84b48bd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:07.186690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:07.187887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:07.187887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:07.187887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:07.209756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:07.212417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:07.261746 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1867/3755] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:09.368206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:09.370791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:09.420441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6672-be53-4bf8-9966-0253051c43ac service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:09.439841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:09.441336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:09.442230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:09.444846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] PATH_INFO: `/v3/projects/7e7a16e0d56d4e7485067f68eaaf50e6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:09.446663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7a16e0d56d4e7485067f68eaaf50e6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:09.449892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:09.597496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7a16e0d56d4e7485067f68eaaf50e6', 'request_id': 'req-62847493-1d18-4361-bbf9-8bb11396cd80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:09.615641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7a16e0d56d4e7485067f68eaaf50e6', 'request_id': 'req-62847493-1d18-4361-bbf9-8bb11396cd80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:09.617567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:09.625576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7a16e0d56d4e7485067f68eaaf50e6', 'request_id': 'req-62847493-1d18-4361-bbf9-8bb11396cd80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:09.652676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] The token cache is being invalidate because project 7e7a16e0d56d4e7485067f68eaaf50e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:09.653484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:09.654001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:09.656396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1889/3756] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:09 2022] DELETE /identity/v3/projects/7e7a16e0d56d4e7485067f68eaaf50e6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:04:09.660612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:09.675109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6c74-f429-45e7-a356-82936deed0f5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:09.845042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:09.845945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:09.846229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:09.846508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] PATH_INFO: `/v3/users/6b1e030570bd4c078604d88615a35825` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:09.849146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1e030570bd4c078604d88615a35825)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:09.851127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:10.009051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1e030570bd4c078604d88615a35825'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:10.037576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1e030570bd4c078604d88615a35825'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:10.063928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1e030570bd4c078604d88615a35825'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:10.064843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1e030570bd4c078604d88615a35825'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:10.065575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f3dcb94e-4d9d-44d4-aeb4-efd0ff761bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1e030570bd4c078604d88615a35825'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:10.088548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1868/3757] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:09 2022] DELETE /identity/v3/users/6b1e030570bd4c078604d88615a35825 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:10.992073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:10.993661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:11.034502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847493-1d18-4361-bbf9-8bb11396cd80 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.169018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bc6e-bd4c-4ded-beb9-3afd7e8f3e2e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.169562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bc6e-bd4c-4ded-beb9-3afd7e8f3e2e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.169777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bc6e-bd4c-4ded-beb9-3afd7e8f3e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.180689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.182087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.182532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.182969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] PATH_INFO: `/v3/projects/d60cb78ef0b841589bb40696b96dae13` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.184491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60cb78ef0b841589bb40696b96dae13)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.186677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:11.217965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-20f8bc6e-bd4c-4ded-beb9-3afd7e8f3e2e None None] MFA Rules not processed for user `fcef2a65be9443dda5cbe7c3d77d6295`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:11.219241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-20f8bc6e-bd4c-4ded-beb9-3afd7e8f3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:11.241360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:11.255951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60cb78ef0b841589bb40696b96dae13', 'request_id': 'req-cbcdd4d3-402c-4ca8-ae20-1796c036582e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:11.271789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60cb78ef0b841589bb40696b96dae13', 'request_id': 'req-cbcdd4d3-402c-4ca8-ae20-1796c036582e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:11.283376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60cb78ef0b841589bb40696b96dae13', 'request_id': 'req-cbcdd4d3-402c-4ca8-ae20-1796c036582e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:11.300935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] The token cache is being invalidate because project d60cb78ef0b841589bb40696b96dae13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:11.301558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:11.302312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbcdd4d3-402c-4ca8-ae20-1796c036582e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:11.308523 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1890/3758] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:10 2022] DELETE /identity/v3/projects/d60cb78ef0b841589bb40696b96dae13 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:11.310456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.310802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.311085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.351532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:11.355035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:11.374305 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1869/3759] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:11.467692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1891/3760] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:11.477348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.477733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.478767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.511626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:11.512931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:11.531209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1870/3761] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:11.533785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:11.552858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fc44-9e9b-4ecb-8bc2-053d241e3da7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.559591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:11.560579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711423-e591-4864-b449-b9829961b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.561342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711423-e591-4864-b449-b9829961b24b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.561471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:11.561978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711423-e591-4864-b449-b9829961b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.561978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711423-e591-4864-b449-b9829961b24b admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.562682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22711423-e591-4864-b449-b9829961b24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:11.562922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22711423-e591-4864-b449-b9829961b24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.564717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22711423-e591-4864-b449-b9829961b24b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:11.578203 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1892/3762] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:11.582121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711423-e591-4864-b449-b9829961b24b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:11.604927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:11.616234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711423-e591-4864-b449-b9829961b24b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.625769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.626824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.627174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.627548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.628315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.630414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:11.674381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1893/3763] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:11 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:11.676899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:11.689445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8be2-5fd1-488a-8c80-7d10acab7b8e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.797844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.798693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.799432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.799830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.831102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853e94-e542-4ac6-b14a-3200e10e1a83 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.849256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.850647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.851097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.851557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.852485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.855345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:11.882649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:11.909205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.912566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:11.917850 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1894/3764] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:11 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:11.923165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:11.927427 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1871/3765] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:11.965267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594bfb-d6b9-449d-a5ed-8125207864a0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:11.979026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:11.979806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:11.980114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:11.980394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:11.981274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:11.983045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.012062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1895/3766] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:12.016902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:12.037506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0866-b85b-4657-8307-087ca1302627 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:12.047905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:12.048722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.049077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.051156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.052307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:12.063104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66028c03-12b7-48fe-9aea-8463b26627b3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.110838 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1872/3767] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:12.112237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:12.132118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0e35-d15c-4edf-af93-e26f7d2c8e49 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:12.147249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:12.149270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.153030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.153293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] PATH_INFO: `/v3/projects/4acb0c3dd300401cb726670901ec3166/users/a0067ef27f2c4ed28a8e94b3c9113183/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.178548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acb0c3dd300401cb726670901ec3166, user_id=a0067ef27f2c4ed28a8e94b3c9113183, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:12.182334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.202229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1896/3768] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:12 2022] PUT /identity/v3/projects/4acb0c3dd300401cb726670901ec3166/users/a0067ef27f2c4ed28a8e94b3c9113183/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:12.214507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.215617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.215617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.297689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] MFA Rules not processed for user `a0067ef27f2c4ed28a8e94b3c9113183`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:12.302556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:12.444851 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1873/3769] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:12.446370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:12.462008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaffda7-2a95-495f-8a2d-e3ce62f2696a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:12.476669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:12.477614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.477900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.478175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.478921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:create_application_credential(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:12.480107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.667942 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1897/3770] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:04:12 2022] POST /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials => generated 920 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:12.672484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:12.690910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12ce54-8633-480a-8c58-d56a46ddf22a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:12.713188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:12.714206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.714466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.715113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/ac582fb4c98e411e9bbdd8c6f5c258c8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.721403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:delete_access_rule(user_id=a0067ef27f2c4ed28a8e94b3c9113183, access_rule_id=ac582fb4c98e411e9bbdd8c6f5c258c8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:12.722866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application session.delete(ref) Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application yield resource Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 21:04:12.849548 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise self.value Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application session.commit() Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.flush() Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 21:04:12.850730 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application compat.raise_( Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._synchronize( Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise AssertionError( Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jun 25 21:04:12.851693 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:04:12.852734 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:04:12.853768 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1874/3771] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 25 21:04:12 2022] DELETE /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/ac582fb4c98e411e9bbdd8c6f5c258c8 => generated 89 bytes in 179 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:04:12.856993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:12.878485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35e1dc-25fb-43a4-9b84-2ff81aa7f7ef tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:12.893405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:12.894814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:12.895290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:12.897356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials/c44cb4bebe2c43f38f60f538cdaf281e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:12.942797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a0067ef27f2c4ed28a8e94b3c9113183, application_credential_id=c44cb4bebe2c43f38f60f538cdaf281e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:12.952091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:12.959972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:12.994926 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1898/3772] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:04:12 2022] DELETE /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials/c44cb4bebe2c43f38f60f538cdaf281e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:12.999081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.017402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16734-f39a-45cc-8118-49dd043b54e4 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.028731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.030021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.030391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.030761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.038812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:list_access_rules(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.040787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.052561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1875/3773] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:04:12 2022] GET /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules => generated 369 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:04:13.056922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.074563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994599-f816-4200-a60c-05de22b06565 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.081198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.082269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.082622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.082964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/ac582fb4c98e411e9bbdd8c6f5c258c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.089386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:delete_access_rule(user_id=a0067ef27f2c4ed28a8e94b3c9113183, access_rule_id=ac582fb4c98e411e9bbdd8c6f5c258c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.091323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.148804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1899/3774] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 25 21:04:13 2022] DELETE /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/ac582fb4c98e411e9bbdd8c6f5c258c8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:13.153810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.168572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddea63a-e4f4-49b1-80b3-23f8a833851c tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.175912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.177683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.180651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.181109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.184067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:list_access_rules(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.187616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.203456 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1876/3775] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:04:13 2022] GET /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules => generated 158 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:13.204392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.221794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0d1b-2f96-45fe-9f5f-4f2d2d1bfac9 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.236741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.237918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.238207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.238486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.240533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:create_application_credential(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.241903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.477668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.484762 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1900/3776] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:04:13 2022] POST /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials => generated 921 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:13.492342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fba4f-c0d4-42ff-9523-687d384962dd tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.498459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.499907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.500303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.501209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.503545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:list_access_rules(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.505298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.524788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1877/3777] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:04:13 2022] GET /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules => generated 369 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:04:13.530583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.552053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a728-861c-467f-873b-b0e9ae33674d tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.563108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.564049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.564338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.564649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.565822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:create_application_credential(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.568459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.736204 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1901/3778] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:04:13 2022] POST /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/application_credentials => generated 921 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:13.737198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.748880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7847a44-cf74-490e-a034-cfcc0af4e912 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.753497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0067ef27f2c4ed28a8e94b3c9113183', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4acb0c3dd300401cb726670901ec3166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.754560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.754940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.755315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/c87c39ea63614eda9e3b9d726680d3c9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.756698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorizing `identity:get_access_rule(user_id=a0067ef27f2c4ed28a8e94b3c9113183, access_rule_id=c87c39ea63614eda9e3b9d726680d3c9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.758510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c0d-0d73-45c1-83e0-2dbe691c5a09 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.769865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1878/3779] 10.222.0.39 () {58 vars in 1358 bytes} [Sat Jun 25 21:04:13 2022] GET /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183/access_rules/c87c39ea63614eda9e3b9d726680d3c9 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:13.771286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:13.826710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:13.856971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc05b-d7da-4257-86cb-9f79059bacd5 tempest-AccessRulesV3Test-712565457 tempest-AccessRulesV3Test-712565457-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:13.862918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:13.863927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:13.864377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:13.864774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] PATH_INFO: `/v3/users/a0067ef27f2c4ed28a8e94b3c9113183` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:13.865921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0067ef27f2c4ed28a8e94b3c9113183)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:13.868051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:13.953069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0067ef27f2c4ed28a8e94b3c9113183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:13.954105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0067ef27f2c4ed28a8e94b3c9113183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:13.966697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0067ef27f2c4ed28a8e94b3c9113183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:14.024350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0067ef27f2c4ed28a8e94b3c9113183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:14.033588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0067ef27f2c4ed28a8e94b3c9113183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:14.041557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1902/3780] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:13 2022] DELETE /identity/v3/users/a0067ef27f2c4ed28a8e94b3c9113183 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:14.046856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d266-6303-4009-8fc3-80f00bbf2029 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:14.047652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d266-6303-4009-8fc3-80f00bbf2029 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:14.048101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1d266-6303-4009-8fc3-80f00bbf2029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:14.079931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e2b1d266-6303-4009-8fc3-80f00bbf2029 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:14.083122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2b1d266-6303-4009-8fc3-80f00bbf2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:14.155119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1879/3781] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:14.169131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:14.172044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:14.244370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965a08-d9a2-4ad9-a5d3-b823e3a14325 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:14.248881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:14.249836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:14.250273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:14.250723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:14.263220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:14.264967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:14.296072 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1903/3782] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:14.435538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edb42-7832-4e0e-ba96-ba645725e361 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:14.435917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edb42-7832-4e0e-ba96-ba645725e361 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:14.436202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edb42-7832-4e0e-ba96-ba645725e361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:14.464239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9c1edb42-7832-4e0e-ba96-ba645725e361 None None] MFA Rules not processed for user `fcef2a65be9443dda5cbe7c3d77d6295`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:14.466023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9c1edb42-7832-4e0e-ba96-ba645725e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:14.484325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:14.543984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1880/3783] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:14.877774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:14.880588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:14.898253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9514a9b-e578-4f40-98cd-473c51d48b91 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:14.909011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:14.910531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:14.910904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:14.911270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] PATH_INFO: `/v3/projects/4acb0c3dd300401cb726670901ec3166` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:14.913810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acb0c3dd300401cb726670901ec3166)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:14.921178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:14.997305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:15.049501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acb0c3dd300401cb726670901ec3166', 'request_id': 'req-579ca5e4-026f-4885-a658-fd0c39864ad3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:15.063473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acb0c3dd300401cb726670901ec3166', 'request_id': 'req-579ca5e4-026f-4885-a658-fd0c39864ad3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:15.072029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acb0c3dd300401cb726670901ec3166', 'request_id': 'req-579ca5e4-026f-4885-a658-fd0c39864ad3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:15.104697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] The token cache is being invalidate because project 4acb0c3dd300401cb726670901ec3166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:15.105193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:15.110693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-579ca5e4-026f-4885-a658-fd0c39864ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:15.115653 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1904/3784] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:14 2022] DELETE /identity/v3/projects/4acb0c3dd300401cb726670901ec3166 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:15.120496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.122529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.123260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.168965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:15.181421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:15.287482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1881/3785] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:15.295776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42607a1-964f-4365-85ba-43a0a4a4b94b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.296722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42607a1-964f-4365-85ba-43a0a4a4b94b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.297044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42607a1-964f-4365-85ba-43a0a4a4b94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.335898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d42607a1-964f-4365-85ba-43a0a4a4b94b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:15.337398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d42607a1-964f-4365-85ba-43a0a4a4b94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:15.349899 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1905/3786] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:15.354272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.370981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.372795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.373145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.377830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da67ab6-2081-4b55-9166-db00073d8671 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.388909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.391235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.391520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.392576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.393301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:15.393611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.396710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.417407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:15.419075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:15.435962 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1882/3787] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:15.440622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.453683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476824e7-9512-46f0-a6fd-4164323bb8b0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.461681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.462464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.462834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.463203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.463994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.467264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.510998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1883/3788] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:04:15.512498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.533430 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1906/3789] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:15.548101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.549903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:15.589158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89f77-3ce6-43f3-a696-e50721c10964 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.599635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.600671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.601126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.601868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.603854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.606320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.640704 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1884/3790] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:04:15.641702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.654922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023de12-e74c-4884-9923-f6b91ba9d4b5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.659702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.660759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.661104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.661553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.662456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.664292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.670570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417944ea-ed89-490e-a54f-32ead651d809 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.703760 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1885/3791] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:15.707801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.726898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572775e3-d466-4e28-bca3-c0aaf175ed50 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.755403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.755403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.755403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.755403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.755952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.757601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.759331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:15.768746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:15.787424 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1886/3792] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:15.788842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:15.811220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.811965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.812261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.812568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.814069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b10b04-3b9a-4c97-bb32-1ecc48f4221c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:15.836850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:15.837764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.838044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.838317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] PATH_INFO: `/v3/projects/1172cba61f01442cb31207ea8bcf66a5/users/54186ce2c26b42f1899bac7ec1dc31fa/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.877713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1172cba61f01442cb31207ea8bcf66a5, user_id=54186ce2c26b42f1899bac7ec1dc31fa, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.882250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69381d6e-c084-4a0d-8e77-3f0882a259e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.905629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:15.906719 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1887/3793] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:15 2022] PUT /identity/v3/projects/1172cba61f01442cb31207ea8bcf66a5/users/54186ce2c26b42f1899bac7ec1dc31fa/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:15.907484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:15.917893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1907/3794] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:15.919434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:15.919772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:15.920037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:15.971560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] MFA Rules not processed for user `54186ce2c26b42f1899bac7ec1dc31fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:15.974381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:16.148779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1888/3795] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:16.164067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:16.166532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:16.384378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c00f-160d-44ed-9267-ec9e987105ef service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:16.532913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:16.532913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:16.532913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:16.532913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:16.555127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:16.557780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31364c-2f9a-4ff9-ae66-80dac53e24c6 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:16.607963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1908/3796] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:17.803371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:17.903493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896060d-6e50-4543-b244-7997713d2bc5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:17.908320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:17.909268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:17.909554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:17.909834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] PATH_INFO: `/v3/users/54186ce2c26b42f1899bac7ec1dc31fa` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:17.911045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54186ce2c26b42f1899bac7ec1dc31fa)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:17.913128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:18.015538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54186ce2c26b42f1899bac7ec1dc31fa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:18.026863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54186ce2c26b42f1899bac7ec1dc31fa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:18.040764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:18.042540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54186ce2c26b42f1899bac7ec1dc31fa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:18.048884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54186ce2c26b42f1899bac7ec1dc31fa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:18.050379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54186ce2c26b42f1899bac7ec1dc31fa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:18.078117 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1889/3797] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:17 2022] DELETE /identity/v3/users/54186ce2c26b42f1899bac7ec1dc31fa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:18.083185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:18.084163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:18.084872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:18.111812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:18.126931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:18.207399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:18.305328 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1909/3798] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:18.316123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:18.317994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:18.439325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a507232-54de-4ac8-9479-738e84563589 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:18.443078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:18.444109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:18.444486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:18.444835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:18.456236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:18.458240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fdff8-3c93-414c-beee-3a862d5ba207 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:18.469565 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1890/3799] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:04:19.003695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.005743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:19.050159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd70cf-0356-48a5-876c-3e46b6226464 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.065677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.067156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.069811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.070356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] PATH_INFO: `/v3/projects/1172cba61f01442cb31207ea8bcf66a5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.073175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1172cba61f01442cb31207ea8bcf66a5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.079564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:19.165561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1172cba61f01442cb31207ea8bcf66a5', 'request_id': 'req-ea339cfc-a66e-485f-bb02-67d4fd68b183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:19.181875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1172cba61f01442cb31207ea8bcf66a5', 'request_id': 'req-ea339cfc-a66e-485f-bb02-67d4fd68b183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:19.192751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1172cba61f01442cb31207ea8bcf66a5', 'request_id': 'req-ea339cfc-a66e-485f-bb02-67d4fd68b183'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:19.217941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] The token cache is being invalidate because project 1172cba61f01442cb31207ea8bcf66a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:19.219143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:19.221881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea339cfc-a66e-485f-bb02-67d4fd68b183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:19.224841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1910/3800] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:19 2022] DELETE /identity/v3/projects/1172cba61f01442cb31207ea8bcf66a5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:19.231535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.232276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.232276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.264539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:19.266246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:19.372046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1891/3801] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:19.373288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.373584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.373867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.405788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:19.408439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:19.439042 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1911/3802] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:19.444664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.459804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833851-d39f-40fa-9fc9-936fe3dc4683 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.474736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.476250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.480845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.481277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.482187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:19.482717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.485911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:19.519909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1892/3803] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:19.524180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.537598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07852-0f71-4094-b155-ff93eea385d0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.548534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.549377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.549668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.549949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.550674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.552845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:19.598770 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1912/3804] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:19 2022] POST /identity/v3/projects => generated 411 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:04:19.604016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.622818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4f373-45c2-4177-8b84-0e1509b170f6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.763931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.764711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.764993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.765284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.765989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.768126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:19.838827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:19.849936 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1893/3805] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:19 2022] POST /identity/v3/users => generated 306 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:19.850381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.868665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507464d2-1cb2-4f6e-9e51-55a17423de25 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.877397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.878039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.878319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.878604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.879342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.881013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:19.918860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1913/3806] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:19.922839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:19.942191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f0410-be62-4385-8109-fc6f1b4a718b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:19.947394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:19.948269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:19.950641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:19.951037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:19.953081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:19.958407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6c30d-6bd5-4264-a05e-df680d6aabb2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:20.016550 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1894/3807] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:20.017209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:20.040332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd154-70cd-41b8-a6af-144706b737b1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:20.059587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:20.061948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.062432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.062883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] PATH_INFO: `/v3/projects/5022d4015f2542269b189213aa61857c/users/d1efdc8c769843a0af1b7d5083059c9b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:20.107567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5022d4015f2542269b189213aa61857c, user_id=d1efdc8c769843a0af1b7d5083059c9b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:20.114974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:20.151693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1914/3808] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:20 2022] PUT /identity/v3/projects/5022d4015f2542269b189213aa61857c/users/d1efdc8c769843a0af1b7d5083059c9b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:04:20.162469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.162646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.162828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:20.220043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] MFA Rules not processed for user `d1efdc8c769843a0af1b7d5083059c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:20.221817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:20.348087 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1895/3809] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:20.352360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:20.447060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:20.453345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6429cc-ea1d-4c1b-8c79-233116f8946d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:20.460889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:20.460889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.461424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.461424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:20.463167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:20.465349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:20.519672 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1915/3810] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:20 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:20.523467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:20.537634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984784-fd85-4cb5-9796-1ed94a9498dd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:20.649873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:20.650621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.650778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.651102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:20.651768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:20.654932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:20.711941 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1896/3811] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:20 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:04:20.712742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:20.726496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b168-5979-47ca-aef7-a0b0282e23d6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:20.751824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:20.752586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.752893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.757123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:20.759456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:20.761241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:20.801900 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1916/3812] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:20.810954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:20.841509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1052e85-5ab0-4ee3-b808-af51f6ebf63c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:20.868944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:20.875654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:20.884407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:20.884407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] PATH_INFO: `/v3/projects/10ab222bdb3c4adbac701d569a63a76b/users/a65e95cb033a424b8e5569e648890c69/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:21.006788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ab222bdb3c4adbac701d569a63a76b, user_id=a65e95cb033a424b8e5569e648890c69, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:21.009548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:21.070257 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1897/3813] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:20 2022] PUT /identity/v3/projects/10ab222bdb3c4adbac701d569a63a76b/users/a65e95cb033a424b8e5569e648890c69/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:21.075542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:21.109786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1bfd4-ff2c-4f0b-903c-5086e66d59dd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:21.279667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:21.280756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:21.281223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:21.281657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:21.282733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:21.285276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150304c6-ed97-4acd-9b89-ac7ceb5d5980 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:21.308624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1917/3814] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:21.313684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:21.330120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9571ea-dfc9-4a96-bedb-7bc905603df8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:21.354934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:21.357219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:21.357999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:21.358431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] PATH_INFO: `/v3/projects/10ab222bdb3c4adbac701d569a63a76b/users/a65e95cb033a424b8e5569e648890c69/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:21.361032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ab222bdb3c4adbac701d569a63a76b, user_id=a65e95cb033a424b8e5569e648890c69, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:21.364218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:21.381177 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1898/3815] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:21 2022] PUT /identity/v3/projects/10ab222bdb3c4adbac701d569a63a76b/users/a65e95cb033a424b8e5569e648890c69/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:21.392703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:21.393734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:21.394509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:21.437404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] MFA Rules not processed for user `a65e95cb033a424b8e5569e648890c69`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:21.438662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:21.634824 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1918/3816] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:21.646045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:21.649391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:21.777849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:21.830275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa7f9e-4db0-4972-a399-9e0b222086ec admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:21.838393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:21.839086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:21.839375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:21.840015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:21.859624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:21.861701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f19d5-3184-4a9d-92fc-2b0b9ec93216 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:21.879725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1899/3817] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:04:24.766945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:24.906927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:24.929618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e636a6a-e8d5-49d0-a116-085292a6bbab None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:24.941552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:24.943171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:24.943517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:24.943859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] PATH_INFO: `/v3/users/d1efdc8c769843a0af1b7d5083059c9b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:24.945180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1efdc8c769843a0af1b7d5083059c9b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:24.947695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:25.065671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1efdc8c769843a0af1b7d5083059c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:25.066531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1efdc8c769843a0af1b7d5083059c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:25.080605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1efdc8c769843a0af1b7d5083059c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:25.100474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1efdc8c769843a0af1b7d5083059c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:25.116354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1efdc8c769843a0af1b7d5083059c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:25.139537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1919/3818] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:24 2022] DELETE /identity/v3/users/d1efdc8c769843a0af1b7d5083059c9b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:25.141349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:25.141855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:25.142042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:25.169358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:25.170894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:25.248528 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1900/3819] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:25.257665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:25.259157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:25.381770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4a574-c2f8-4d31-8e55-f9fceb86fd30 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:25.392583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:25.392583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:25.392583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:25.392583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:25.423457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:25.425032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:25.437239 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1920/3820] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:26.146608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:26.150896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:26.189373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7adbe3-c739-4d77-b00b-55d12eb15606 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:26.213608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:26.216380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:26.218158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:26.218914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] PATH_INFO: `/v3/projects/5022d4015f2542269b189213aa61857c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:26.226810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5022d4015f2542269b189213aa61857c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:26.232021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:26.358301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5022d4015f2542269b189213aa61857c', 'request_id': 'req-d1cbf257-64b1-4ed4-baba-92f9b16cead7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.373204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5022d4015f2542269b189213aa61857c', 'request_id': 'req-d1cbf257-64b1-4ed4-baba-92f9b16cead7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.396893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5022d4015f2542269b189213aa61857c', 'request_id': 'req-d1cbf257-64b1-4ed4-baba-92f9b16cead7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.421823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] The token cache is being invalidate because project 5022d4015f2542269b189213aa61857c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:26.422375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.423507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.439576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:26.441776 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1901/3821] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:26 2022] DELETE /identity/v3/projects/5022d4015f2542269b189213aa61857c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:26.459287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158878b-a6b7-4910-a307-ca1e55b3ca9f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:26.602460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:26.603861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:26.604131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:26.604721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] PATH_INFO: `/v3/users/a65e95cb033a424b8e5569e648890c69` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:26.606138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65e95cb033a424b8e5569e648890c69)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:26.610040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:26.636010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:26.740940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65e95cb033a424b8e5569e648890c69'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.741986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65e95cb033a424b8e5569e648890c69'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.760115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65e95cb033a424b8e5569e648890c69'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.812100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65e95cb033a424b8e5569e648890c69'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.832303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13d26202-725f-4dcd-8cc9-3c8556d3eb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65e95cb033a424b8e5569e648890c69'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:26.851426 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1921/3822] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:26 2022] DELETE /identity/v3/users/a65e95cb033a424b8e5569e648890c69 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:27.602773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:27.605983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:27.644736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf257-64b1-4ed4-baba-92f9b16cead7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:27.752316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:27.762521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:27.763892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:27.764390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:27.765377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] PATH_INFO: `/v3/projects/10ab222bdb3c4adbac701d569a63a76b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:27.767960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ab222bdb3c4adbac701d569a63a76b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:27.771007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:27.842712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ab222bdb3c4adbac701d569a63a76b', 'request_id': 'req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:27.853333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ab222bdb3c4adbac701d569a63a76b', 'request_id': 'req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:27.860394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ab222bdb3c4adbac701d569a63a76b', 'request_id': 'req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:27.881218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] The token cache is being invalidate because project 10ab222bdb3c4adbac701d569a63a76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:27.881578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:27.882250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f404d5d-132c-41ad-9b74-e759ddb2b0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:27.885428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1902/3823] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:27 2022] DELETE /identity/v3/projects/10ab222bdb3c4adbac701d569a63a76b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:27.890224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:27.890746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:27.890852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:27.913492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:27.914741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:28.053775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1922/3824] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:28.061437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.061733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.062038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.102049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:28.103746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:28.122622 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1903/3825] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:28.127167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.142399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122990a-6e81-42b0-83da-77abbd0bc643 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.156209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.158817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.161153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.161920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.164689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:28.166456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.168626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.215426 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1923/3826] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:28.216867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.241882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ac00f-baf2-4222-afac-ccff763fcccb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.265173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.267654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.268041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.268436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.269272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.272087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.338111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1904/3827] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:28 2022] POST /identity/v3/projects => generated 397 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:28.343632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.363328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbd21-988e-4d96-86a1-7d60f54c6ae0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.480046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.480925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.481214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.481492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.482313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.484398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.523662 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1924/3828] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:28 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:28.527795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.566791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408022fd-7be6-4eb1-bbbe-c37faefbc345 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.575285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.577270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.577695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.578245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.580460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.583888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a4d5a-c091-4dfc-a513-c77248602d06 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.627318 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1905/3829] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:28.636234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.649379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6614b8-391d-42f0-b35c-e568c38129a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.652984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98932cb-41e8-493a-aa6d-fceee4f1e327 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.653478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98932cb-41e8-493a-aa6d-fceee4f1e327 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.654266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98932cb-41e8-493a-aa6d-fceee4f1e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.689251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.691714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.693567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.693961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.697061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.701636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.714128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:28.737374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c98932cb-41e8-493a-aa6d-fceee4f1e327 None None] MFA Rules not processed for user `259fbe1886a644c28632dc5c8a3c3568`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:28.742359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c98932cb-41e8-493a-aa6d-fceee4f1e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:28.757221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1925/3830] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:28.762334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:28.791284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7db09-7b2f-45cb-8924-830e1b4d3e44 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:28.808166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:28.809391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.809775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.810152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] PATH_INFO: `/v3/projects/fa49b00e1c274b6f9fb8b0fed9662d0f/users/900c1baca2844682a4e999c112e0fd0a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.861182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa49b00e1c274b6f9fb8b0fed9662d0f, user_id=900c1baca2844682a4e999c112e0fd0a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:28.866074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:28.884379 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1906/3831] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:28.904548 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1926/3832] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:28 2022] PUT /identity/v3/projects/fa49b00e1c274b6f9fb8b0fed9662d0f/users/900c1baca2844682a4e999c112e0fd0a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:28.905543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:28.905904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:28.906252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:28.946974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] MFA Rules not processed for user `900c1baca2844682a4e999c112e0fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:28.948238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:29.043373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:29.110838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.115888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1907/3833] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:29.200085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca216-b165-43cb-bb05-11a7701ffca5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.209426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.210226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.210792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.210915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.211690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.213849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.283287 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1927/3834] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:29 2022] POST /identity/v3/projects => generated 399 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:29.287453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.299868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0326-8377-40b2-9fa5-137faa3146bd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.391299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.392146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.392580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.392961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.393755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.397053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.458100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.465830 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1908/3835] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:29 2022] POST /identity/v3/users => generated 306 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:29.470428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e1725-d93e-4afe-91db-883695b3af3f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.476455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.478636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.478636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.479344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.480127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.484274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.501611 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1928/3836] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:29.505983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.521733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ce1d-91f1-4a3d-927a-636d7d64ae0f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.532061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.533050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.533400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.533738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] PATH_INFO: `/v3/projects/04c1c029f0d94271a23b12f34b67ba69/users/e4e345d113c14ed2a4922e9a892ac585/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.556151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c1c029f0d94271a23b12f34b67ba69, user_id=e4e345d113c14ed2a4922e9a892ac585, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.560477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.585318 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1909/3837] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:29 2022] PUT /identity/v3/projects/04c1c029f0d94271a23b12f34b67ba69/users/e4e345d113c14ed2a4922e9a892ac585/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:29.586098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.602141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beadd0-063e-498e-95bd-c422b7394ccf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.706292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.707308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.707710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.708001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.710201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.711991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd956-1b34-41b2-9012-af696639623c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.733337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:29.740219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1929/3838] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:29.748038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32fd6a-cda9-4891-8a68-797724583127 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:29.757559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:29.758522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.758805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.759086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] PATH_INFO: `/v3/projects/04c1c029f0d94271a23b12f34b67ba69/users/e4e345d113c14ed2a4922e9a892ac585/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.761149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c1c029f0d94271a23b12f34b67ba69, user_id=e4e345d113c14ed2a4922e9a892ac585, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:29.765854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:29.780785 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1910/3839] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:29 2022] PUT /identity/v3/projects/04c1c029f0d94271a23b12f34b67ba69/users/e4e345d113c14ed2a4922e9a892ac585/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:29.792158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:29.792274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:29.792590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:29.870398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] MFA Rules not processed for user `e4e345d113c14ed2a4922e9a892ac585`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:29.871830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:29.934820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:30.008811 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1930/3840] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:30.015550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:30.017532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:30.121044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bcd9f-819c-48dc-9a84-58e9a540f8b5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:30.131154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:30.132043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:30.132455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:30.132841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:30.191846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:30.237381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:30.239207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba697bb0-daad-4a54-96e5-58922fdea730 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:30.250127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1911/3841] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:30.953468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:30.954965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:31.180694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf938e4-edce-4476-bfbe-3abd60c54f60 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:31.194369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:31.195831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:31.196081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:31.196567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:31.208621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:31.211514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:31.224849 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1931/3842] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:35.525969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:35.526993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:35.527529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:35.556642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:35.558216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:35.632610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1912/3843] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:35.644062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:35.646187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:35.750991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b615533-7d7f-47b0-98a9-9e6ac9e78689 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:35.758527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:35.760071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:35.760364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:35.760737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:35.771952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:35.773710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b9b37-e784-4344-af0a-b7297cad8661 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:35.788666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1932/3844] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:36.558264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:36.562301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:36.649163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985254c-1176-4cf3-beb1-6cd473de27df None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:36.655663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:36.656871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:36.657370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:36.657831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:36.660207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:36.676838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:36.679050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:36.703692 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1913/3845] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:37.006658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9e89-f824-4664-bc41-ca084323e4f5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:37.008007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9e89-f824-4664-bc41-ca084323e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:37.008562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9e89-f824-4664-bc41-ca084323e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:37.047411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f44f9e89-f824-4664-bc41-ca084323e4f5 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:37.049529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f44f9e89-f824-4664-bc41-ca084323e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:37.060764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1933/3846] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:37.076470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:37.090604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08025d-e48a-4e1e-8d8c-78e1ed6a2e54 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:37.097846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:37.098801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:37.099314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:37.099795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:37.112041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:37.114095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:37.129211 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1914/3847] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:37.568037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:37.568344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:37.568662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:37.588305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:37.589912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:37.598039 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1934/3848] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:37.610863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:37.621817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d31030-2704-418f-b3c6-e63ffdd42e6b service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:37.627295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:37.628005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:37.628292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:37.628613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:37.639003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:37.640647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:37.649038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1915/3849] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:38.419628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:38.433141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc14a2-e07f-4baf-89c9-e4787c3d1034 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:38.438196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:38.439010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:38.439356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:38.439639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:38.441512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:38.454067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:38.455664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf050b-c189-458a-ac7a-5be452f53e4f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:38.468682 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1935/3850] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:38.483306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:38.533605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:38.547570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690de5a-e04a-4065-9535-cf95330011d4 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:38.552082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:38.553021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:38.553290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:38.553570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] PATH_INFO: `/v3/users/900c1baca2844682a4e999c112e0fd0a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:38.554755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900c1baca2844682a4e999c112e0fd0a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:38.556739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:38.605300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900c1baca2844682a4e999c112e0fd0a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:38.613950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900c1baca2844682a4e999c112e0fd0a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:38.626601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900c1baca2844682a4e999c112e0fd0a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:38.627243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900c1baca2844682a4e999c112e0fd0a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:38.627847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900c1baca2844682a4e999c112e0fd0a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:38.640929 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1916/3851] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:38 2022] DELETE /identity/v3/users/900c1baca2844682a4e999c112e0fd0a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:38.645583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:38.645876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:38.646152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:38.664711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:38.665925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:38.679094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:38.732163 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1936/3852] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:38.742190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:38.744212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:38.806484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981705-64b3-4c5c-aa54-7a6146a5a369 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:38.810572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:38.811229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:38.811512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:38.811786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:38.821970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:38.823422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:38.833564 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1917/3853] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:39.040697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:39.043137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:39.058030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3380b-4d08-4485-a579-2b7ec476d6aa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:39.063877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:39.064829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.065114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.065393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] PATH_INFO: `/v3/projects/fa49b00e1c274b6f9fb8b0fed9662d0f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.067882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa49b00e1c274b6f9fb8b0fed9662d0f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:39.070567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:39.119640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa49b00e1c274b6f9fb8b0fed9662d0f', 'request_id': 'req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.128503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa49b00e1c274b6f9fb8b0fed9662d0f', 'request_id': 'req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.134553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa49b00e1c274b6f9fb8b0fed9662d0f', 'request_id': 'req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.149077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] The token cache is being invalidate because project fa49b00e1c274b6f9fb8b0fed9662d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:39.149335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.150062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.152118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1937/3854] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:39 2022] DELETE /identity/v3/projects/fa49b00e1c274b6f9fb8b0fed9662d0f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:39.156034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:39.166848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48960-8ac1-4e9a-b568-2342d9a9e98c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:39.231341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:39.232324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.232639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.232916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] PATH_INFO: `/v3/users/e4e345d113c14ed2a4922e9a892ac585` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.234236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e345d113c14ed2a4922e9a892ac585)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:39.236188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:39.251000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:39.298374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e345d113c14ed2a4922e9a892ac585'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.307066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e345d113c14ed2a4922e9a892ac585'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.333595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e345d113c14ed2a4922e9a892ac585'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.334341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e345d113c14ed2a4922e9a892ac585'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.334948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-365bfc04-4588-42b3-bb88-9b37c4bcadd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e345d113c14ed2a4922e9a892ac585'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.347809 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1918/3855] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:39 2022] DELETE /identity/v3/users/e4e345d113c14ed2a4922e9a892ac585 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:39.605168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:39.606789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:39.621015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21344-9618-4d4f-b0c5-f75c8cec0bb8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:39.679437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:39.680370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.680680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.680953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] PATH_INFO: `/v3/projects/04c1c029f0d94271a23b12f34b67ba69` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.682142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c1c029f0d94271a23b12f34b67ba69)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:39.684072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:39.729617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:39.733731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c1c029f0d94271a23b12f34b67ba69', 'request_id': 'req-7de76421-fdec-45dc-b820-f42c792b02ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.741882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c1c029f0d94271a23b12f34b67ba69', 'request_id': 'req-7de76421-fdec-45dc-b820-f42c792b02ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.747404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c1c029f0d94271a23b12f34b67ba69', 'request_id': 'req-7de76421-fdec-45dc-b820-f42c792b02ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.758315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] The token cache is being invalidate because project 04c1c029f0d94271a23b12f34b67ba69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:39.758620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.759242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7de76421-fdec-45dc-b820-f42c792b02ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:39.760880 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1938/3856] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:39 2022] DELETE /identity/v3/projects/04c1c029f0d94271a23b12f34b67ba69 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:39.766516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.767044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.767139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.786221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:39.787423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:39.855292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1919/3857] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:39.865231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.865520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.865803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.891919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:39.893180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:39.906192 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1939/3858] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:39.907740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:39.918420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c123-57ba-4e6a-9b66-fefed2647142 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:39.923607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:39.924270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.924585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.924878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.925621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:39.926027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:39.927647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:39.940130 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1920/3859] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:39.944749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:39.954539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4d833-73b1-412d-8cb0-21379bf5eab5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:39.959818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:39.960628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:39.961005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:39.961361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:39.962129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:39.974613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.018509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1940/3860] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:40.024355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.034952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d05-c15e-4c89-bd55-ee586a389658 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.095985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.096624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.096911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.097188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.097889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.099842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.127182 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1921/3861] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:40 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:40.131431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.143313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ef56-ec83-48a6-88ba-aef78117d45b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.148471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.149296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.149589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.149841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.150571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.152181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.164476 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1941/3862] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:40.167756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.178478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c1186-4222-4399-adb0-7fa655527843 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.183884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.184669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.185553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.185553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.186001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.187606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa0e7-337a-46c8-9f29-1fe9e9664c02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.188968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:40.204984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1922/3863] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:40.205557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.217323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252d54-b8fc-4e0c-9620-ff19a1fa3fe1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.222614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.223634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.223776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.224046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] PATH_INFO: `/v3/projects/35f573611b134a928b031f11f12bb7ff/users/b0198d0a7ae940e98fa708ac9cd59067/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.240789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f573611b134a928b031f11f12bb7ff, user_id=b0198d0a7ae940e98fa708ac9cd59067, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.243486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.258477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1942/3864] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:40 2022] PUT /identity/v3/projects/35f573611b134a928b031f11f12bb7ff/users/b0198d0a7ae940e98fa708ac9cd59067/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:04:40.270332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.270621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.270922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.300748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] MFA Rules not processed for user `b0198d0a7ae940e98fa708ac9cd59067`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:40.302229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:40.413749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1923/3865] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:40.418062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.508125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a694f-bd00-4c28-b1d3-196153ad5d09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.513850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.514638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.514998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.515351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.516197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.518484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.561951 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1943/3866] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:40 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:40.565814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.586339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06ea4-deb7-427e-86b4-0ee6bebd70e6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.700363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.701291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.701573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.701857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.702669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.704696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.730396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1924/3867] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:40 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:40.734666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.748913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5488dc-9a13-4630-923a-09e5d8ebafad admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.758046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.759404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.759786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.759786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.760544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.762490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.776176 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1944/3868] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:40.780600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.794594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf209d3-2c3d-44cf-88f9-45b3906fded6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.802818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.803874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.804254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.804569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] PATH_INFO: `/v3/projects/e02549e7c43f4094892ff122ab7b4827/users/d0cedff007d44230a197a280e7f38c4d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.830259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02549e7c43f4094892ff122ab7b4827, user_id=d0cedff007d44230a197a280e7f38c4d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.833315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.855709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1925/3869] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:40 2022] PUT /identity/v3/projects/e02549e7c43f4094892ff122ab7b4827/users/d0cedff007d44230a197a280e7f38c4d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:40.857185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.868571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76121a-2d08-4065-99f4-638c9ee30859 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.926648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:40.955272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.956083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.956449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.956833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.957651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.959473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3abe42-2e65-49a7-a7d0-64b1ed7f4bd4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:40.970969 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1945/3870] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:40.975251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:40.985932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5ff8-809f-4a12-bba8-970ccd3cae6b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:40.990551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:40.991440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:40.991721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:40.991996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] PATH_INFO: `/v3/projects/e02549e7c43f4094892ff122ab7b4827/users/d0cedff007d44230a197a280e7f38c4d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:40.994050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02549e7c43f4094892ff122ab7b4827, user_id=d0cedff007d44230a197a280e7f38c4d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:40.996791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:41.007663 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1926/3871] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:40 2022] PUT /identity/v3/projects/e02549e7c43f4094892ff122ab7b4827/users/d0cedff007d44230a197a280e7f38c4d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:41.018162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:41.018539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:41.018889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:41.048072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] MFA Rules not processed for user `d0cedff007d44230a197a280e7f38c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:41.049348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:41.118975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1946/3872] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:41.130048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:41.132027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:41.177256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:41.196166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c94d-8545-4cbd-9ec1-c66217ff3600 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:41.199954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:41.200850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:41.201133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:41.201413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:41.212033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:41.213535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:41.224549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1927/3873] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:42.300207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:42.303301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:42.404042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f2fe0-3690-45df-8025-8e9c39fd4910 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:42.411993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:42.413432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:42.413864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:42.414389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:42.416576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:42.447871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:42.450719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:42.467158 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1947/3874] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:47.949084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:47.950635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:47.982924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259df7c-e823-43b9-b82d-d0b70658e9d5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:47.994238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590511-da00-4881-bc31-282caa278554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:47.995122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590511-da00-4881-bc31-282caa278554 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:47.995817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590511-da00-4881-bc31-282caa278554 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:47.996187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590511-da00-4881-bc31-282caa278554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:47.998308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04590511-da00-4881-bc31-282caa278554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:48.011626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590511-da00-4881-bc31-282caa278554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:48.014007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590511-da00-4881-bc31-282caa278554 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:48.025753 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1928/3875] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:48.039561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:48.072741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91eae0-1613-486a-9d81-d62f4d09a5d3 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:48.088058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0cedff007d44230a197a280e7f38c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e02549e7c43f4094892ff122ab7b4827', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:48.089291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:48.090099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:48.090568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:48.092526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:48.093481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:48.099758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:48.115640 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1948/3876] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:48.117490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590511-da00-4881-bc31-282caa278554 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:48.139716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590511-da00-4881-bc31-282caa278554 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:48.145076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0cedff007d44230a197a280e7f38c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e02549e7c43f4094892ff122ab7b4827', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:48.146415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:48.146777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:48.147124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:48.147896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:48.150193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:48.179602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1929/3877] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:48 2022] POST /identity/v3/projects => generated 349 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:48.183777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:48.196089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0ca10-f5d3-4be1-9522-9d40cab66dcd tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:48.240490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:48.283497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0cedff007d44230a197a280e7f38c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e02549e7c43f4094892ff122ab7b4827', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:48.284199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:48.284520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:48.284808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:48.285547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:48.285860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:48.287499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:48.315431 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1949/3878] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:48.862089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:48.880011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11a5db-0557-4162-9d6a-4d0411c40ca3 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:48.888880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0cedff007d44230a197a280e7f38c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e02549e7c43f4094892ff122ab7b4827', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:48.890257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:48.900454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:48.900454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] PATH_INFO: `/v3/projects/5fe0e0d4e46e41ea8ff676373fc3352a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:48.900454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5fe0e0d4e46e41ea8ff676373fc3352a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:48.900454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:48.952040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe0e0d4e46e41ea8ff676373fc3352a', 'request_id': 'req-f838c965-0a5f-499e-a04d-73ba2acf79a2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:48.962473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe0e0d4e46e41ea8ff676373fc3352a', 'request_id': 'req-f838c965-0a5f-499e-a04d-73ba2acf79a2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:48.971651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe0e0d4e46e41ea8ff676373fc3352a', 'request_id': 'req-f838c965-0a5f-499e-a04d-73ba2acf79a2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:49.012959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] The token cache is being invalidate because project 5fe0e0d4e46e41ea8ff676373fc3352a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:49.013226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:49.017026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f838c965-0a5f-499e-a04d-73ba2acf79a2 tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:49.020178 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1930/3879] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:48 2022] DELETE /identity/v3/projects/5fe0e0d4e46e41ea8ff676373fc3352a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:49.034665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:49.036970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:49.145736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653863eb-8ffb-42f7-a3dd-b78bbc8deedc tempest-RoutersAdminTest-1698403918 tempest-RoutersAdminTest-1698403918-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:49.224476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:49.225254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:49.225619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:49.226067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:49.228040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:49.304313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:49.305940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ec962-d646-4802-8acc-e85f8b0b8108 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:49.316832 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1950/3880] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:49.477154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:49.477451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:49.477729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:49.496561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] MFA Rules not processed for user `5d3257db63ed4bf0861abc735c1e83ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:49.497834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:49.577245 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1931/3881] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:49.616926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad556-6bc3-484a-9517-dfe63343ec4b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:49.617294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad556-6bc3-484a-9517-dfe63343ec4b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:49.617652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad556-6bc3-484a-9517-dfe63343ec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:49.638650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-79fad556-6bc3-484a-9517-dfe63343ec4b None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:49.640141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79fad556-6bc3-484a-9517-dfe63343ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:49.690022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:49.716600 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1951/3882] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:49.738168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:49.739740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:49.783200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:49.838461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aebda-fa2a-4e51-8424-95e907f23702 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:49.844251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:49.844952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:49.845236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:49.845568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:49.854970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:49.856749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:49.872743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1932/3883] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:50.072171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853bca-21d6-4101-a6d4-7beffbdf4b91 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.072490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853bca-21d6-4101-a6d4-7beffbdf4b91 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.073002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853bca-21d6-4101-a6d4-7beffbdf4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:50.092881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dd853bca-21d6-4101-a6d4-7beffbdf4b91 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:50.094099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd853bca-21d6-4101-a6d4-7beffbdf4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:50.101629 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1952/3884] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:50.115677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:50.127670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a843c5d-4200-4b22-a6fb-211210d50678 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:50.132799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:50.133457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.133738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.134014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:50.143178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:50.144834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:50.155528 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1933/3885] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:50.413889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.414991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.415488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:50.437771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:50.439329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:50.448519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1953/3886] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:50.465809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:50.479184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b322-97c9-44c4-906f-b8d1f363cb01 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:50.495934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:50.496673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.497019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.497258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:50.517085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:50.519202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62a209-9c8b-4769-aeec-601f92a1e40c service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:50.538903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1934/3887] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:50.677965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:50.680322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:50.831488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a207886-75f9-413e-a3d1-3086466a865a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:50.838236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:50.839145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.839427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.840109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] PATH_INFO: `/v3/users/e6fb1f340fc243f4ae0f4f11f90c1f5d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:50.841887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fb1f340fc243f4ae0f4f11f90c1f5d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:50.843849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:50.936656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fb1f340fc243f4ae0f4f11f90c1f5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:50.937321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fb1f340fc243f4ae0f4f11f90c1f5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:50.948710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fb1f340fc243f4ae0f4f11f90c1f5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:50.970772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fb1f340fc243f4ae0f4f11f90c1f5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:50.980222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fb1f340fc243f4ae0f4f11f90c1f5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:50.987690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1954/3888] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:50 2022] DELETE /identity/v3/users/e6fb1f340fc243f4ae0f4f11f90c1f5d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:50.992075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:50.992376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:50.992732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:51.012441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:51.014046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:51.073800 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1935/3889] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:51.084298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:51.085750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:51.151106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586417df-d69e-45b7-9b80-eecfb4b4d103 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:51.156773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:51.156953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:51.157200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:51.157494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:51.170632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:51.172177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577229a5-d108-4bdd-b223-9896053d8c19 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:51.176555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:51.189370 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1955/3890] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:04:51.584448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:51.586036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:51.606644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75287-f3c0-47ff-9738-1458ad6c2722 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:51.623363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:51.635918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:51.636497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:51.636915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] PATH_INFO: `/v3/projects/c08f52307dc24b5bacaea02af2fe64da` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:51.638629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08f52307dc24b5bacaea02af2fe64da)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:51.641660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:51.723759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08f52307dc24b5bacaea02af2fe64da', 'request_id': 'req-e2d58543-5514-466e-94bf-27fca8e00560'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:51.736369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08f52307dc24b5bacaea02af2fe64da', 'request_id': 'req-e2d58543-5514-466e-94bf-27fca8e00560'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:51.750325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08f52307dc24b5bacaea02af2fe64da', 'request_id': 'req-e2d58543-5514-466e-94bf-27fca8e00560'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:51.783432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] The token cache is being invalidate because project c08f52307dc24b5bacaea02af2fe64da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:51.784509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:51.785599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e2d58543-5514-466e-94bf-27fca8e00560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:51.788950 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1936/3891] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:51 2022] DELETE /identity/v3/projects/c08f52307dc24b5bacaea02af2fe64da => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:51.794094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:51.794627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:51.794880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:51.820748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:51.822453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:51.934450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1956/3892] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:04:51.944311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:51.944636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:51.944918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:51.998674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:52.002600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:52.041828 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1937/3893] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:52.043136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.056914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3472-8946-45f2-b9cb-cdf0b1bd53f9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.068314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.069291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.072200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.072317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.084218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:52.086140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.095650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.126390 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1957/3894] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:52.129492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.135294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:52.140559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f03731-0c6b-41e6-bfe2-7c85062b2375 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.155730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.156517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.156808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.156999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.157691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.159806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.237881 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1938/3895] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:52 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:52.239553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.252772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f939e-fc5b-4c05-8696-7908290bbb66 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.324070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.324924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.325212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.325541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.326482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.329331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.398712 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1958/3896] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:52 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:52.399536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.417049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f6cea-9058-4250-8910-a290f47b16f2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.430993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.431883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.432346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.432807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.433700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.435785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.462721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1939/3897] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:52.466296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.484483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559ac6f-c0bf-4fa2-b2ce-5e4ab8601204 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.495530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.497327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.497897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.498335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.499237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.504000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de7819-fc40-41a1-9716-c90c943e344d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.533407 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1959/3898] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:04:52.537578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.554143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b437-3411-4125-ac51-e574f36e2e3e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.563138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.564187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.564529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.565247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] PATH_INFO: `/v3/projects/95fe24504ce84cd5a6436e591103af6c/users/e4efda3eb68e444b8efdbdc10216e6bd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.591254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fe24504ce84cd5a6436e591103af6c, user_id=e4efda3eb68e444b8efdbdc10216e6bd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.595437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:52.617000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1940/3899] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:52 2022] PUT /identity/v3/projects/95fe24504ce84cd5a6436e591103af6c/users/e4efda3eb68e444b8efdbdc10216e6bd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:52.628126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.628655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.628943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.686774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] MFA Rules not processed for user `e4efda3eb68e444b8efdbdc10216e6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:52.688151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:52.785899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:52.801612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1960/3900] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:52.830649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:52.832567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:52.949947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835431e-c163-4334-9d8a-fcc734fc767c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:52.959013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:52.960058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:52.960058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:52.960258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:52.976894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:52.986587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4c6ec-b6ca-4f57-860a-78a726e3b099 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:53.001291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1941/3901] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:53.066926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:53.209055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17be36-50d2-45b1-8f0e-ace786a1b7e4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:53.222302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:53.222662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:53.228263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:53.229856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] PATH_INFO: `/v3/users/e4efda3eb68e444b8efdbdc10216e6bd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:53.238801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4efda3eb68e444b8efdbdc10216e6bd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:53.244796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:53.368759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4efda3eb68e444b8efdbdc10216e6bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:53.370383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4efda3eb68e444b8efdbdc10216e6bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:53.384589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4efda3eb68e444b8efdbdc10216e6bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:53.447640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4efda3eb68e444b8efdbdc10216e6bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:53.457611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4efda3eb68e444b8efdbdc10216e6bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:53.467576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1961/3902] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:04:53 2022] DELETE /identity/v3/users/e4efda3eb68e444b8efdbdc10216e6bd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:53.472037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:53.472580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:53.473014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:53.528180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:53.530209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:53.685474 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1942/3903] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:53.750768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:53.752207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:53.877095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe835-f7f9-4efc-838b-81f5ca175204 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:53.886125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:53.886883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:53.887260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:53.887613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:53.910216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:53.910356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e251d-18b7-4830-9f58-a1ae20c4ba9a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:53.922622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1962/3904] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:54.649903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:54.652215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:54.672892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e85a8f-12f3-48d6-9ef2-545e1432eaa7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:54.680194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:54.681164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:54.681454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:54.682046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] PATH_INFO: `/v3/projects/95fe24504ce84cd5a6436e591103af6c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:54.683511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fe24504ce84cd5a6436e591103af6c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:54.686489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:54.731705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:54.760128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fe24504ce84cd5a6436e591103af6c', 'request_id': 'req-e9b90794-1f85-4161-b31a-261407dee3f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:54.769024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fe24504ce84cd5a6436e591103af6c', 'request_id': 'req-e9b90794-1f85-4161-b31a-261407dee3f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:54.777997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fe24504ce84cd5a6436e591103af6c', 'request_id': 'req-e9b90794-1f85-4161-b31a-261407dee3f3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:54.793740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] The token cache is being invalidate because project 95fe24504ce84cd5a6436e591103af6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:04:54.794375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:54.795376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e9b90794-1f85-4161-b31a-261407dee3f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:04:54.800114 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1943/3905] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:54 2022] DELETE /identity/v3/projects/95fe24504ce84cd5a6436e591103af6c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:54.802304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:54.802796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:54.804954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:54.829030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:54.830409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:54.844143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:54.908461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1963/3906] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:54.916536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:54.916829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:54.917110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:54.937033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:54.938276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:54.950138 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1944/3907] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:54.951522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:54.962146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc60ca-739f-487e-94af-7e9ac6c42632 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:54.968494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:54.969397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:54.970059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:54.970331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:54.971097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:04:54.971404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:54.973076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:54.993812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.003747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ee13a-b949-48f8-9baf-49792f8117ba None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.004725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1964/3908] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:04:55.015382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.016149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.016345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.020660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.021361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.023328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.069031 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1945/3909] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:04:54 2022] POST /identity/v3/projects => generated 403 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:55.073535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.084768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a82b-0879-4c3a-b839-033f5998bc21 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.151025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.151600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.151881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.152172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.152909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.155017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.179155 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1965/3910] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:04:55 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:04:55.183444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.198139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c5d4-6ac6-4bfe-8187-123351b62976 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.203955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.204661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.205540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.205907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.206543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.208170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.226728 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1946/3911] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:55.234344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.243741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060bab4-10dc-4c89-bec6-1223ebf78bc2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.248997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.249670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.249959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.250240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.251685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.253357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5c6aa-3b3a-4aee-8011-9549fa377a93 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.266330 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1966/3912] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:04:55.277053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.289205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba3cf-9854-4cfc-86f9-8de1e6032201 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.304620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.305607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.305898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.306184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] PATH_INFO: `/v3/projects/455d6b7ba6994dd3ad89208b9856bad6/users/e16ebf76a8644979b53d2d8fe5ffa688/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.329573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455d6b7ba6994dd3ad89208b9856bad6, user_id=e16ebf76a8644979b53d2d8fe5ffa688, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.332791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.359217 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1947/3913] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:04:55 2022] PUT /identity/v3/projects/455d6b7ba6994dd3ad89208b9856bad6/users/e16ebf76a8644979b53d2d8fe5ffa688/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:04:55.366166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.366467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.366750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.391306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:55.392573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:55.463257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1967/3914] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:04:55.481379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.484907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:55.554549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841b9fd-91e1-42fe-a25e-9507ba262862 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.560150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.560963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.561254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.561545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.573177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.574864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88820a-e3ef-4e16-ae70-04cc6c6543e7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.585947 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1948/3915] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:55.724335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:04:55.738049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c306-8d9a-4a8c-a097-b92d79a3116c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:04:55.743031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:04:55.743382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:55.743667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:55.743987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:55.746425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:55.761810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:04:55.763358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75ab05-f312-4fd0-9996-d08c5ca2f2c6 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:04:55.774376 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1968/3916] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:04:56.144244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4dafc-f873-4eb7-8200-545efd07bbc6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:04:56.144834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4dafc-f873-4eb7-8200-545efd07bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:04:56.144834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4dafc-f873-4eb7-8200-545efd07bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:04:56.163662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6fb4dafc-f873-4eb7-8200-545efd07bbc6 None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:04:56.164902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6fb4dafc-f873-4eb7-8200-545efd07bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:04:56.215726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:56.227279 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1949/3917] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:05.379004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:05.379596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:05.379596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:05.381383 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1969/3918] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:05:05.387762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:05.388621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:05.388900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:05.412571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:05.414010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:05.418425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:05.421064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:05.442511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed803e-bb04-4fbe-b8ac-39bc7fd52238 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:05.504574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:05.505529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:05.505809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:05.506570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] PATH_INFO: `/v3/users/259fbe1886a644c28632dc5c8a3c3568` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:05.507917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] RBAC: Authorizing `identity:delete_user(user_id=259fbe1886a644c28632dc5c8a3c3568)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:05.509956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:05.512642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:05.581488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1950/3919] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:05.610858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:05.612340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:05.629739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ca7f-94b0-4acc-970b-f449c0fb7a1b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:05.631814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259fbe1886a644c28632dc5c8a3c3568'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:05.632889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259fbe1886a644c28632dc5c8a3c3568'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:05.641373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:05.642342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:05.642749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:05.643168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:05.645435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259fbe1886a644c28632dc5c8a3c3568'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:05.649550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:05.667394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:05.669630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:05.681911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259fbe1886a644c28632dc5c8a3c3568'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:05.690894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c7b4b60-5887-44a3-837d-8bd1357d942b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259fbe1886a644c28632dc5c8a3c3568'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:05.692499 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1951/3920] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:05.699396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1970/3921] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:05:05 2022] DELETE /identity/v3/users/259fbe1886a644c28632dc5c8a3c3568 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:05:05.949583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:05.952327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:05.975107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb011c-deec-456d-9a5b-47cf26b00ca3 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.048902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.049913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.050199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.050810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] PATH_INFO: `/v3/projects/e2076d2f07d34d44b9431dc1e9e78e14` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.052075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2076d2f07d34d44b9431dc1e9e78e14)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.054594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.115591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d833-ce5d-4a76-b68d-5ef8814e71af None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.115890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d833-ce5d-4a76-b68d-5ef8814e71af None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.116349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64d833-ce5d-4a76-b68d-5ef8814e71af None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.120406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1971/3922] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:05:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 21:05:06.122120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2076d2f07d34d44b9431dc1e9e78e14', 'request_id': 'req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:06.125920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dc82-d112-4fee-82a1-15337708285c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.126213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dc82-d112-4fee-82a1-15337708285c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.126498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dc82-d112-4fee-82a1-15337708285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.133885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2076d2f07d34d44b9431dc1e9e78e14', 'request_id': 'req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:06.140946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2076d2f07d34d44b9431dc1e9e78e14', 'request_id': 'req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:06.150400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a7e8dc82-d112-4fee-82a1-15337708285c None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:06.151645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a7e8dc82-d112-4fee-82a1-15337708285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.154629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] The token cache is being invalidate because project e2076d2f07d34d44b9431dc1e9e78e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:05:06.155196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:06.156345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aea0466b-a1ff-4b21-9a6d-7efbec730cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:06.158990 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1952/3923] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:05:05 2022] DELETE /identity/v3/projects/e2076d2f07d34d44b9431dc1e9e78e14 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:06.163759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.164055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.164323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.183073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:06.184370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.193808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:06.236216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1972/3924] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:06.253352 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1953/3925] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:06.261280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.261619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.261904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.266138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.267690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.284564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:06.285811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.288333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e486ad8-e7d1-4d3f-abd4-9c2610c1691a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.293639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.294338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1973/3926] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:06.294511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.294612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.294889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.298381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.304738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.306377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.308038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50177b1d-1cad-47ef-9fef-c810df3bced6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.313694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.314656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.314946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.315383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.316289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:05:06.316774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.318112 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1954/3927] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:05:06.321204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.340017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1974/3928] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:05:06.340851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.352067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565afd5-ed36-4043-b88e-e32a8d561cbf service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.357083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.357778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.358067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.358345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.359050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.361152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.392736 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1955/3929] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:05:06.397199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.409933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9e31a-528e-4943-8c2b-90459e9cdd24 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.475573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:06.483638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.484338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.485047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.485734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.487659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.490034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.516481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1975/3930] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:06.520558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.536301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9c18a-8cb4-4f58-b480-577c303467b1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.542354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.543326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.543896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.544380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.545351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.547200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.560529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1956/3931] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:06.565856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.581601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc777b4-4576-4eb4-bd3e-f4a3b1aca518 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.588386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.589430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.590161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.590813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.591706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.594349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b03042-e8f3-4366-9e3f-41020fa5d58d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.611295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1976/3932] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:06.615510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.626828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357eb3-2298-4b67-acc7-064722ac3cca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.633256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b507-a45d-4768-b417-0d8fcea60b7a None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.633556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b507-a45d-4768-b417-0d8fcea60b7a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.634475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b507-a45d-4768-b417-0d8fcea60b7a None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.636386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1977/3933] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:05:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 21:05:06.640480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.641391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.641677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.641956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] PATH_INFO: `/v3/projects/ec20b1038c9240bd8c66c092f0581206/users/368aeda4e4d744daa5aa45b4eff5aa8f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.647337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.647749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.648098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.668408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec20b1038c9240bd8c66c092f0581206, user_id=368aeda4e4d744daa5aa45b4eff5aa8f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.673092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa034f1-4fa6-42d0-9123-dec8efdc409f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:06.698543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1957/3934] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:06 2022] PUT /identity/v3/projects/ec20b1038c9240bd8c66c092f0581206/users/368aeda4e4d744daa5aa45b4eff5aa8f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:06.701085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.701553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.702047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.702166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:06.705834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.730416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:06.732163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.835310 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1978/3935] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:06.851074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1958/3936] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:06.863147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.864897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.869628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:06.883632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:06.951553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:06.967794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236b84-5fcf-4dfc-a0c5-98b9cd0acbd4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.973508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6a75-fd40-4de4-b2cf-e1e21d35db7e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:06.977586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.978253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.978532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.978834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.980005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:06.981304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:06.981687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:06.982060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:06.998290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:06.999997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c1380-08d0-43d4-9376-49b9d5719833 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:07.007872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:07.012688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:07.014073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1959/3937] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:07.037116 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1979/3938] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:07.246691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:07.247485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:07.247848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:07.343144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] MFA Rules not processed for user `e16ebf76a8644979b53d2d8fe5ffa688`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:07.346008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:07.509057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1960/3939] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:07.517419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:07.518718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:07.539564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65601-0737-422e-9a63-32d0bd6023d5 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:07.549160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:07.549869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:07.550235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:07.550696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:07.561239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:07.563132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea99e-a56e-4350-88f2-26b8941f39da service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:07.577764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1980/3940] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:09.078701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:09.080802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:09.118611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32e702-c65c-4388-9403-e4d13d0d0b8d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:09.138005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:09.139739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:09.139739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:09.139975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:09.145057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:09.285804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:09.289214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1da4-929d-4512-b714-5ad3ed5283bd service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:09.350588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1961/3941] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:16.415509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e784-e9a8-42c5-8708-993580901526 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:16.416059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e784-e9a8-42c5-8708-993580901526 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:16.416059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e784-e9a8-42c5-8708-993580901526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:16.447987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c603e784-e9a8-42c5-8708-993580901526 None None] MFA Rules not processed for user `368aeda4e4d744daa5aa45b4eff5aa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:16.449290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c603e784-e9a8-42c5-8708-993580901526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:16.494031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:16.547887 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1981/3942] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:16.549771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:16.550324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:16.550324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:16.577090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] MFA Rules not processed for user `368aeda4e4d744daa5aa45b4eff5aa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:16.578514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:16.594156 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1962/3943] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:16.657428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e784-e9a8-42c5-8708-993580901526 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:16.685890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e784-e9a8-42c5-8708-993580901526 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:16.697334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:16.698265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:16.698879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:16.699190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:16.738697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:16.741956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:16.766569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1982/3944] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:25.572280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:25.574387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:25.588772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13d73-3c5b-48cd-abbf-27e8ae8597a9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:25.594990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:25.596165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:25.596791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:25.597289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] PATH_INFO: `/v3/users/e16ebf76a8644979b53d2d8fe5ffa688` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:25.598689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16ebf76a8644979b53d2d8fe5ffa688)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:25.600904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:25.669239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16ebf76a8644979b53d2d8fe5ffa688'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:25.681112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16ebf76a8644979b53d2d8fe5ffa688'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:25.691592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:25.702877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16ebf76a8644979b53d2d8fe5ffa688'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:25.704298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16ebf76a8644979b53d2d8fe5ffa688'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:25.704935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-68da4984-a2e6-474b-82ac-88b0dbcc71b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16ebf76a8644979b53d2d8fe5ffa688'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:25.729904 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1963/3945] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:05:25 2022] DELETE /identity/v3/users/e16ebf76a8644979b53d2d8fe5ffa688 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:26.596458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:26.611556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590369-a298-43a6-92b1-15cff4566396 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:26.735164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:26.736682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:26.737214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:26.737836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] PATH_INFO: `/v3/projects/455d6b7ba6994dd3ad89208b9856bad6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:26.739414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=455d6b7ba6994dd3ad89208b9856bad6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:26.741999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:26.820786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455d6b7ba6994dd3ad89208b9856bad6', 'request_id': 'req-c82b5bda-4684-4eed-976d-4aa790dcf6ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:26.836515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455d6b7ba6994dd3ad89208b9856bad6', 'request_id': 'req-c82b5bda-4684-4eed-976d-4aa790dcf6ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:26.848363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455d6b7ba6994dd3ad89208b9856bad6', 'request_id': 'req-c82b5bda-4684-4eed-976d-4aa790dcf6ca'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:26.866165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] The token cache is being invalidate because project 455d6b7ba6994dd3ad89208b9856bad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:05:26.866945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:26.868563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c82b5bda-4684-4eed-976d-4aa790dcf6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:26.871988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1983/3946] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:05:26 2022] DELETE /identity/v3/projects/455d6b7ba6994dd3ad89208b9856bad6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:26.877932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:26.878571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:26.878571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:26.907304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:26.909928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:26.991394 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1964/3947] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:27.000017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.000390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.000657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.030849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:27.032819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:27.044550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1984/3948] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:27.045994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.057515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dc120-2b30-4dea-83ac-ad9da083e5b9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.064910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.065852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.066997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.067368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.068248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:05:27.068652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.070576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.119499 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1965/3949] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:05:27.125263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.142753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fbf5d-1b45-471c-8d89-aff92c3e1ee4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.167705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.168626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.168915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.169534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.170861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.173986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.224895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1985/3950] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:05:27 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:27.229546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.257083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a09b-b020-4877-9581-2583eedce6ff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.322365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.323386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.323841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.324168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.324928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.326889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.350407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1966/3951] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:05:27 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:27.354726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.365773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706a0d-acd9-4186-8f43-bd23b4878952 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.370810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.371569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.371851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.372126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.372896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.374511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.385221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1986/3952] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:27.390152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.402365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5664-2e50-442b-ad63-0f24e90d5ca5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.408673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.409492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.409782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.410059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.410799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.412451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47bad-47be-40dc-b2eb-116b3a2bb70c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.423458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1967/3953] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:05:27.427863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.439572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadaa84-132e-44c7-a356-d8ff18ecfde2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.450659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.451611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.451891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.452229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] PATH_INFO: `/v3/projects/034b90cc1b144b43b2aec3feaeb65f74/users/6b7cbda91af54f84a9432ddbf6abec2a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.463908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:27.470871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034b90cc1b144b43b2aec3feaeb65f74, user_id=6b7cbda91af54f84a9432ddbf6abec2a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.473937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.498074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1987/3954] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:27 2022] PUT /identity/v3/projects/034b90cc1b144b43b2aec3feaeb65f74/users/6b7cbda91af54f84a9432ddbf6abec2a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:27.500052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.500340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.500623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.519699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:27.521046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:27.574997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:27.605971 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1968/3955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:27.615997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:27.617913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:27.735618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacc430-fdd1-4dfd-8bdc-bff31806c178 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:27.742555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:27.746566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:27.747000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:27.747432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:27.770835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:27.773316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:27.795430 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1988/3956] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:05:28.914592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:28.917421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:28.933177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69c280-7fef-4e16-9b03-dd20a828c82a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:28.938668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:28.940776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:28.941278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:28.941849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] PATH_INFO: `/v3/users/fcef2a65be9443dda5cbe7c3d77d6295` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:28.943277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcef2a65be9443dda5cbe7c3d77d6295)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:28.945618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:29.035675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcef2a65be9443dda5cbe7c3d77d6295'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.046611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcef2a65be9443dda5cbe7c3d77d6295'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.065124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcef2a65be9443dda5cbe7c3d77d6295'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.066138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcef2a65be9443dda5cbe7c3d77d6295'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.067168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0bb78a1-a1b4-45eb-8084-0a5f0b51eaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcef2a65be9443dda5cbe7c3d77d6295'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.084900 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1969/3957] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:05:28 2022] DELETE /identity/v3/users/fcef2a65be9443dda5cbe7c3d77d6295 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:29.561200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:29.574892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34632771-59c4-4325-bb9d-174ac615474e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:29.639420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:29.640309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:29.640618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:29.640898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] PATH_INFO: `/v3/projects/9a930bf73f9845e6b079820ec7b14906` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:29.642097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a930bf73f9845e6b079820ec7b14906)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:29.644065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:29.698000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a930bf73f9845e6b079820ec7b14906', 'request_id': 'req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.708166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a930bf73f9845e6b079820ec7b14906', 'request_id': 'req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.718227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a930bf73f9845e6b079820ec7b14906', 'request_id': 'req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.730785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] The token cache is being invalidate because project 9a930bf73f9845e6b079820ec7b14906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:05:29.731173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.731901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0f58cd79-54a6-46f9-9d0c-eb6ec319df60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:29.733568 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1989/3958] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:05:29 2022] DELETE /identity/v3/projects/9a930bf73f9845e6b079820ec7b14906 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:29.738828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:29.739239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:29.739611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:29.763727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:29.765363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:29.897470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1970/3959] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:29.898676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:29.898971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:29.899252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:29.938658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:29.940377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:29.968001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1990/3960] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:29.972965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:29.993412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697196-7cef-4a8d-ab89-c96dafdd77c9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.007039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.007873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.008164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.008671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.009634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:05:30.010195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.012375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.037680 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1971/3961] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:05:30.042828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.055616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40119-91a7-4c86-b465-62b45dc4ba17 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.062298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.063260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.064379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.065034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.065950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.068300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.082247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:30.118693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1991/3962] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:05:30 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:30.123431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.138426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c5e2-2bb7-4b6c-afee-cde757fd8d28 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.203429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:30.254532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.255355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.256367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.256745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.257566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.259783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.296922 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1972/3963] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:05:30 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:30.301061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.313956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d98eed-005c-409e-ae5b-d0081e50fdaa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.320834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.321824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.322345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.325306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.327487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.337459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.364524 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1992/3964] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:30.371695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.383372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86c0b-8490-40ec-a074-ce41f0d828c4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.389047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.389748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.390217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.390518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.398069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.398069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9210-1ccb-442f-a18e-6998261c619a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.410149 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1973/3965] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:30.415182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.426833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8763d-dc4f-4cd6-968b-35825a840da8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.432836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.434786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.435171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.435551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] PATH_INFO: `/v3/projects/1174772192cc45578b127d170fda4ebf/users/9c53269024eb4c238ec405606e36a049/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.458923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1174772192cc45578b127d170fda4ebf, user_id=9c53269024eb4c238ec405606e36a049, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.462436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.488693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1993/3966] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:30 2022] PUT /identity/v3/projects/1174772192cc45578b127d170fda4ebf/users/9c53269024eb4c238ec405606e36a049/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:30.492859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389390-c680-4bb7-9bdd-98490a6bd7f2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.493175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389390-c680-4bb7-9bdd-98490a6bd7f2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.493477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389390-c680-4bb7-9bdd-98490a6bd7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.526067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36389390-c680-4bb7-9bdd-98490a6bd7f2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:30.527624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36389390-c680-4bb7-9bdd-98490a6bd7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:30.621303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1974/3967] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:30.632108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:30.634262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:30.699579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b10a-f78b-46fc-8a9e-a7059656c748 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:30.707016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:30.707642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:30.708416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:30.708721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:30.723967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:30.725587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:30.739144 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1994/3968] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:05:40.102081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec845bb-07dd-40ce-8c72-28d5d31eedf3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:40.102570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec845bb-07dd-40ce-8c72-28d5d31eedf3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:40.102672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec845bb-07dd-40ce-8c72-28d5d31eedf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:40.145301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1ec845bb-07dd-40ce-8c72-28d5d31eedf3 None None] MFA Rules not processed for user `6b7cbda91af54f84a9432ddbf6abec2a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:40.146984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1ec845bb-07dd-40ce-8c72-28d5d31eedf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:40.280138 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1975/3969] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:40.299441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:40.301240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:40.429652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31d48f-433e-411a-b0aa-44d63f018b21 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:40.438707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:40.439569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:40.440048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:40.442572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:40.452957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:40.454758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:40.466881 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1995/3970] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:43.003742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:43.004270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:43.004354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:43.111193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] MFA Rules not processed for user `9c53269024eb4c238ec405606e36a049`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:43.117846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:43.237724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:43.301261 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1976/3971] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:43.349936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:43.351488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:43.374658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d6e1-be1f-499a-ba0a-b054eae31013 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:43.383878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:43.385808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:43.386479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:43.388045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:43.450314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:43.453202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe192bf6-0842-4133-8f48-6401ea870fab service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:43.486159 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1996/3972] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:44.747920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:44.750947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:44.776389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1366-43d6-4f5e-9ecb-9029d59a18b2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:44.781267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:44.782808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:44.783155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:44.783508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] PATH_INFO: `/v3/users/b0198d0a7ae940e98fa708ac9cd59067` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:44.784852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0198d0a7ae940e98fa708ac9cd59067)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:44.786895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:44.856933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0198d0a7ae940e98fa708ac9cd59067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:44.865415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0198d0a7ae940e98fa708ac9cd59067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:44.879433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0198d0a7ae940e98fa708ac9cd59067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:44.880349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0198d0a7ae940e98fa708ac9cd59067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:44.881405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe12f3e9-405d-4f7a-bc06-2c33f431c91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0198d0a7ae940e98fa708ac9cd59067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:44.895083 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1977/3973] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:05:44 2022] DELETE /identity/v3/users/b0198d0a7ae940e98fa708ac9cd59067 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:44.899470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:44.899945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:44.900089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:44.925928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:44.927187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:44.949575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:44.949882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:44.950155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:44.969157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:44.974570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] MFA Rules not processed for user `a6a15dadfd0448fab9e84a89173ed7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:44.976590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:45.021879 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1997/3974] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:45.040649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:45.042321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:45.123064 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1978/3975] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:45.165212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c794d1-7c4d-4c52-9482-6968b0fa6eb9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:45.169984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:45.171404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:45.172118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:45.173040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:45.203759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:45.206511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:45.228283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1998/3976] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:05:46.006648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:46.008899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:46.037057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00f50-72d3-4a96-a8d0-eb18b85d4efd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:46.054751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:46.055838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:46.056329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:46.056844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] PATH_INFO: `/v3/projects/35f573611b134a928b031f11f12bb7ff` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:46.061004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f573611b134a928b031f11f12bb7ff)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:46.065728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:46.199664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:46.210184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f573611b134a928b031f11f12bb7ff', 'request_id': 'req-200fd1ee-5497-47b1-9a88-e3738512710b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.237187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f573611b134a928b031f11f12bb7ff', 'request_id': 'req-200fd1ee-5497-47b1-9a88-e3738512710b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.245995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f573611b134a928b031f11f12bb7ff', 'request_id': 'req-200fd1ee-5497-47b1-9a88-e3738512710b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.261488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] The token cache is being invalidate because project 35f573611b134a928b031f11f12bb7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:05:46.262669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.263586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-200fd1ee-5497-47b1-9a88-e3738512710b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.266251 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1979/3977] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:05:46 2022] DELETE /identity/v3/projects/35f573611b134a928b031f11f12bb7ff => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:46.270252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:46.286357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:46.286724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:46.287061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:46.290004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4e14-be9e-4ffb-9a87-6f57f596a78d service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:46.310055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] MFA Rules not processed for user `6b7cbda91af54f84a9432ddbf6abec2a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:46.311436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:46.377207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:46.378365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:46.378765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:46.379116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] PATH_INFO: `/v3/users/d0cedff007d44230a197a280e7f38c4d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:46.380835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cedff007d44230a197a280e7f38c4d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:46.389996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:46.401420 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1980/3978] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:46.503373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cedff007d44230a197a280e7f38c4d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.504538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cedff007d44230a197a280e7f38c4d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.518679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cedff007d44230a197a280e7f38c4d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.549911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cedff007d44230a197a280e7f38c4d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.557853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:46.563828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e062d2be-93bd-4b12-9343-24daf6240951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cedff007d44230a197a280e7f38c4d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:46.582118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 1999/3979] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:05:46 2022] DELETE /identity/v3/users/d0cedff007d44230a197a280e7f38c4d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:47.000775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:47.006443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:47.079332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d45e3-4834-4a83-8acf-9b0791cf2123 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:47.216178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:47.219224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:47.219818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:47.221197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] PATH_INFO: `/v3/projects/e02549e7c43f4094892ff122ab7b4827` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:47.222852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02549e7c43f4094892ff122ab7b4827)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:47.225279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:47.372452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02549e7c43f4094892ff122ab7b4827', 'request_id': 'req-a23eb74e-1a94-4465-89aa-f424e53d3276'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:47.400176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02549e7c43f4094892ff122ab7b4827', 'request_id': 'req-a23eb74e-1a94-4465-89aa-f424e53d3276'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:47.430601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02549e7c43f4094892ff122ab7b4827', 'request_id': 'req-a23eb74e-1a94-4465-89aa-f424e53d3276'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:47.498338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] The token cache is being invalidate because project e02549e7c43f4094892ff122ab7b4827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:05:47.500735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:47.504105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a23eb74e-1a94-4465-89aa-f424e53d3276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:05:47.509665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1981/3980] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:05:46 2022] DELETE /identity/v3/projects/e02549e7c43f4094892ff122ab7b4827 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:47.515079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:47.515881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:47.516382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:47.537863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:47.540284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:47.779369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2000/3981] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:05:47.781343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:47.781633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:47.782041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:47.824397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:47.827900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:47.847400 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1982/3982] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:47.851383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:47.873914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6a501-1033-4422-ad14-dd0b3f2cd183 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:47.899852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:47.903175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:47.903301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:47.903817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:47.904659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:05:47.904970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:47.906617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:47.941822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2001/3983] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:05:47.946419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:47.954781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:47.960789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ee60-ddee-441c-9915-bdff7570e4d5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:47.972090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:47.972808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:47.974225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:47.974552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:47.976503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:47.982256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:48.042008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1983/3984] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:05:47 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:05:48.045815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:48.058979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a15ae6-f33a-4424-a4a2-f6bee610b7a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:48.204396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:48.205253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.205552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.205808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.206503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:48.208851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:48.254424 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2002/3985] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:05:48 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:48.254742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:48.271574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5230760-0078-47ee-9226-48fa8ce6094f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:48.298873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:48.299575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.299857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.300133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.300904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:48.302642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:48.336380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1984/3986] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:05:48.340674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:48.362313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d635-9647-4231-987d-ed94f3f80a38 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:48.392949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:48.394174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.394470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.394748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.396353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:48.398470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a321d9-7a08-4b2c-acf6-15138d45c5c2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:48.429044 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2003/3987] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:48.430259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:48.443760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083585-917b-4b97-9628-095eea3707d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:48.449309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:48.450334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.450767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.451137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] PATH_INFO: `/v3/projects/1db7270bbafb4b05a1c5f263b2a69ad2/users/a7647674123e4a5fb28c347bbe354cd7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.472097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db7270bbafb4b05a1c5f263b2a69ad2, user_id=a7647674123e4a5fb28c347bbe354cd7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:48.475408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:48.524405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.525009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.525009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.526841 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1985/3988] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:48 2022] PUT /identity/v3/projects/1db7270bbafb4b05a1c5f263b2a69ad2/users/a7647674123e4a5fb28c347bbe354cd7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:48.567389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] MFA Rules not processed for user `a7647674123e4a5fb28c347bbe354cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:48.569257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:48.707133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:48.770962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:48.773243 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2004/3989] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:48.951812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c7f2-ffbb-4fff-89d8-2e12f80522c1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:48.969357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:48.970244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:48.970659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:48.971030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:48.971921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:48.974966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7490e-0707-479d-b7f5-98276db1b887 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:49.073543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1986/3990] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:05:48 2022] POST /identity/v3/projects => generated 391 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:49.079198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:49.091830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debae137-c4c5-4f56-b757-8a8ec41c4fa3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:49.205342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:49.205883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:49.206310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:49.245522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] MFA Rules not processed for user `9c53269024eb4c238ec405606e36a049`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:49.247164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:49.309257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:49.310006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:49.315943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:49.317132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:49.322420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:49.325630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:49.382596 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1987/3991] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:49.397007 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2005/3992] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:05:49 2022] POST /identity/v3/users => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:05:49.398330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:49.428519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca092-9c18-4e41-bf69-f9adbbe0e7cb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:49.442713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:49.443423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:49.443847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:49.443963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:49.446766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:49.457523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:49.490024 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1988/3993] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:49.494560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:49.511099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7d96-932f-439d-9b42-b9cccf998604 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:49.519849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:49.521364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:49.524050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:49.524510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] PATH_INFO: `/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e/users/089fbd69f0604dce84c4268f06002d66/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:49.605542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bb06c187f44cfc96f2a6aca053d27e, user_id=089fbd69f0604dce84c4268f06002d66, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:49.608084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:49.655079 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2006/3994] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:49 2022] PUT /identity/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e/users/089fbd69f0604dce84c4268f06002d66/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:49.658797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:49.692812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b63d35-7aba-4aa3-b885-2c46f00731ed admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:49.758426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:49.897630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:49.899638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:49.899899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:49.900177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:49.904847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:49.914832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa3d0d-ae7d-46bd-a0cc-7d4ace8fc33a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:49.950429 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1989/3995] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:05:49.953783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:49.989392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806ff54-3227-4751-a287-ba98487e2e6a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:49.998187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:49.999128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:50.008315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:50.008650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] PATH_INFO: `/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e/users/089fbd69f0604dce84c4268f06002d66/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:50.017204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bb06c187f44cfc96f2a6aca053d27e, user_id=089fbd69f0604dce84c4268f06002d66, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:50.022847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:50.108973 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2007/3996] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:05:49 2022] PUT /identity/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e/users/089fbd69f0604dce84c4268f06002d66/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:05:50.119433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:50.119981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:50.120443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:50.200481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] MFA Rules not processed for user `089fbd69f0604dce84c4268f06002d66`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:05:50.202123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:50.439044 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1990/3997] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:05:50.494949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:05:50.497778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:05:50.640120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a127a7-867f-4a7b-b251-b583dd247414 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:05:50.654597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:05:50.655660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:05:50.656296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:05:50.656895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:05:50.685416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:05:50.687973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:05:50.720511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2008/3998] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:00.425827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=51 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:00.701877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:00.957665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:00.959883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:00.985101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:01.148128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856cfc-7549-400b-931d-7c4dab7c4530 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:01.149063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e8145-d5f7-4a7f-921a-323a85e938ab service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:01.153746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:01.155292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:01.155845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:01.156359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] PATH_INFO: `/v3/users/368aeda4e4d744daa5aa45b4eff5aa8f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:01.158579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368aeda4e4d744daa5aa45b4eff5aa8f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:01.159451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:01.160919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:01.162413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:01.162714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:01.163000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] PATH_INFO: `/v3/users/a7647674123e4a5fb28c347bbe354cd7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:01.165759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7647674123e4a5fb28c347bbe354cd7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:01.170307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:01.269209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368aeda4e4d744daa5aa45b4eff5aa8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.271764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7647674123e4a5fb28c347bbe354cd7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.272503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7647674123e4a5fb28c347bbe354cd7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.281486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368aeda4e4d744daa5aa45b4eff5aa8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.295028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7647674123e4a5fb28c347bbe354cd7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.312682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368aeda4e4d744daa5aa45b4eff5aa8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.314618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368aeda4e4d744daa5aa45b4eff5aa8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.316057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b08fe9d6-daac-493d-bec1-b62b66689530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368aeda4e4d744daa5aa45b4eff5aa8f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.316675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7647674123e4a5fb28c347bbe354cd7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.335383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7647674123e4a5fb28c347bbe354cd7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:01.335631 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1991/3999] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:00 2022] DELETE /identity/v3/users/368aeda4e4d744daa5aa45b4eff5aa8f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:01.345955 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2009/4000] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:00 2022] DELETE /identity/v3/users/a7647674123e4a5fb28c347bbe354cd7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:01.350700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:01.350935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:01.351551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:01.371051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:01.372306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:01.459928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1992/4001] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:01.484138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:01.489644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:01.570158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f82e-ca8c-4798-9da3-bd2581ad46cb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:01.576467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:01.577310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:01.577310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:01.577711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:01.593532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:01.595121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74959043-6a51-468b-83ac-dea8a6d85e0f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:01.608490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2010/4002] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:06:02.461899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:02.463484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:02.485980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0baa-dcba-4782-823a-bfd89fc01ba7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:02.498266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:02.500661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:02.501099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:02.501973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] PATH_INFO: `/v3/projects/ec20b1038c9240bd8c66c092f0581206` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:02.502801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec20b1038c9240bd8c66c092f0581206)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:02.505617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:02.555177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:02.618370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec20b1038c9240bd8c66c092f0581206', 'request_id': 'req-6a917d3d-194a-47f0-9024-e98bd54da325'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:02.660760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec20b1038c9240bd8c66c092f0581206', 'request_id': 'req-6a917d3d-194a-47f0-9024-e98bd54da325'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:02.685308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec20b1038c9240bd8c66c092f0581206', 'request_id': 'req-6a917d3d-194a-47f0-9024-e98bd54da325'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:02.721123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] The token cache is being invalidate because project ec20b1038c9240bd8c66c092f0581206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:02.721421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:02.726542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6a917d3d-194a-47f0-9024-e98bd54da325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:02.733940 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1993/4003] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:02 2022] DELETE /identity/v3/projects/ec20b1038c9240bd8c66c092f0581206 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:02.738813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:02.739338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:02.739436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:02.768298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:02.769610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:02.814500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:02.958326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2011/4004] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:02.967276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:02.967563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:02.967844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.003384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:03.004783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:03.030740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1994/4005] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:03.032112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.051871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531283c3-b862-42a7-bbb1-b257431438b5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.058157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.058853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.059310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.059736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.060715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:03.061342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.063285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.085556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.092312 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2012/4006] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:03.097347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814442d-37ee-459b-8f3e-4d07638150f3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.102963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.103643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.104146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.104570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.106533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.108694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.172305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.172532 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1995/4007] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:03 2022] POST /identity/v3/projects => generated 395 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:03.180198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35785b4c-bab0-4d26-a190-c8e110323607 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.328377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.333817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.334166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.334459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.337640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.344024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.434585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.435533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2013/4008] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:03 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:03.439235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.440197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:03.469007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0f2a-ef84-4e88-b9ca-72c16527a00f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.469264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f5c8-4bfe-4bfb-8dc3-1047aa7dcef2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.482411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.483608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.484051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.484472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.485311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.485311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.485559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] PATH_INFO: `/v3/projects/1db7270bbafb4b05a1c5f263b2a69ad2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.486197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.487109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.490714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db7270bbafb4b05a1c5f263b2a69ad2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.490945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.492674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.508414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2014/4009] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:03.512553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.535795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c318-1fe8-4025-a552-0f6d36616f72 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.545670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.546977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.548118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.548919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.550557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.574742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.610637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2015/4010] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:06:03.615264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db7270bbafb4b05a1c5f263b2a69ad2', 'request_id': 'req-508c5036-a3df-42e6-9167-b237332cb183'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.616978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.634016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db7270bbafb4b05a1c5f263b2a69ad2', 'request_id': 'req-508c5036-a3df-42e6-9167-b237332cb183'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.640381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4fbbf-6be1-4491-934f-9e470f585605 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.640545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db7270bbafb4b05a1c5f263b2a69ad2', 'request_id': 'req-508c5036-a3df-42e6-9167-b237332cb183'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.661555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] The token cache is being invalidate because project 1db7270bbafb4b05a1c5f263b2a69ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:03.661850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.662536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.665085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1996/4011] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:03 2022] DELETE /identity/v3/projects/1db7270bbafb4b05a1c5f263b2a69ad2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:03.669140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:03.671807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:03.767467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:03.776436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5036-a3df-42e6-9167-b237332cb183 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:03.786091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.787588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.788611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.789889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] PATH_INFO: `/v3/users/089fbd69f0604dce84c4268f06002d66` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.791272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089fbd69f0604dce84c4268f06002d66)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.793261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:03.794275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.797420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.797773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.798063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] PATH_INFO: `/v3/projects/646b2a5c42444e6891d6cc44e816c918/users/fdc9d61eb01b444f9071248ecbd1bc43/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.854286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=646b2a5c42444e6891d6cc44e816c918, user_id=fdc9d61eb01b444f9071248ecbd1bc43, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:03.869928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:03.874348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089fbd69f0604dce84c4268f06002d66'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.885606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089fbd69f0604dce84c4268f06002d66'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.899191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:03.910778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089fbd69f0604dce84c4268f06002d66'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.911540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089fbd69f0604dce84c4268f06002d66'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.912480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fe358b67-c7bb-4415-84ac-bd383cc055d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089fbd69f0604dce84c4268f06002d66'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:03.930724 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1997/4013] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:03 2022] DELETE /identity/v3/users/089fbd69f0604dce84c4268f06002d66 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:03.931363 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2016/4013] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:03 2022] PUT /identity/v3/projects/646b2a5c42444e6891d6cc44e816c918/users/fdc9d61eb01b444f9071248ecbd1bc43/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:03.933633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:03.933930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:03.934215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:03.956464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:03.958375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:04.088070 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1998/4014] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:04.109825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:04.113144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:04.291922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d24a9-0828-4caa-9753-2e6e43ef55eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:04.384124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:04.385374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:04.385679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:04.385987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:04.401957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:04.404552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d1c5b-65f7-4f15-9da3-b07cc9222926 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:04.425604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2017/4015] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:04.754857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:04.756679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:04.770830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20097c-8ac3-45fd-831c-5d027adb2d37 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:04.777860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:04.778745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:04.779090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:04.780007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] PATH_INFO: `/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:04.780903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bb06c187f44cfc96f2a6aca053d27e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:04.783238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:04.860964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bb06c187f44cfc96f2a6aca053d27e', 'request_id': 'req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:04.872340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bb06c187f44cfc96f2a6aca053d27e', 'request_id': 'req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:04.879831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bb06c187f44cfc96f2a6aca053d27e', 'request_id': 'req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:04.895863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:04.903834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] The token cache is being invalidate because project c4bb06c187f44cfc96f2a6aca053d27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:04.904135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:04.905468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52fcae92-63b5-42d9-a36a-7f3f6f2b6a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:04.913989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 1999/4016] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:04 2022] DELETE /identity/v3/projects/c4bb06c187f44cfc96f2a6aca053d27e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:04.914799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:04.915269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:04.915375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:04.934426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:04.935675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:05.003298 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2018/4017] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:05.011074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.011917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.012558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.047781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:05.049626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:05.086656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2000/4018] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:05.088999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.102414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865cb2f-2678-4e8c-9086-365b55b7b05f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.110498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.111797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.112243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.112741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.113785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:05.114306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.116338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.135544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2019/4019] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:05.136876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.146609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb7ef9-4754-4bdc-b386-92666eb33f1f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.153665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.154307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.154737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.155022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.155685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.157691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.201881 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2001/4020] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:05 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:05.203164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.217048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cacd3a-96f4-4fa0-bce7-7ba654b919d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.273998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:05.302407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.303852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.304136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.304410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.305290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.308799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.350373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2020/4021] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:05 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:05.354777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.370907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5caf8-d94f-49fe-9bb1-8a2c5c3fac4c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.380776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.382270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.382682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.383250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.384319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.386562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.408041 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2002/4022] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:05.413040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.426385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1abdf9-b976-4eab-97e3-309aea76db56 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.443733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.444700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.445042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.445431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.452174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.465787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052064-8133-454a-ba9f-63e6aaef8786 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.501032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.516775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2021/4023] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:05.519951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53f9c-bac3-49c1-b433-fef71c4030e8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:05.535509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:05.537388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.537668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.537945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] PATH_INFO: `/v3/projects/ef84794c4f5f46d68a675f9dbe77ed3d/users/4781cf9b0d594aba99745153534b23be/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.593086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef84794c4f5f46d68a675f9dbe77ed3d, user_id=4781cf9b0d594aba99745153534b23be, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:05.595920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:05.627457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2003/4024] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:05 2022] PUT /identity/v3/projects/ef84794c4f5f46d68a675f9dbe77ed3d/users/4781cf9b0d594aba99745153534b23be/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:05.641002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:05.641315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:05.643635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:05.693513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] MFA Rules not processed for user `4781cf9b0d594aba99745153534b23be`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:05.695419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:05.849097 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2022/4025] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:05.993324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:05.995004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:06.101937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ff0-ff95-4c61-aa29-39aacd885720 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:06.111438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:06.112252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:06.112448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:06.112923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:06.126806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:06.129588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:06.149649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2004/4026] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:07.354569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:07.356286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:07.494783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863558f-98a4-423c-8211-be4e91567ae4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:07.509654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:07.510574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:07.510988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:07.511246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] PATH_INFO: `/v3/users/f46fff9b561e4959975edfffe24e1397` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:07.521395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46fff9b561e4959975edfffe24e1397)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:07.523697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:07.596997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46fff9b561e4959975edfffe24e1397'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:07.597975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46fff9b561e4959975edfffe24e1397'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:07.609429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46fff9b561e4959975edfffe24e1397'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:07.614010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:07.637654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46fff9b561e4959975edfffe24e1397'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:07.647101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef6f1ed-a770-4f07-a316-afcdeed740e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46fff9b561e4959975edfffe24e1397'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:07.660764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2023/4027] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:07 2022] DELETE /identity/v3/users/f46fff9b561e4959975edfffe24e1397 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:08.983186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.012868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf9944-f6b6-4b6c-8a4b-358e26ee576f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:09.120502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:09.121419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.121688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.121960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] PATH_INFO: `/v3/projects/109c4d190ac748b68b97b317d63a909a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.123611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] RBAC: Authorizing `identity:delete_project(project_id=109c4d190ac748b68b97b317d63a909a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:09.130335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:09.189106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:09.204561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109c4d190ac748b68b97b317d63a909a', 'request_id': 'req-bbe56ffa-2215-4254-96a7-7a9f537c154a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:09.222485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109c4d190ac748b68b97b317d63a909a', 'request_id': 'req-bbe56ffa-2215-4254-96a7-7a9f537c154a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:09.240802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109c4d190ac748b68b97b317d63a909a', 'request_id': 'req-bbe56ffa-2215-4254-96a7-7a9f537c154a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:09.255510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] The token cache is being invalidate because project 109c4d190ac748b68b97b317d63a909a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:09.256001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:09.256853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:09.258886 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2005/4028] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:08 2022] DELETE /identity/v3/projects/109c4d190ac748b68b97b317d63a909a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:09.264632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629e37-1605-4675-92cd-39fe383bb7de None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.265603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629e37-1605-4675-92cd-39fe383bb7de None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.266113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629e37-1605-4675-92cd-39fe383bb7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.322463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-30629e37-1605-4675-92cd-39fe383bb7de None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:09.324047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30629e37-1605-4675-92cd-39fe383bb7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:09.406351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.408168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:09.434207 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2024/4029] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:09.448146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.448708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.449334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.500614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:09.503207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:09.519622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2025/4030] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:09.521208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.540593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c057-be59-4edb-b655-2a105016c9b5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:09.553197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:09.553890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.556132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.556513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.559555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:09.559922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:09.562967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:09.585087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56ffa-2215-4254-96a7-7a9f537c154a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:09.599059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2026/4031] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:09.600490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.603484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:09.604163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.608266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.608592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.613850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:09.629166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032384a9-f539-49d7-a536-fd4112269195 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:09.638977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:09.640193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.640563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.641844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.642859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:09.646650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:09.743279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2027/4032] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:09 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:09.750076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.773739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:09.780269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:09.835341 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2006/4033] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:06:09.900511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63d0a-288e-4b32-afdb-fb155d119d47 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:09.911260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:09.912059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:09.912455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:09.912847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:09.913742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:09.917360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:09.973169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2028/4034] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:09 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:09.976991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:09.999362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3293ef-d717-4ef5-8acf-bd3bc4f6e624 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:10.005258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:10.006220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.006513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.006791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.007524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:10.010948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:10.025967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2007/4035] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:10.029784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:10.047338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfda89e-4687-448e-ae4d-31e67da6fd89 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:10.058994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:10.059775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.086097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.086603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.091527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:10.098880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a42ea9-3309-45c0-86d3-801a77c05996 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:10.121813 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2029/4036] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:10.126968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:10.145747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3085512-7495-44fa-87c0-e892ee5027d0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:10.154808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:10.155959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.156719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.157151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] PATH_INFO: `/v3/projects/7748ea0850294ce78a3f390458685b9b/users/ed80bbb76f8e4636a8ba37c23790b74f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.183711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7748ea0850294ce78a3f390458685b9b, user_id=ed80bbb76f8e4636a8ba37c23790b74f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:10.208040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135727-e9a2-4a14-80f5-c105a3afd84d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:10.239838 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2008/4037] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:10 2022] PUT /identity/v3/projects/7748ea0850294ce78a3f390458685b9b/users/ed80bbb76f8e4636a8ba37c23790b74f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:10.250801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.251203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.251463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.300613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:10.327208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] MFA Rules not processed for user `ed80bbb76f8e4636a8ba37c23790b74f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:10.328821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:10.494345 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2030/4038] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:10.510517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5488-081e-4e05-86cd-d0b3e961e1fb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.511585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5488-081e-4e05-86cd-d0b3e961e1fb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.512390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5488-081e-4e05-86cd-d0b3e961e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.542385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-46fb5488-081e-4e05-86cd-d0b3e961e1fb None None] MFA Rules not processed for user `ed80bbb76f8e4636a8ba37c23790b74f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:10.542385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-46fb5488-081e-4e05-86cd-d0b3e961e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:10.558364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2009/4039] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:10.570192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:10.571914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:10.680212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758215f-e486-431f-af6d-cb7f0c53fc30 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:10.687738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:10.688297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:10.688449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:10.688755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:10.703882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:10.706769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e2d8-0efe-43c7-b135-f3b7a15f806f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:10.759470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2031/4040] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:20.097645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:20.098160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:20.098260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:20.190976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] MFA Rules not processed for user `fdc9d61eb01b444f9071248ecbd1bc43`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:20.192320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:20.228376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:20.333247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2010/4041] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:20.344192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:20.344763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:20.344763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:20.372210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] MFA Rules not processed for user `fdc9d61eb01b444f9071248ecbd1bc43`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:20.372742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:20.383738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2032/4042] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:20.502143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:20.517531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966d2a-9391-425f-b1b2-390a5514cc8f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:20.529620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:20.530738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:20.531904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:20.532353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:20.546756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:20.549545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a49a-8abd-4dbf-b725-663993bf7e2f service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:20.572130 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2011/4043] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:21.134580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:21.138018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:21.218617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bab76-d72c-4c6f-987b-863d863bf2ad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:21.223630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:21.224778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:21.224957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:21.225242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] PATH_INFO: `/v3/users/5d3257db63ed4bf0861abc735c1e83ee` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:21.226521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3257db63ed4bf0861abc735c1e83ee)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:21.229186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:21.257543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:21.320460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3257db63ed4bf0861abc735c1e83ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:21.321360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3257db63ed4bf0861abc735c1e83ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:21.336886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3257db63ed4bf0861abc735c1e83ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:21.376625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3257db63ed4bf0861abc735c1e83ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:21.401631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3257db63ed4bf0861abc735c1e83ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:21.424415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:21.425378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:21.425908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:21.428833 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2033/4044] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:21 2022] DELETE /identity/v3/users/5d3257db63ed4bf0861abc735c1e83ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:21.461546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:21.462902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:21.622260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2012/4045] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:21.680355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:21.681940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:21.789897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83521a2-e746-40cd-b686-fd9ee2a73182 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:21.803053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:21.803757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:21.804040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:21.804319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:21.830019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:21.831655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:21.854337 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2034/4046] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:22.371279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:22.373294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:22.386681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f291e-6672-4469-b3dc-1f9539301dd5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:22.401065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:22.402022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:22.402308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:22.402585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] PATH_INFO: `/v3/projects/b5e11266f1884df8b0f27ebc2f4133d8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:22.405022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e11266f1884df8b0f27ebc2f4133d8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:22.407962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:22.491702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e11266f1884df8b0f27ebc2f4133d8', 'request_id': 'req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.514436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e11266f1884df8b0f27ebc2f4133d8', 'request_id': 'req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.522199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e11266f1884df8b0f27ebc2f4133d8', 'request_id': 'req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.535413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] The token cache is being invalidate because project b5e11266f1884df8b0f27ebc2f4133d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:22.535703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.548818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.554235 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2013/4047] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:22 2022] DELETE /identity/v3/projects/b5e11266f1884df8b0f27ebc2f4133d8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:22.558474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:22.578385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11bc2-1ad6-457f-822f-68502a91ade8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:22.673004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:22.673903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:22.674295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:22.674578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] PATH_INFO: `/v3/users/f6e3d3212ab942feb30bae5b2fd9885d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:22.675828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e3d3212ab942feb30bae5b2fd9885d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:22.681061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:22.756650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:22.759349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e3d3212ab942feb30bae5b2fd9885d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.760547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e3d3212ab942feb30bae5b2fd9885d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.775379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e3d3212ab942feb30bae5b2fd9885d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.788993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e3d3212ab942feb30bae5b2fd9885d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.799294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d6d326f4-85ca-4696-8ed2-c2110ca9a4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e3d3212ab942feb30bae5b2fd9885d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:22.814221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2035/4048] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:22 2022] DELETE /identity/v3/users/f6e3d3212ab942feb30bae5b2fd9885d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:23.230395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:23.232624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:23.277188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a99f-9d7e-476b-ae0f-1729c9cf182e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:23.367943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:23.456709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:23.463172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:23.463678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:23.463965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] PATH_INFO: `/v3/projects/4e758e68d8094b8bb4d528182ef10a3a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:23.467516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e758e68d8094b8bb4d528182ef10a3a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:23.472628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:23.565097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e758e68d8094b8bb4d528182ef10a3a', 'request_id': 'req-d0a64b7e-b757-44a1-a5bb-71db22085f78'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:23.590054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e758e68d8094b8bb4d528182ef10a3a', 'request_id': 'req-d0a64b7e-b757-44a1-a5bb-71db22085f78'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:23.599579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e758e68d8094b8bb4d528182ef10a3a', 'request_id': 'req-d0a64b7e-b757-44a1-a5bb-71db22085f78'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:23.645332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] The token cache is being invalidate because project 4e758e68d8094b8bb4d528182ef10a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:23.645891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:23.646799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d0a64b7e-b757-44a1-a5bb-71db22085f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:23.653165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2014/4049] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:23 2022] DELETE /identity/v3/projects/4e758e68d8094b8bb4d528182ef10a3a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:23.654745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:23.655189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:23.655318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:23.683058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:23.684743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:23.859989 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2036/4050] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:23.867830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:23.868115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:23.870100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:23.906008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:23.908659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:23.930242 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2015/4051] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:23.934597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:23.947067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e1233-2965-4619-abf2-2494d883ffd6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:23.963171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:23.964948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:23.965236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:23.965622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:23.966439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:23.966753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:23.969425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.001873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2037/4052] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:24.004854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.017243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6bd82-d975-49d5-9809-831a7947ea08 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.034714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.035411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.035684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.035961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.037067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.038723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.140142 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2016/4053] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:24 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:24.144226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.155661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd8f7-5126-494f-b1f6-858038ba7564 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.244740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.245575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.245862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.246136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.246912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.249098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.288170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2038/4054] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:24 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:24.292603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.306743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5f18-b3fe-4415-9a8a-1a1a4da6152c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.312969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.313669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.314097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.314383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.315771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.317522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.335911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.351921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2017/4055] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:24.353827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf183253-9b8a-4237-9a12-4aee63270599 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.360723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.361493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.361811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.362249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.362992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.364667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757ee29-7459-4d90-9d59-e9aeb4381e89 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.381942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.382410 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2039/4056] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:24.395015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f2e15-9247-4340-b5e0-a23faf1dd684 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.400312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.401469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.401750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.402027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] PATH_INFO: `/v3/projects/8a8b4c00c03a433996f32a3f5e446a0b/users/7d59b32e8c9e4bfcb4f5cbc7d010f58f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.419038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8b4c00c03a433996f32a3f5e446a0b, user_id=7d59b32e8c9e4bfcb4f5cbc7d010f58f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.422823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.444291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2018/4057] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:24 2022] PUT /identity/v3/projects/8a8b4c00c03a433996f32a3f5e446a0b/users/7d59b32e8c9e4bfcb4f5cbc7d010f58f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:24.455856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.456149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.456455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.501705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] MFA Rules not processed for user `7d59b32e8c9e4bfcb4f5cbc7d010f58f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:24.503260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:24.527611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:24.602506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2040/4058] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:24.606623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.656973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:24.682170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c859-9701-4296-a04a-35873ba85730 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.688713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.690366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.690649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.690927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.691639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.694306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.732545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2019/4059] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:24.736713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.751359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff89d18-1cce-4e7e-94b6-bac8ef54d7bb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.881671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.882767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.883209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.883642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.884608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.887348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.925184 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2041/4060] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:24 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:24.929951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:24.945629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821873-520b-44a9-b8af-41722c13e754 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:24.960960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:24.961816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:24.962203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:24.962574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:24.963427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:24.965792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:24.991502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2020/4061] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:24.996834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:25.013244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23e82-1561-4cf5-9338-2cc8020ceabb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:25.020118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:25.021354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:25.021641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:25.021918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] PATH_INFO: `/v3/projects/68edf139ab53434da63ba0680c2cba43/users/2686c327391144fd8c65216027501da1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:25.055321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68edf139ab53434da63ba0680c2cba43, user_id=2686c327391144fd8c65216027501da1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:25.057005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:25.092081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2042/4062] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:24 2022] PUT /identity/v3/projects/68edf139ab53434da63ba0680c2cba43/users/2686c327391144fd8c65216027501da1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:25.093624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:25.113239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61beaf5-d391-47a6-a13c-32d0bb91ac76 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:25.257627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:25.258713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:25.259159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:25.259583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:25.260577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:25.266328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94321-2bea-4b44-9aff-561dbc513a42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:25.303447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:25.303748 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2021/4063] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:25.322639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963360b-6995-4f60-920d-f855e8e7792e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:25.330429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:25.332604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:25.332978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:25.333328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] PATH_INFO: `/v3/projects/68edf139ab53434da63ba0680c2cba43/users/2686c327391144fd8c65216027501da1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:25.336725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=68edf139ab53434da63ba0680c2cba43, user_id=2686c327391144fd8c65216027501da1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:25.341225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:25.373799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:25.374184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:25.374531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:25.376790 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2043/4064] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:25 2022] PUT /identity/v3/projects/68edf139ab53434da63ba0680c2cba43/users/2686c327391144fd8c65216027501da1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:25.422608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] MFA Rules not processed for user `2686c327391144fd8c65216027501da1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:25.424364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:25.565434 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2022/4065] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:25.788829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:25.793503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:25.952398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a3dc-9bd4-4f6e-a5e0-8e50e96295ef admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:25.960058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:25.961157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:25.961554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:25.961942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:25.973444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:25.977934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:25.981184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca066-7c8f-4d6f-98cc-e4b1de2c2209 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:26.016209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2044/4066] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:26.605629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:26.650520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:26.682648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7c30-ff8b-4b43-9c07-829809e90dd9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:26.689296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:26.690366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:26.690635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:26.690912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] PATH_INFO: `/v3/users/7d59b32e8c9e4bfcb4f5cbc7d010f58f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:26.692339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d59b32e8c9e4bfcb4f5cbc7d010f58f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:26.694342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:26.755292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d59b32e8c9e4bfcb4f5cbc7d010f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:26.765039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d59b32e8c9e4bfcb4f5cbc7d010f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:26.779635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d59b32e8c9e4bfcb4f5cbc7d010f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:26.780820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d59b32e8c9e4bfcb4f5cbc7d010f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:26.781623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d59b32e8c9e4bfcb4f5cbc7d010f58f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:26.797744 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2023/4067] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:26 2022] DELETE /identity/v3/users/7d59b32e8c9e4bfcb4f5cbc7d010f58f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:26.802117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:26.802617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:26.803031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:26.827746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:26.829596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:26.941552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2045/4068] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:26.961723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:26.963677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.080015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5ff39-2e6c-4492-8521-98618914b5dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:27.084782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:27.085503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.085949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.086291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.099017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:27.100732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5792a-cf8c-4685-95a4-6eeb66f934c3 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:27.113098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2024/4069] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:27.228012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:27.229671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.242579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c44b-cc51-4fd5-9472-dde364649bdc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:27.248640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:27.249692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.250052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.250396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] PATH_INFO: `/v3/users/4781cf9b0d594aba99745153534b23be` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.251838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4781cf9b0d594aba99745153534b23be)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:27.254819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:27.305090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4781cf9b0d594aba99745153534b23be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.305829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4781cf9b0d594aba99745153534b23be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.314530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4781cf9b0d594aba99745153534b23be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.332134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4781cf9b0d594aba99745153534b23be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.341834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4781cf9b0d594aba99745153534b23be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.348789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2046/4070] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:27 2022] DELETE /identity/v3/users/4781cf9b0d594aba99745153534b23be => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:27.354059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.354451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.355086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.372234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:27.373485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.425375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:27.436793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2025/4071] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:27.446796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:27.448359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.452492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:27.453842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.466364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1228ece-edc2-44fc-904f-e54f5c3c49ac None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:27.471995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:27.473851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.474469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.474830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] PATH_INFO: `/v3/projects/8a8b4c00c03a433996f32a3f5e446a0b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.476151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8b4c00c03a433996f32a3f5e446a0b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:27.478528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:27.514864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407addc-19bf-4584-bb19-a9c66a300eb3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:27.528448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8b4c00c03a433996f32a3f5e446a0b', 'request_id': 'req-a392d4c8-113f-4e6a-a8cd-e5f76d509175'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.533221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:27.536698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8b4c00c03a433996f32a3f5e446a0b', 'request_id': 'req-a392d4c8-113f-4e6a-a8cd-e5f76d509175'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.543411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8b4c00c03a433996f32a3f5e446a0b', 'request_id': 'req-a392d4c8-113f-4e6a-a8cd-e5f76d509175'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.554383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] The token cache is being invalidate because project 8a8b4c00c03a433996f32a3f5e446a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:27.554667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.555318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.558338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2026/4072] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:27 2022] DELETE /identity/v3/projects/8a8b4c00c03a433996f32a3f5e446a0b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:27.560734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:27.562074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.573463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:27.574132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.574411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.574683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.576653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.633698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d4c8-113f-4e6a-a8cd-e5f76d509175 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:27.639568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:27.640659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:27.641079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:27.641365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] PATH_INFO: `/v3/users/2686c327391144fd8c65216027501da1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:27.642655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2686c327391144fd8c65216027501da1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:27.644843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:27.651562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:27.653282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:27.663543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2047/4073] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:27.699765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2686c327391144fd8c65216027501da1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.710048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2686c327391144fd8c65216027501da1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.740343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2686c327391144fd8c65216027501da1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.741132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2686c327391144fd8c65216027501da1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.741737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2686c327391144fd8c65216027501da1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:27.763817 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2027/4074] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:27 2022] DELETE /identity/v3/users/2686c327391144fd8c65216027501da1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:27.938817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:27.940286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:27.953334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a77be3-7b48-4c8a-bcb8-1cc7e4cff222 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.075746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.076968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.077087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.077326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] PATH_INFO: `/v3/projects/ef84794c4f5f46d68a675f9dbe77ed3d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.078732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef84794c4f5f46d68a675f9dbe77ed3d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.080730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.135740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef84794c4f5f46d68a675f9dbe77ed3d', 'request_id': 'req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.145990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef84794c4f5f46d68a675f9dbe77ed3d', 'request_id': 'req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.152778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef84794c4f5f46d68a675f9dbe77ed3d', 'request_id': 'req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.155437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.157266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.168795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] The token cache is being invalidate because project ef84794c4f5f46d68a675f9dbe77ed3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:28.169117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.169780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-66da1eb9-2153-435a-9ede-c0cfc5abd0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.170777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:28.171443 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2048/4075] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:27 2022] DELETE /identity/v3/projects/ef84794c4f5f46d68a675f9dbe77ed3d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:28.175780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdac8e-8553-4d93-98cd-8d5792ded24f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.185394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d28a-c1b7-4d86-acf4-c288f8bb927f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.185709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d28a-c1b7-4d86-acf4-c288f8bb927f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.186109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d28a-c1b7-4d86-acf4-c288f8bb927f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.195998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:28.209844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ca40d28a-c1b7-4d86-acf4-c288f8bb927f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.211542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ca40d28a-c1b7-4d86-acf4-c288f8bb927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.256777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.258072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.258421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.258766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] PATH_INFO: `/v3/projects/68edf139ab53434da63ba0680c2cba43` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.260689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68edf139ab53434da63ba0680c2cba43)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.262948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.282499 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2049/4076] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:28.290417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.290707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.290984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.314003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.315213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.320014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68edf139ab53434da63ba0680c2cba43', 'request_id': 'req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.328694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68edf139ab53434da63ba0680c2cba43', 'request_id': 'req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.334568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68edf139ab53434da63ba0680c2cba43', 'request_id': 'req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.346047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] The token cache is being invalidate because project 68edf139ab53434da63ba0680c2cba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:28.346335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.347084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4243f8e-4bdc-421f-a12f-605a71d1ceb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:28.348672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2028/4077] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:28 2022] DELETE /identity/v3/projects/68edf139ab53434da63ba0680c2cba43 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:28.353512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbb6b-393f-498f-b649-0d9e7728a41f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.353804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbb6b-393f-498f-b649-0d9e7728a41f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.354121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbb6b-393f-498f-b649-0d9e7728a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.372050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c0cfbb6b-393f-498f-b649-0d9e7728a41f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.373351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0cfbb6b-393f-498f-b649-0d9e7728a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.377455 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2050/4078] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:28.378378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.381630 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2029/4079] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:28.387649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c41c0f-e9ae-4a82-9f37-3f05d0e224f0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.389522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.389787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.390063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.392445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.393117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.393399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.393682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.394401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:28.394709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.396310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.407925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2051/4080] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:28.408797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.410050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.412210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.418296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2030/4081] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:28.422305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.422594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738d03d-349c-463a-bef1-818be083fc57 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.427964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.428134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.428441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.428722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.429411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.431233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3f48a-ff86-4f2b-a7af-a9bd0a02ba9c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.431381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.435847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.436508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.436792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.437065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.437776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:28.438078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.439653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.454980 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2031/4082] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:28.456299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.458225 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2052/4083] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:28.462210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.466679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0264-7fe9-46f6-9f0d-4ad697bbb809 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.524167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.524769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.525070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.525342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.526051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.527303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264a85-aaca-47d9-b14a-08ce009411bf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.527965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.533131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.533893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.534236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.534575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.535317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.537820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.538846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:28.553353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:28.559227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2032/4084] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:28.564059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2053/4085] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:28.564266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.565843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.577285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4fc2-51b3-49e2-a70c-3af73dc388c3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.633607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3792ede-40ab-497e-943d-0a71bb174695 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.640178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.640887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.641026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.641494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.641494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.641777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.641974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.642215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.642341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.643101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.643849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.645271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.657827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2054/4086] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:28.658903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.671861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed876e-3667-46ff-8fe5-d64726ccfa47 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.676200 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2033/4087] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:28.677411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.678305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.678975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.679253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.679525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.680245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.681902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.690436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b6db1-4920-44ce-8c08-82fe142f6d87 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.698073 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2055/4088] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:06:28.698687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.699403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.699685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.699961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.700825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.702142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.702584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.712412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323671-ee98-487e-9ae7-5b13332afd5f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.718219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2034/4089] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:28.719327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.722739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.723695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.723971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.724351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] PATH_INFO: `/v3/projects/a5859161af684c308497d87013d53045/users/ad1c7bd32c4b4e8c85f02eebaa6b2ab1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.732651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23768c0-7e4b-4431-9f14-f06dbaca5e9b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.737449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.738017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.738301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.738579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.739313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.741005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.743722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5859161af684c308497d87013d53045, user_id=ad1c7bd32c4b4e8c85f02eebaa6b2ab1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.747450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b14a-69ab-4d4f-b0fa-f0f62146edf4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.769931 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2035/4090] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:28.773571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.784469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2056/4091] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:28 2022] PUT /identity/v3/projects/a5859161af684c308497d87013d53045/users/ad1c7bd32c4b4e8c85f02eebaa6b2ab1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:28.785824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2b70-9fad-4f58-94f7-0b6e2e42737c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:28.794487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.794982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.795420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.844629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] MFA Rules not processed for user `ad1c7bd32c4b4e8c85f02eebaa6b2ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.846441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.871698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:28.872692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.873543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.873543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031/users/2e11fc4c10eb448e814f442b3daa63ae/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.894593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681cedebb0ca40b1bf5214248e378031, user_id=2e11fc4c10eb448e814f442b3daa63ae, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:28.897698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10276589-c112-412a-af1e-a5bf49a478a2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:28.918969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2036/4092] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:28 2022] PUT /identity/v3/projects/681cedebb0ca40b1bf5214248e378031/users/2e11fc4c10eb448e814f442b3daa63ae/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:28.931122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:28.931581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:28.932017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:28.947038 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2057/4093] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:28.956831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:28.958348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:28.971047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] MFA Rules not processed for user `2e11fc4c10eb448e814f442b3daa63ae`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:28.972280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:29.014334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:29.031570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:29.036800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d703-0f95-4ae8-bb7a-85b89c621999 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.066823 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2037/4094] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:29.071260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.104077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.105426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.105724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.106072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.146714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404c6db-a7f5-4880-b625-9ff54fd20c23 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.155902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.156635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.156920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.157341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.158076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.160092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.180205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.182163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.204462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2058/4095] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:06:29.212044 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2038/4096] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:29 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:29.216566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.249198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb2535-364c-4c87-b040-cfd03ad8ea07 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.336069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.336792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.337079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.337359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.338054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.340559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.372017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2059/4097] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:29 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:29.373578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.388444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972d6-1161-4723-9a0d-40cb6752eccb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.395290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.396661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.397156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.398059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.398944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.401633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.418591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2039/4098] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:29.420078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.432310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af299a9-a74c-49bc-a61f-ceb9b318b6a0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.442806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.443920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.444266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.444699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] PATH_INFO: `/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c/users/7a080b09985845059a8b11875bbd2f62/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.469668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3725a855c2dc4fbd8f246b8e6fa10b9c, user_id=7a080b09985845059a8b11875bbd2f62, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.474311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.495998 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2060/4099] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:29 2022] PUT /identity/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c/users/7a080b09985845059a8b11875bbd2f62/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:29.499931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.512179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a92e-a1e9-46a7-b4e6-b2c69c56ea76 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.587621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.588300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.588676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.588949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.590017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.591648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15abe9f-214c-40b0-a7c6-900733dadd15 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.603650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2040/4100] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:29.608042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.620381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28650021-304f-404d-907f-1433c1dc3db2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.628271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.629407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.629836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.630241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] PATH_INFO: `/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c/users/7a080b09985845059a8b11875bbd2f62/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.634165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3725a855c2dc4fbd8f246b8e6fa10b9c, user_id=7a080b09985845059a8b11875bbd2f62, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.637415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.650152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2061/4101] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:29 2022] PUT /identity/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c/users/7a080b09985845059a8b11875bbd2f62/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:29.660840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.661318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.661423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.722246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] MFA Rules not processed for user `7a080b09985845059a8b11875bbd2f62`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:29.725824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:29.771391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:29.822608 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2041/4102] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:29.828913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.840801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bd342-d790-4089-a5d3-eb09a6ca786f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.845992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.846540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.846828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.847109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.847839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:29.848154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.849974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.857566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:29.867415 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2062/4103] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:29.868035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.877690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800151f-0c3b-489e-b503-fa5c01a36d0d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.882289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.882974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.883260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.883534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.884224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.886304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:29.912655 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2042/4104] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:29 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:29.916826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:29.926862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a4d5-0640-43d6-b471-2d01e1c1c962 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:29.984758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:29.985439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:29.985727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:29.986010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:29.986754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:29.987057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:29.988733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3d133-770b-40c5-9de5-ff364949e963 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.000658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2063/4105] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:30.011373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.013213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:30.116971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85a1f-e2f4-4af8-b3e1-5269214caab1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.122981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.123648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.123932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.124207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.133088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.134693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.144701 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2043/4106] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:30.163359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46abcf-7cca-4ae9-bcc9-0a5e2466d182 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.163785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46abcf-7cca-4ae9-bcc9-0a5e2466d182 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.164169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46abcf-7cca-4ae9-bcc9-0a5e2466d182 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.165866 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2064/4107] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:30.171650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:30.184034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.193432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e20964-da38-45a9-bea7-1fad97b4d10d service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.198576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.199463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.199751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.200029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/2017fe70e1d549eeb093ed121c9b10e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.201265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=2017fe70e1d549eeb093ed121c9b10e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.206649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.209304 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2044/4108] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/projects/2017fe70e1d549eeb093ed121c9b10e6 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:30.247143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7438566-d173-4bcc-8f9f-ab1ada5cc91f None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.247432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7438566-d173-4bcc-8f9f-ab1ada5cc91f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.248506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7438566-d173-4bcc-8f9f-ab1ada5cc91f None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.249903 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2065/4109] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:30.254733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:30.256595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:30.272969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.281646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704539-673a-4d72-8d7e-973a18525c39 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.287893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.288809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.289222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.289398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/2017fe70e1d549eeb093ed121c9b10e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.290614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=2017fe70e1d549eeb093ed121c9b10e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.292844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.294613 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2045/4110] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/projects/2017fe70e1d549eeb093ed121c9b10e6 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:30.398517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f456-deeb-4c31-bdfd-0b714485d957 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.399000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f456-deeb-4c31-bdfd-0b714485d957 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.399342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f456-deeb-4c31-bdfd-0b714485d957 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.400954 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2066/4111] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:30.405681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:30.419472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.428376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986383c1-285d-400d-ba40-8d442343e7f8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.433263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.434129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.434413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.434695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/2017fe70e1d549eeb093ed121c9b10e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.435881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=2017fe70e1d549eeb093ed121c9b10e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.438014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e170d-4857-483f-b60e-bfde072008c2 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.439850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2046/4112] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/projects/2017fe70e1d549eeb093ed121c9b10e6 => generated 371 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:30.461872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f456-deeb-4c31-bdfd-0b714485d957 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.474868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f456-deeb-4c31-bdfd-0b714485d957 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.479419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.480286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.480603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.480877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/2017fe70e1d549eeb093ed121c9b10e6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.482098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2017fe70e1d549eeb093ed121c9b10e6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.483989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.532822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2017fe70e1d549eeb093ed121c9b10e6', 'request_id': 'req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:30.540654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2017fe70e1d549eeb093ed121c9b10e6', 'request_id': 'req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:30.547319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2017fe70e1d549eeb093ed121c9b10e6', 'request_id': 'req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:30.561607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] The token cache is being invalidate because project 2017fe70e1d549eeb093ed121c9b10e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:30.561915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:30.562668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:30.564308 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2067/4113] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:30 2022] DELETE /identity/v3/projects/2017fe70e1d549eeb093ed121c9b10e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:30.582124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f599bf-3446-49a4-b816-f4aa56d82333 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.582414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f599bf-3446-49a4-b816-f4aa56d82333 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.582695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f599bf-3446-49a4-b816-f4aa56d82333 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.584263 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2047/4114] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:30.589678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:30.591632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:30.672474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.673978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:30.685616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:30.757196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdfab4-d2b0-44ae-ad71-2f9e84051d07 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.762815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.763709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.764100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.764284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.765494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=681cedebb0ca40b1bf5214248e378031)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.767695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.770001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2068/4115] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/projects/681cedebb0ca40b1bf5214248e378031 => generated 373 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:30.788814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f599bf-3446-49a4-b816-f4aa56d82333 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.803729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f599bf-3446-49a4-b816-f4aa56d82333 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.808376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.809084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.809373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.809661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.810395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:30.811008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.812747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.830423 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2048/4116] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:30.831772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.854641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46810c0b-0940-4bc1-a7a5-f40f8114bedd tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.861231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.862223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.863594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.864088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:30.865226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:30.867507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f0dd4-a24b-484d-836a-781c20ce554f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:30.903591 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2069/4117] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:30 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:30.908776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:30.928996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629024-3e55-4a67-b82a-92e8b5982716 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:30.984200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:30.997438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:30.998406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:30.998810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:30.999191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.000135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:31.000647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.002925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.021437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2049/4118] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.037926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c90b4-3b58-4356-885a-13b3e7a93ce3 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.038479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c90b4-3b58-4356-885a-13b3e7a93ce3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.038568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c90b4-3b58-4356-885a-13b3e7a93ce3 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.040052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2070/4119] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:31.046188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:31.048669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:31.121986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.130616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754655d-4b7b-468f-93c3-7c025a4b2877 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.135479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.136397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.136664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.136942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/bf9dcac865924a2085c4632e27921fbd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.138155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=bf9dcac865924a2085c4632e27921fbd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.140241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.142001 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2050/4120] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/projects/bf9dcac865924a2085c4632e27921fbd => generated 369 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.228776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fd57-7e8f-4b2b-bc0a-0e00c7800345 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.229356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fd57-7e8f-4b2b-bc0a-0e00c7800345 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.229640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fd57-7e8f-4b2b-bc0a-0e00c7800345 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.231295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2071/4121] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:31.249111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:31.268107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.281203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53819-1a06-4441-8a63-e2f3ea999a60 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.286956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.288152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.288714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.289089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/bf9dcac865924a2085c4632e27921fbd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.290445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=bf9dcac865924a2085c4632e27921fbd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.292826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.294804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2051/4122] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/projects/bf9dcac865924a2085c4632e27921fbd => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.347389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937fd57-7e8f-4b2b-bc0a-0e00c7800345 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.362320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937fd57-7e8f-4b2b-bc0a-0e00c7800345 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.368689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.369489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.369949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.370329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.371168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:31.371596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.373429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.393498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.400702 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2072/4123] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.404456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e155-f8c6-4a25-9d0b-75fc428d41d6 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.409989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.410906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.411366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.411742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.412634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.415014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5eb5-43c2-493b-a52f-3897c9dbffa5 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.449185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2052/4124] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:31 2022] POST /identity/v3/users => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:31.454113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.465485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243c7c-0335-4975-b0a6-f84e68d07f6b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.470279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.471027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.471382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.471732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.472566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:31.472947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.474723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.487880 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2073/4125] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.504997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cab9e-add8-47f0-8695-3298a7fb9fd6 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.505293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cab9e-add8-47f0-8695-3298a7fb9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.505578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cab9e-add8-47f0-8695-3298a7fb9fd6 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.507182 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2053/4126] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:31.517425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:31.531202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.540096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ded0d8-aaf3-47ff-85e6-b7abedd0c040 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.544890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.545777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.546072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.546352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/bf9dcac865924a2085c4632e27921fbd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.547572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=bf9dcac865924a2085c4632e27921fbd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.549687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.551411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2074/4127] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/projects/bf9dcac865924a2085c4632e27921fbd => generated 369 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.673494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f979-307d-4b88-b180-c7aa1abb65f5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.673782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f979-307d-4b88-b180-c7aa1abb65f5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.674064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f979-307d-4b88-b180-c7aa1abb65f5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.675439 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2054/4128] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:31.680325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:31.694705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.705428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ded3cf-0f66-4d37-8f10-310af9ec551c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.710082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.711597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.711888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.712166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/bf9dcac865924a2085c4632e27921fbd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.713570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=bf9dcac865924a2085c4632e27921fbd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.716156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.718067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2075/4129] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:31 2022] GET /identity/v3/projects/bf9dcac865924a2085c4632e27921fbd => generated 369 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:31.750107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745f979-307d-4b88-b180-c7aa1abb65f5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.764856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745f979-307d-4b88-b180-c7aa1abb65f5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.769353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.770237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.770524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.770803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/users/b98461574ae04936aabbe9b384847465` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.786389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b98461574ae04936aabbe9b384847465)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.788403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:31.840662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98461574ae04936aabbe9b384847465'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:31.850561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98461574ae04936aabbe9b384847465'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:31.874829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98461574ae04936aabbe9b384847465'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:31.875686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98461574ae04936aabbe9b384847465'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:31.876403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb895fc9-525b-4e31-af9d-b889ed4d1f1a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98461574ae04936aabbe9b384847465'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:31.891048 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2055/4130] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:31 2022] DELETE /identity/v3/users/b98461574ae04936aabbe9b384847465 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:31.895211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:31.897225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:31.912582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5907c2-d881-4112-a304-ef03624538e7 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:31.990872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:31.991778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:31.992073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:31.992368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/bf9dcac865924a2085c4632e27921fbd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:31.994161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf9dcac865924a2085c4632e27921fbd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:31.997194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:32.061432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:32.063138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9dcac865924a2085c4632e27921fbd', 'request_id': 'req-8ed16a60-e9f2-4264-929b-8d1956a7f580'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:32.077861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9dcac865924a2085c4632e27921fbd', 'request_id': 'req-8ed16a60-e9f2-4264-929b-8d1956a7f580'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:32.083691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9dcac865924a2085c4632e27921fbd', 'request_id': 'req-8ed16a60-e9f2-4264-929b-8d1956a7f580'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:32.096031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] The token cache is being invalidate because project bf9dcac865924a2085c4632e27921fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:32.096322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:32.097018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:32.098604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2076/4131] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:31 2022] DELETE /identity/v3/projects/bf9dcac865924a2085c4632e27921fbd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:32.116021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a850-fe29-455a-81c7-8e6c4b7fb9c2 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.116312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a850-fe29-455a-81c7-8e6c4b7fb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.116625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a850-fe29-455a-81c7-8e6c4b7fb9c2 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.118170 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2056/4132] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:32.122995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:32.124479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:32.201085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:32.202301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:32.269965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16a60-e9f2-4264-929b-8d1956a7f580 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:32.274876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:32.275756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.276075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.276354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.277611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=681cedebb0ca40b1bf5214248e378031)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:32.279722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:32.281676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2077/4133] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:32 2022] GET /identity/v3/projects/681cedebb0ca40b1bf5214248e378031 => generated 373 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:32.313022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b971e-0d93-40f0-8ceb-7ea94e6b2cef None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.313247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b971e-0d93-40f0-8ceb-7ea94e6b2cef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.313556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b971e-0d93-40f0-8ceb-7ea94e6b2cef None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.314939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2057/4134] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:32.319821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:32.321745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:32.339691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:32.348932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184f9b-5ec4-496a-976c-5a29aef9367b tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:32.354264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:32.355134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.355422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.355708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.356971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=681cedebb0ca40b1bf5214248e378031)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:32.359003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:32.360970 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2078/4135] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:32 2022] GET /identity/v3/projects/681cedebb0ca40b1bf5214248e378031 => generated 373 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:32.678796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.679526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.680037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.681668 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2058/4136] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:06:32.698637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:06:32.729070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:32.743324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfea2c8-2b17-4401-ab21-faa08250f7ec tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:32.748504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a080b09985845059a8b11875bbd2f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:32.749387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:32.749679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:32.749960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:32.752579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorizing `identity:get_project(project_id=681cedebb0ca40b1bf5214248e378031)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:32.754652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92fafe-4335-46f0-8d63-6808819acb48 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:32.757624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2079/4137] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:06:32 2022] GET /identity/v3/projects/681cedebb0ca40b1bf5214248e378031 => generated 373 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:33.130738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:33.132567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:33.144691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:33.202857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac222cc-5c73-482b-a2a8-c27118097d8e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:33.208155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:33.209167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:33.209514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:33.209927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] PATH_INFO: `/v3/users/2e11fc4c10eb448e814f442b3daa63ae` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:33.211349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e11fc4c10eb448e814f442b3daa63ae)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:33.213577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:33.263440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e11fc4c10eb448e814f442b3daa63ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:33.273807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e11fc4c10eb448e814f442b3daa63ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:33.285975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e11fc4c10eb448e814f442b3daa63ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:33.287113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e11fc4c10eb448e814f442b3daa63ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:33.287738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e11fc4c10eb448e814f442b3daa63ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:33.300691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2059/4138] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:33 2022] DELETE /identity/v3/users/2e11fc4c10eb448e814f442b3daa63ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:33.305655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:33.306216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:33.306216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:33.325278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:33.327031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:33.384600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:33.399786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2080/4139] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:33.410409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:33.413304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:33.484094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69a66-aee1-4528-8c07-53d13b26e106 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:33.488953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:33.489895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:33.490079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:33.490395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:33.509847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:33.512134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:33.523207 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2060/4140] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:34.202788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:34.204745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:34.230189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24d97-f7ba-4db7-8b4f-9f874cca4970 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:34.242257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:34.246648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:34.247527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:34.249049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] PATH_INFO: `/v3/projects/681cedebb0ca40b1bf5214248e378031` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:34.252803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681cedebb0ca40b1bf5214248e378031)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:34.258957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:34.374729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681cedebb0ca40b1bf5214248e378031', 'request_id': 'req-18f61c00-1f8f-4ab8-8314-d67ec2011e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.399518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681cedebb0ca40b1bf5214248e378031', 'request_id': 'req-18f61c00-1f8f-4ab8-8314-d67ec2011e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.413771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681cedebb0ca40b1bf5214248e378031', 'request_id': 'req-18f61c00-1f8f-4ab8-8314-d67ec2011e78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.431420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] The token cache is being invalidate because project 681cedebb0ca40b1bf5214248e378031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:34.431754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.432800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.435944 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2081/4141] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:34 2022] DELETE /identity/v3/projects/681cedebb0ca40b1bf5214248e378031 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:34.440156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:34.459330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb978b-9618-4913-9c49-7a9ae6e8e551 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:34.512553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:34.561584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:34.562614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:34.563499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:34.563863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] PATH_INFO: `/v3/users/7a080b09985845059a8b11875bbd2f62` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:34.565543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a080b09985845059a8b11875bbd2f62)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:34.567777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:34.665868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a080b09985845059a8b11875bbd2f62'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.696818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a080b09985845059a8b11875bbd2f62'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.725945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a080b09985845059a8b11875bbd2f62'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.726747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a080b09985845059a8b11875bbd2f62'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.727740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-149419ae-20d4-4713-8296-ac71fecd5fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a080b09985845059a8b11875bbd2f62'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:34.754293 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2061/4142] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:34 2022] DELETE /identity/v3/users/7a080b09985845059a8b11875bbd2f62 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:35.225756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:35.227473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:35.243459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f61c00-1f8f-4ab8-8314-d67ec2011e78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:35.357283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:35.359267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.359716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.364238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] PATH_INFO: `/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.366075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3725a855c2dc4fbd8f246b8e6fa10b9c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:35.368464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:35.437310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'request_id': 'req-3370bc02-2347-47b4-bdfb-64ce28831005'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:35.451186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'request_id': 'req-3370bc02-2347-47b4-bdfb-64ce28831005'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:35.458641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3725a855c2dc4fbd8f246b8e6fa10b9c', 'request_id': 'req-3370bc02-2347-47b4-bdfb-64ce28831005'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:35.473636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] The token cache is being invalidate because project 3725a855c2dc4fbd8f246b8e6fa10b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:35.474173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:35.475893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3370bc02-2347-47b4-bdfb-64ce28831005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:35.478348 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2082/4143] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:35 2022] DELETE /identity/v3/projects/3725a855c2dc4fbd8f246b8e6fa10b9c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:35.486108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.487127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.488142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.521601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:35.523218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:35.607918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2062/4144] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:35.617615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.617911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.618383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.641278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:35.643075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:35.657287 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2083/4145] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:35.658752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:35.683067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6ca50-28c9-43c4-8744-3e6bbc7158ef None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:35.689444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:35.690486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.691755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.692887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.695349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:35.695908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:35.697804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:35.718812 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2063/4146] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:35.719381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:35.724512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:35.733460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88bbb2-87ea-4eb6-a468-6634573e4467 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:35.746483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:35.747148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.747509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.748117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.751672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:35.755730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:35.804076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2084/4147] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:35.807541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:35.837841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcff11-389f-43dc-a454-7628571e11fd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:35.895293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:35.941644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:35.942364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:35.942648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:35.942926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:35.943634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:35.945636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.005905 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2064/4148] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:35 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:36.010626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.022730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954089b8-98ec-4ef0-8759-dfbe5946b848 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.032371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.033842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.034161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.038328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.038328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.041642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.055844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2085/4149] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:36.062533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.096322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d547d-c64b-4c30-8d80-3a92c8815a02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.107032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.109111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.109563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.111945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.112910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.116265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538d42-daee-40d9-8849-b5b2fe4c2309 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.145892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2065/4150] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:36.149881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.164955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3de2-45eb-4545-bbfb-f0832c0a6254 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.179115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.180359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.180831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.181279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] PATH_INFO: `/v3/projects/ccdbe2fec6454cef988cb3ed5466c6fe/users/ea5a50f6e8ea470894e19f8c1dec476f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.221618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdbe2fec6454cef988cb3ed5466c6fe, user_id=ea5a50f6e8ea470894e19f8c1dec476f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.224341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.288502 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2086/4151] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:36 2022] PUT /identity/v3/projects/ccdbe2fec6454cef988cb3ed5466c6fe/users/ea5a50f6e8ea470894e19f8c1dec476f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:36.293041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.293746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.294273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.335898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] MFA Rules not processed for user `ea5a50f6e8ea470894e19f8c1dec476f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:36.337876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:36.441673 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2066/4152] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:36.446297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.564223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017181b-a796-4e61-9e3f-7e10df048389 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.571364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.572525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.573075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.573680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.575485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.578344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.613898 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2087/4153] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:36 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:36.616312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.633803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f753e6-9403-4bee-9014-0c8f430c029d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.716000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.716871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.717249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.717620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.718416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.720825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.745376 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2067/4154] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:36 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:36.749114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.770594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976438-3610-4700-9ff6-fbe2ff6b3b89 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.777794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.778813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.779256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.779690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.780993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.784235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.798518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2088/4155] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:06:36.802789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.815282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf8174-c66c-41be-bbea-0c07d4ed6ef3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.821912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.823994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.824453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.824907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] PATH_INFO: `/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1/users/88463db42cde4aa7927c954a8f482553/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.843840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e9c5ec661d4a0181faabeeb9e393f1, user_id=88463db42cde4aa7927c954a8f482553, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.846619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.861935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2068/4156] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:36 2022] PUT /identity/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1/users/88463db42cde4aa7927c954a8f482553/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:36.866189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:36.876912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50316c09-6a48-4636-a9b0-7fcd7cd5303d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:36.968577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:36.969910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:36.970384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:36.971741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:36.973368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:36.975146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510baa8d-38fc-40a6-98a3-6eda9f1242da admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:36.987643 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2089/4157] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:36.993155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:37.006423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25925bf-7e75-48bd-8455-af3a61dabdcc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:37.013265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:37.015635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:37.016612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:37.017235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] PATH_INFO: `/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1/users/88463db42cde4aa7927c954a8f482553/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:37.021605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e9c5ec661d4a0181faabeeb9e393f1, user_id=88463db42cde4aa7927c954a8f482553, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:37.033184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a908db-8883-4e98-99ae-f697f8442ac1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:37.041454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:37.060762 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2069/4158] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:36 2022] PUT /identity/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1/users/88463db42cde4aa7927c954a8f482553/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:37.064707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:37.065822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:37.066487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:37.105793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] MFA Rules not processed for user `88463db42cde4aa7927c954a8f482553`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:37.108049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:37.133548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:37.261356 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2090/4159] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:37.276147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4f85-323c-4fae-a896-161cc3a1e7e6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:37.276460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4f85-323c-4fae-a896-161cc3a1e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:37.276741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe4f85-323c-4fae-a896-161cc3a1e7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:37.321615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dafe4f85-323c-4fae-a896-161cc3a1e7e6 None None] MFA Rules not processed for user `ea5a50f6e8ea470894e19f8c1dec476f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:37.322909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dafe4f85-323c-4fae-a896-161cc3a1e7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:37.384000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2070/4160] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:37.481820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:37.483280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:37.625727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243d03-c920-4ec5-90a1-dce09c2f3e1b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:37.632181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:37.633231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:37.633827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:37.634164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:37.644699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:37.646527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:37.671365 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2091/4161] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:38.165132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901278-205b-43b7-a99b-c35a9bba725d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:38.165718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901278-205b-43b7-a99b-c35a9bba725d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:38.165718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901278-205b-43b7-a99b-c35a9bba725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:38.201549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-be901278-205b-43b7-a99b-c35a9bba725d None None] MFA Rules not processed for user `ea5a50f6e8ea470894e19f8c1dec476f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:38.202813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be901278-205b-43b7-a99b-c35a9bba725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:38.227314 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2071/4162] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:47.640965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:47.642353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:47.770446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a0fb-b23a-42de-bb6e-8d0d48f6e6ee service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:47.775125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:47.776023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:47.776557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:47.776932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:47.779071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:47.813198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:47.821958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:47.846000 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2092/4163] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:48.184672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=29 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:48.448312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:48.448627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:48.448903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:48.470960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] MFA Rules not processed for user `9c53269024eb4c238ec405606e36a049`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:48.471870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:48.537188 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2072/4164] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:50.230966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:50.233591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:50.249039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae91cb-3c43-4c15-9bb8-d7765951a2f8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:50.253133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:50.254037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:50.254530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:50.255172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:50.257641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:50.274528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:50.276039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:50.289854 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2093/4165] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:52.912231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:52.914933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:53.095977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510eb4-ea2d-49fd-b9a2-09904876b511 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:53.101621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:53.102610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:53.103142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:53.103737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] PATH_INFO: `/v3/users/fdc9d61eb01b444f9071248ecbd1bc43` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:53.105182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc9d61eb01b444f9071248ecbd1bc43)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:53.107824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:53.194344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc9d61eb01b444f9071248ecbd1bc43'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:53.233913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc9d61eb01b444f9071248ecbd1bc43'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:53.256097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc9d61eb01b444f9071248ecbd1bc43'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:53.257272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc9d61eb01b444f9071248ecbd1bc43'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:53.258028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc9d61eb01b444f9071248ecbd1bc43'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:53.286101 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2073/4166] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:52 2022] DELETE /identity/v3/users/fdc9d61eb01b444f9071248ecbd1bc43 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:53.446891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:53.448978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:53.470392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:53.591023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea68feb-9baa-4fc6-a71d-375be130aa96 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:53.740081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:53.741585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:53.742413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:53.760481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:53.767775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:53.841766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:53.843800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:53.931808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:53.939238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:53.941456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76f065-4cc5-4abd-a270-9152f66432fd service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:53.956245 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2094/4167] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:54.053085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96cccf-577b-4bc5-bee1-cc79496e34a9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:54.068132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:54.071657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.071955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.072366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] PATH_INFO: `/v3/projects/646b2a5c42444e6891d6cc44e816c918` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.074897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646b2a5c42444e6891d6cc44e816c918)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:54.081527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:54.177625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646b2a5c42444e6891d6cc44e816c918', 'request_id': 'req-124c1d9c-862b-47c7-a697-470054ee91c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.191673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646b2a5c42444e6891d6cc44e816c918', 'request_id': 'req-124c1d9c-862b-47c7-a697-470054ee91c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.204218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646b2a5c42444e6891d6cc44e816c918', 'request_id': 'req-124c1d9c-862b-47c7-a697-470054ee91c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.222980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] The token cache is being invalidate because project 646b2a5c42444e6891d6cc44e816c918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:54.223795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.224762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-124c1d9c-862b-47c7-a697-470054ee91c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.234514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2074/4168] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:53 2022] DELETE /identity/v3/projects/646b2a5c42444e6891d6cc44e816c918 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:06:54.235295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.235589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.235877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.261008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:54.262577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:54.400966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2095/4169] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:06:54.411855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.412319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.412404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.438693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:54.441158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:54.455429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:54.457271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:54.465531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d8c13-1689-4072-976a-be48ff34b75f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:54.483087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:54.486399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.487041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.488554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] PATH_INFO: `/v3/users/ed80bbb76f8e4636a8ba37c23790b74f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.495428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed80bbb76f8e4636a8ba37c23790b74f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:54.505023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:54.529422 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2075/4170] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:54.530544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:54.535433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:54.563527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d2d42-fba9-4ac6-95f5-5247e021e5c2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:54.583913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:54.585119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.585595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.585975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.592355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:54.592845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:54.601811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:54.628126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed80bbb76f8e4636a8ba37c23790b74f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.634143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed80bbb76f8e4636a8ba37c23790b74f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.636414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2076/4171] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:06:54.640828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:54.647111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:54.657332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed80bbb76f8e4636a8ba37c23790b74f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.671164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6465a-7696-451d-a44a-4170bffec47a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:54.681010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:54.681999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.682451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.682885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.683768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:54.686139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:54.689613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed80bbb76f8e4636a8ba37c23790b74f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.729839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-891598ed-222b-48ff-a343-817218ea1772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed80bbb76f8e4636a8ba37c23790b74f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:54.741456 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2077/4172] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:54 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:54.745877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:54.765701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2096/4173] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:06:54 2022] DELETE /identity/v3/users/ed80bbb76f8e4636a8ba37c23790b74f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:54.767627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.769174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.769685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.795669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:54.797236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:54.891875 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2097/4174] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:54.958069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ab107-f764-4dfe-8f25-761990077283 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:54.970218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:54.971265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:54.971704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:54.972126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:54.973449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:54.977770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.019421 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2078/4175] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:54 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:55.023999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:55.040568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c62c2-e7ce-4d8a-ba2e-db4c2bc49f49 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:55.049772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:55.051154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.051908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.052622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.053788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:55.056111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.072622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2098/4176] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:55.076563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:55.084750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:55.095464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc4331-5a05-4b4d-8cee-31f3f2f37888 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:55.101788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:55.105493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:55.111703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:55.112416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.112724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.113004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.113752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:55.116033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.142344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2079/4177] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:55.157452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:55.173933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73830-e9ab-4cdf-9912-4daec0a3a326 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:55.187313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:55.188249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.188555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.188834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] PATH_INFO: `/v3/projects/29c4645abed4410981601604f61a3d89/users/5b01ed1ecd8d4609a5a277f96e8a8445/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.223722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478a74-b97d-4e42-acb3-4d2cff9a6209 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:55.224935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c4645abed4410981601604f61a3d89, user_id=5b01ed1ecd8d4609a5a277f96e8a8445, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:55.227655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1e96-83f6-49f0-a773-360b37fc9cd5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.229073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:55.230305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.230880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.231489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.250194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:55.252807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.254767 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2080/4178] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:55 2022] PUT /identity/v3/projects/29c4645abed4410981601604f61a3d89/users/5b01ed1ecd8d4609a5a277f96e8a8445/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:55.262256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.262541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.262807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.270260 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2099/4179] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:55.290751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:55.292192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:55.426610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2081/4180] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:55.445023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:55.446558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:55.466414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f74ec-c83e-46ce-b991-f0e2b3a9fd72 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:55.507567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:55.581058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:55.581920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:55.582354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:55.582781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:55.597379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:55.599434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db52708-7bc5-4887-9ea1-9fb05da03759 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:55.622947 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2100/4181] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:57.597388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:57.599516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:57.613824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5a8d-a2df-4238-9565-a34eec1d804b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:57.623018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:57.623808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:57.624091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:57.624970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] PATH_INFO: `/v3/projects/7748ea0850294ce78a3f390458685b9b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:57.626295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7748ea0850294ce78a3f390458685b9b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:57.628324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:57.687615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7748ea0850294ce78a3f390458685b9b', 'request_id': 'req-99cb526c-12fd-4674-8bbf-d8edf3d1c188'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:57.705532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7748ea0850294ce78a3f390458685b9b', 'request_id': 'req-99cb526c-12fd-4674-8bbf-d8edf3d1c188'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:57.721378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7748ea0850294ce78a3f390458685b9b', 'request_id': 'req-99cb526c-12fd-4674-8bbf-d8edf3d1c188'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:57.752796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] The token cache is being invalidate because project 7748ea0850294ce78a3f390458685b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:06:57.753594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:57.754510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99cb526c-12fd-4674-8bbf-d8edf3d1c188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:06:57.756938 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2082/4182] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:06:57 2022] DELETE /identity/v3/projects/7748ea0850294ce78a3f390458685b9b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:57.762205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:57.762697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:57.762809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:57.789439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:57.790946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:57.878876 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2101/4183] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:57.887152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:57.888125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:57.888478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:57.911191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:57.912829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:57.927927 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2083/4184] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:57.928745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:57.941397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982283-0f48-40d1-8410-2bb45a492e71 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:57.950016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:57.951112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:57.951582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:57.952037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:57.953003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:06:57.953475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:57.955345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:57.978929 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2102/4185] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:06:57.983336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:57.997073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45961366-90c6-4431-b8d7-faa72fd9cb13 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:58.005010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:58.006478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.007203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.007712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.010052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:58.014044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:58.080917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2084/4186] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:06:57 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:06:58.081845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:58.094917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b03f2-15db-4eab-8e69-7171e159d7e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:58.246120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:58.247004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.247448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.247702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.248467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:58.256170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:58.333606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:58.338731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2103/4187] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:06:58 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:06:58.350677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987f9b-81d6-49e4-9301-cdc62f5c4dc4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:58.363711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:58.364536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.364888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.365235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.366141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:58.367832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:58.406499 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2085/4188] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:58.409837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:58.428209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8fd34-3900-4349-9fc9-c2d11573d9d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:58.446752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:58.447838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.448168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.448546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.451537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:58.455637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf8ea-be96-40de-8956-d8f010c28c73 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:58.504522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2104/4189] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:06:58.505539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:58.521315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd8c8c-14e7-4760-82c1-1bf509d40fb8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:58.538118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:58.539398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.539784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.541926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] PATH_INFO: `/v3/projects/ca0bcba91f3a4e749c46c491d5270fe2/users/69be43ab3b044443b83d47d98f57ab1b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.566293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:58.589501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0bcba91f3a4e749c46c491d5270fe2, user_id=69be43ab3b044443b83d47d98f57ab1b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:58.615068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cfeb7-0a95-4b4d-a82e-3f4ba29b05d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:58.656717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2086/4190] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:06:58 2022] PUT /identity/v3/projects/ca0bcba91f3a4e749c46c491d5270fe2/users/69be43ab3b044443b83d47d98f57ab1b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:06:58.667279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.667574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.667857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.721411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] MFA Rules not processed for user `69be43ab3b044443b83d47d98f57ab1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:58.722826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:58.767264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:58.871354 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2105/4191] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:58.883508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:58.884898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:58.885320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:58.926750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] MFA Rules not processed for user `69be43ab3b044443b83d47d98f57ab1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:06:58.931033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:58.968801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2087/4192] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:06:59.137864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:59.139503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:59.277448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e0ec-eb8b-4d78-9ca0-6d6ad67d443a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:59.283199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:59.284088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:59.284593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:59.285072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:59.301546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:59.303602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:59.318147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2106/4193] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:06:59.635615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:06:59.637326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:59.787916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a25f-6451-4516-92e0-b28d391b8f55 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:06:59.802976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:06:59.804251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:06:59.804662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:06:59.805028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:06:59.810200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:06:59.837277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:06:59.840356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e12f9-a6c5-4da2-88a9-9e1d8938d05d service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:06:59.861450 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2088/4194] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:01.266094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:01.276039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:01.441863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e02a3-aae4-490d-b438-eb1c8462a751 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:01.449480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:01.450177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:01.450626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:01.451985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:01.467474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:01.490350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:01.503557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:01.527384 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2107/4195] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:04.319551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:04.320049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:04.320347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:04.358444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] MFA Rules not processed for user `ea5a50f6e8ea470894e19f8c1dec476f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:04.366140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:04.541389 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2089/4196] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:10.609935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:10.612302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:10.626283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16619e60-bf6b-48ca-925c-f05e2d71b297 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:10.630392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:10.631233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:10.631607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:10.632130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:10.635270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:10.647594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:10.649361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:10.695976 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2108/4197] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:12.207987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:12.210155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:12.401156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ecc19-3dfc-451b-9bc8-54cd65cdab49 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:12.421929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:12.423276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:12.423780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:12.424306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] PATH_INFO: `/v3/users/6b7cbda91af54f84a9432ddbf6abec2a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:12.426095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7cbda91af54f84a9432ddbf6abec2a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:12.428326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:12.461520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:12.537028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7cbda91af54f84a9432ddbf6abec2a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:12.564233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7cbda91af54f84a9432ddbf6abec2a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:12.614119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7cbda91af54f84a9432ddbf6abec2a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:12.615665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7cbda91af54f84a9432ddbf6abec2a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:12.616938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e915c90b-5ce1-4e1b-b658-1ba58dac9e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7cbda91af54f84a9432ddbf6abec2a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:12.655294 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2090/4198] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:07:12 2022] DELETE /identity/v3/users/6b7cbda91af54f84a9432ddbf6abec2a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:13.193545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:13.230277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff65-41a7-4c66-a569-2d2d9e24acc8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:13.274832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:13.302763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:13.303863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.304311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.304620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] PATH_INFO: `/v3/projects/034b90cc1b144b43b2aec3feaeb65f74` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.306065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=034b90cc1b144b43b2aec3feaeb65f74)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:13.307990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:13.373485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034b90cc1b144b43b2aec3feaeb65f74', 'request_id': 'req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:13.385390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034b90cc1b144b43b2aec3feaeb65f74', 'request_id': 'req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:13.393487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034b90cc1b144b43b2aec3feaeb65f74', 'request_id': 'req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:13.409924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] The token cache is being invalidate because project 034b90cc1b144b43b2aec3feaeb65f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:07:13.410199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:13.411349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2d32e5f-b91f-4cbf-b36a-c9a6da6237c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:13.416922 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2109/4199] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:07:13 2022] DELETE /identity/v3/projects/034b90cc1b144b43b2aec3feaeb65f74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:13.418542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d58ab-a306-49e6-83ad-735bd30c33e7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.419018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d58ab-a306-49e6-83ad-735bd30c33e7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.419169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d58ab-a306-49e6-83ad-735bd30c33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.441127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-400d58ab-a306-49e6-83ad-735bd30c33e7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:13.442510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-400d58ab-a306-49e6-83ad-735bd30c33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:13.522952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e93d5-61e4-498e-a444-d97f0960de85 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.523317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e93d5-61e4-498e-a444-d97f0960de85 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.523835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e93d5-61e4-498e-a444-d97f0960de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.549752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2091/4200] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:13.557897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.558220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.558501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.571845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c14e93d5-61e4-498e-a444-d97f0960de85 None None] MFA Rules not processed for user `5b01ed1ecd8d4609a5a277f96e8a8445`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:13.573355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c14e93d5-61e4-498e-a444-d97f0960de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:13.600385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:13.603218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:13.620676 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2092/4201] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:07:13.625299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:13.639001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cfd32-af5b-48b0-a2c7-6e64784bb731 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:13.646911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:13.647949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.648398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.649034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.650026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:07:13.651158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:13.653240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:13.674025 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2093/4202] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:07:13.678864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:13.695325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aecd7-225a-46f1-9047-70c8a62a1e1e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:13.702757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:13.703905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.704815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.705947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.707025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:13.711118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:13.760621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2094/4203] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:13.762489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:13.785243 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2110/4204] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:13.800464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.801376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.801872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.829570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] MFA Rules not processed for user `5b01ed1ecd8d4609a5a277f96e8a8445`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:13.831207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:13.893581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:13.912303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5805-dabc-4e2a-86a6-479fd98fa473 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:13.916639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:13.924139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:13.925715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:13.926302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:13.926797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:13.927732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:13.932547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:13.938675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2111/4205] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:13.975837 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2095/4206] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:13 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:13.977555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:13.991661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1849d9-b174-40ef-a0c3-85327a5c371e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:14.005288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:14.006794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.007831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.010622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.011591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:14.013437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:14.045173 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2112/4207] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:14.047410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:14.068940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01529f4-32fb-4e39-b48d-357534a1a08c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:14.079810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:14.082580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.082992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.083669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.085140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:14.090847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a51b6-bc7e-4c8d-9f67-2c420193324a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:14.126667 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2096/4208] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:14.130573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:14.142380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcff78-fb3e-4c65-8fda-af3576ff26a7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:14.173910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:14.174846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.175145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.175428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] PATH_INFO: `/v3/projects/4e97b91d23b24e7aba5860e7d0bd062c/users/ec129d5641ef457c99014e8f95fcfb5d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.210003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e97b91d23b24e7aba5860e7d0bd062c, user_id=ec129d5641ef457c99014e8f95fcfb5d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:14.213124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:14.247071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2113/4209] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:14 2022] PUT /identity/v3/projects/4e97b91d23b24e7aba5860e7d0bd062c/users/ec129d5641ef457c99014e8f95fcfb5d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:14.249115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.249675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.249994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.283115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:14.286562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:14.417637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2097/4210] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:14.450467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:14.452305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:14.454046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:14.454217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:14.583641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4123-f5b3-4d9f-a280-759459e3388c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:14.593882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:14.594548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.594828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.595102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.614606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:14.616925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:14.639194 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2114/4211] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:14.655717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5a53-6f0a-46ba-833b-c9dcc738496c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:14.685839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:14.686628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:14.687090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:14.687571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:14.839417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:14.842695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7de4-1b32-4907-a6c7-e507f9c900aa service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:14.883747 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2098/4212] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:22.839612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:22.841169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:22.858781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579cbf-b095-40f8-b105-33c0513a7330 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:22.890907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:22.894163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:22.895617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:22.896176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] PATH_INFO: `/v3/users/ad1c7bd32c4b4e8c85f02eebaa6b2ab1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:22.898111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1c7bd32c4b4e8c85f02eebaa6b2ab1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:22.901630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:23.032288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1c7bd32c4b4e8c85f02eebaa6b2ab1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:23.033233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1c7bd32c4b4e8c85f02eebaa6b2ab1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:23.050864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1c7bd32c4b4e8c85f02eebaa6b2ab1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:23.090594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1c7bd32c4b4e8c85f02eebaa6b2ab1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:23.127860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1c7bd32c4b4e8c85f02eebaa6b2ab1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:23.135178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2115/4213] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:07:22 2022] DELETE /identity/v3/users/ad1c7bd32c4b4e8c85f02eebaa6b2ab1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:23.139670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:23.140165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:23.140257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:23.170844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:23.172314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:23.179110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:23.281519 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2099/4214] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:23.368700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:23.370188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:23.463292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:23.492897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb5b24-94d8-465b-9a44-63f30cb333cc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:23.497672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:23.498678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:23.499262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:23.499820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:23.514136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:23.516151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:23.528724 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2116/4215] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:23.828083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:23.830853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:23.957784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2553e6-763d-4c1d-88f0-50f24d17d2e7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:23.964600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:23.965412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:23.965761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:23.966105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:23.968078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:24.058412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:24.060662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cdf4b-bbf1-4a9f-a3bb-522f3d5e774d service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:24.075145 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2100/4216] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:25.031150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:25.032681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:25.069838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade957f9-f603-4521-ad64-391911fc544b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:25.081442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:25.082658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.083344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.084105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] PATH_INFO: `/v3/projects/a5859161af684c308497d87013d53045` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.087873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5859161af684c308497d87013d53045)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:25.091317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:25.259688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5859161af684c308497d87013d53045', 'request_id': 'req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:25.296075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5859161af684c308497d87013d53045', 'request_id': 'req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:25.312159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5859161af684c308497d87013d53045', 'request_id': 'req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:25.337789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] The token cache is being invalidate because project a5859161af684c308497d87013d53045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:07:25.340237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:25.342339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14feb302-86a5-4d0a-96c8-b6b6bd163d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:25.347567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2117/4217] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:07:25 2022] DELETE /identity/v3/projects/a5859161af684c308497d87013d53045 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:25.349429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.349918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.350017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.382383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:25.383861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:25.486012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:25.519083 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2101/4218] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:25.527527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.528074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.528735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.565366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:25.566802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:25.576064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2118/4219] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:25.580205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:25.596348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c66a2-0f15-4899-b2aa-a380d3322e9f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:25.602696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:25.603597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.604387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.605840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.606876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:07:25.607610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:25.610634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:25.641362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2102/4220] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:07:25.645908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:25.659003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48033f56-0551-4a7d-a70b-d639bf528934 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:25.671849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:25.672821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.673425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.673894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.674885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:25.682218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:25.769492 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2119/4221] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:25 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:25.778543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:25.801108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa5e01-8595-462a-8ca4-f87b2ef5472a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:25.966138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:25.966855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:25.967141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:25.967422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:25.973061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:25.976240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.045368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:26.045968 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2103/4222] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:25 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:26.060661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d819a-bacf-45a7-b38a-c720ef2ea004 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:26.065748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:26.066686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.067152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.067592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.068712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:26.070500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.096770 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2120/4223] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:07:26.099667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:26.116134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dec1-c5cb-49a3-aff0-17d3929eab33 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:26.124728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:26.126686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.127020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.127394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.128278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:26.131597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527db17-91f4-4bfe-8c23-009812db9f31 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.153539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:26.153982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2104/4224] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:26.172178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63056a-87a4-4e40-a25c-efada5d52e21 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:26.189067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:26.191988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.194376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.196840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] PATH_INFO: `/v3/projects/b10b0457e0e94a6c944fa20c3f75e33e/users/b05a7235318f4ad6a4453603e5310237/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.228338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10b0457e0e94a6c944fa20c3f75e33e, user_id=b05a7235318f4ad6a4453603e5310237, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:26.231485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.257183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2121/4225] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:26 2022] PUT /identity/v3/projects/b10b0457e0e94a6c944fa20c3f75e33e/users/b05a7235318f4ad6a4453603e5310237/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:26.268546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.269079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.269371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.300911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] MFA Rules not processed for user `b05a7235318f4ad6a4453603e5310237`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:26.302173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:26.381704 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2105/4226] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:26.396934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:26.399918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:26.483068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f23d-abc5-44c8-8c27-09bc795e5e65 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:26.486832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:26.487671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.488132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.488415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.498987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:26.500976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9175df-62f1-404c-91cd-9d11a41cac81 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.524009 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2122/4227] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:26.581605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:26.598483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942255d-a0e7-44ba-bc61-30e5e28081c1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:26.609002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:26.610484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:26.611213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:26.611806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:26.615169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:26.698573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:26.777188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:26.779007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:26.814751 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2106/4228] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:07:27.093256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.093740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.094025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.102186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:27.127178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] MFA Rules not processed for user `ec129d5641ef457c99014e8f95fcfb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:27.129134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:27.246462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2123/4229] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:27.251538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:27.253381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:27.289394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231bd8b-e3ce-4b53-8b86-e0f95a01b3ba service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:27.296674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:27.297368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.297657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.297939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.300272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:27.304754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:27.358232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:27.359554 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2107/4230] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:27 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:07:27.377613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabc78-cefd-4332-9893-7582ecc1a9fa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:27.601739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:27.602543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.602836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.603121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.603820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:27.620606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:27.622395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:27.631721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:27.699557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2124/4231] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:27 2022] POST /identity/v3/users => generated 296 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:27.701454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:27.763980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421138b-21ec-4b6d-8999-c3946ccb3050 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:27.782834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:27.785314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.785608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.785893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.787958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:27.792972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:27.818828 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2125/4232] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:27.823102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:27.838174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56b9c-553b-47b2-966d-70e6efbcf19e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:27.850665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae31e0-f945-4243-9ca0-f0fe7fe33a28 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:27.854096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:27.854786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.855069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.855342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.861791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:27.864098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:27.864397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:27.864716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] PATH_INFO: `/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064/users/a7221bfe15c64e0d9509b3b44ebcfab9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:27.865598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:27.901899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:27.902790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=704ed985f3434c0e9e97b3c1d4bd6064, user_id=a7221bfe15c64e0d9509b3b44ebcfab9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:27.904040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:27.908280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:27.942511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2108/4234] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:27.942888 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2126/4234] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:27 2022] PUT /identity/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064/users/a7221bfe15c64e0d9509b3b44ebcfab9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:27.943946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:28.077536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:28.111033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182237-94ed-477e-a886-f71a11723d5f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:28.126166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:28.126957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:28.127249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:28.127525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:28.129717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:28.135446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:28.172155 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2127/4235] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:28.176090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:28.215760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2207c6-4286-47be-aee6-9265d5cbc702 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:28.232510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:28.233641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:28.235085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:28.235868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] PATH_INFO: `/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064/users/a7221bfe15c64e0d9509b3b44ebcfab9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:28.243695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=704ed985f3434c0e9e97b3c1d4bd6064, user_id=a7221bfe15c64e0d9509b3b44ebcfab9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:28.256121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:28.291491 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2109/4236] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:28 2022] PUT /identity/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064/users/a7221bfe15c64e0d9509b3b44ebcfab9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:37.332983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:37.334861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:37.384803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0034-ea2b-4039-8a0c-e9a3332512b2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:37.551096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:37.552143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:37.552458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:37.552914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] PATH_INFO: `/v3/users/a6a15dadfd0448fab9e84a89173ed7d1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:37.559151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a15dadfd0448fab9e84a89173ed7d1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:37.561342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:37.648873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a15dadfd0448fab9e84a89173ed7d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:37.650092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a15dadfd0448fab9e84a89173ed7d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:37.663890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a15dadfd0448fab9e84a89173ed7d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:37.682249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a15dadfd0448fab9e84a89173ed7d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:37.691871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f4075062-d510-4788-93c8-35edccb99281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a15dadfd0448fab9e84a89173ed7d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:37.702887 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2128/4237] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:07:37 2022] DELETE /identity/v3/users/a6a15dadfd0448fab9e84a89173ed7d1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:38.265260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:38.268561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:38.299864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6b15-c1cc-4c32-8220-ba67dd16fa6d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:38.395528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:38.397044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:38.397044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:38.397292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] PATH_INFO: `/v3/projects/b3349ed72f824bcb9d1ce52d238bc870` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:38.398721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3349ed72f824bcb9d1ce52d238bc870)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:38.401052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:38.468703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:38.547697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3349ed72f824bcb9d1ce52d238bc870', 'request_id': 'req-c989cd02-f899-40db-97bc-531c200a066d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:38.558253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3349ed72f824bcb9d1ce52d238bc870', 'request_id': 'req-c989cd02-f899-40db-97bc-531c200a066d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:38.566597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3349ed72f824bcb9d1ce52d238bc870', 'request_id': 'req-c989cd02-f899-40db-97bc-531c200a066d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:38.584153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] The token cache is being invalidate because project b3349ed72f824bcb9d1ce52d238bc870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:07:38.584490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:38.585184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c989cd02-f899-40db-97bc-531c200a066d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:38.591826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2110/4238] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:07:38 2022] DELETE /identity/v3/projects/b3349ed72f824bcb9d1ce52d238bc870 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:38.593601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:38.594120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:38.594396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:38.628529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:38.629944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:38.753664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2129/4239] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:38.763655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:38.764858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:38.765153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:38.801065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:38.802284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:38.820566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2111/4240] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:38.825221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:38.832239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:38.837260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1366cf-0e62-4267-9a4c-c50a47dc1ea2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:38.847267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:38.848455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:38.849495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:38.849952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:38.850864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:07:38.851403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:38.854439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:38.880298 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2130/4241] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:07:38.884767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:38.895911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2160cb-d294-4ca0-a721-c6b6bb2cb969 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:38.902170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:38.903213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:38.903668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:38.903939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:38.904670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:38.906660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:38.987188 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2112/4242] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:38 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:38.988307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:39.002467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfdd55-c1ba-479f-b729-f067af7735d5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:39.142407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:39.143114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.143401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.143676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.144610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:39.148946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:39.183630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2131/4243] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:38 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:39.188591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:39.202082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf999-db57-4b24-bb64-646f0b944f94 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:39.209279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:39.210126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.210524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.210898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.211815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:39.213699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:39.228543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2113/4244] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:39.232474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:39.246448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f646a-a615-4c89-991a-3590a003770f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:39.252703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:39.253542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.254050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.254389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.255278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:39.257453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918872ff-8ab4-4816-9d64-2dbf44c2a872 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:39.276852 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2132/4245] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:39.280916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:39.300267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307badd-a1be-4c1d-862a-62f228e0cb25 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:39.307340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:39.309805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.310423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.311002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] PATH_INFO: `/v3/projects/26b2606c05e441e58e2bba46a8ee48e5/users/b6aaf0215c7d4342b75c8921f1ac54d3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.346149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b2606c05e441e58e2bba46a8ee48e5, user_id=b6aaf0215c7d4342b75c8921f1ac54d3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:39.351953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:39.386533 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2114/4246] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:39 2022] PUT /identity/v3/projects/26b2606c05e441e58e2bba46a8ee48e5/users/b6aaf0215c7d4342b75c8921f1ac54d3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:39.387769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.388065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.388345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.448667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:39.453462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:39.568317 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2133/4247] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:07:39.638144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:39.646608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:39.794744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef765ab-c975-4722-8a03-66c23a3bc099 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:39.809672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:39.819388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:39.827202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:39.828553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:39.860499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:39.865440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb68a6-4210-4544-8530-7189eedebc0f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:39.892868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2115/4248] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:42.153890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:42.157215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:42.299098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720a70-41c4-4be8-b634-68d342a23b3f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:42.306742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:42.308205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:42.308832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:42.309400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:42.312098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:42.328203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:42.334056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:42.336252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:42.357459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2134/4249] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:42.768637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:42.769188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:42.769384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:42.811958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] MFA Rules not processed for user `a7221bfe15c64e0d9509b3b44ebcfab9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:42.813880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:42.905002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:42.984722 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2116/4250] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:43.010735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:43.013424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:43.138111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c7d71-818d-4a7e-aa59-4618a0fd22e4 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:43.144166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:43.144939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:43.145277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:43.145707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:43.147748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:43.247469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:43.249923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618fa96-80ce-4c9e-910c-ccea12e09a8c service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:43.261983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2135/4251] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:45.658607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:45.660157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:45.698653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91619035-ab3e-4d47-a80f-0ca020dbb113 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:45.735203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:45.737310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:45.737937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:45.738417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] PATH_INFO: `/v3/users/69be43ab3b044443b83d47d98f57ab1b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:45.744996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69be43ab3b044443b83d47d98f57ab1b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:45.748475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:45.876892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69be43ab3b044443b83d47d98f57ab1b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:45.892806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69be43ab3b044443b83d47d98f57ab1b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:45.929041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69be43ab3b044443b83d47d98f57ab1b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:45.931214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69be43ab3b044443b83d47d98f57ab1b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:45.932053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69be43ab3b044443b83d47d98f57ab1b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:45.970690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2117/4252] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:07:45 2022] DELETE /identity/v3/users/69be43ab3b044443b83d47d98f57ab1b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:45.975813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:45.976843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:45.977267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:46.008706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:46.011862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:46.244052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2136/4253] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:46.301337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:46.302829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:46.522629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ff41-49b8-436c-8491-95c53e37be85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:46.539690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:46.540412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:46.540893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:46.541381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:46.561996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:46.564037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdf405-565d-4573-b681-1d7cd6539207 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:46.585739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2118/4254] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:47.339330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:47.341407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:47.361379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cafb1-3aa9-4725-aa95-d7baf3ee7aac None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:47.376004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:47.377114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:47.377409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:47.377849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] PATH_INFO: `/v3/projects/ca0bcba91f3a4e749c46c491d5270fe2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:47.379201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0bcba91f3a4e749c46c491d5270fe2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:47.385014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:47.812707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:47.822615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0bcba91f3a4e749c46c491d5270fe2', 'request_id': 'req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:47.849598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0bcba91f3a4e749c46c491d5270fe2', 'request_id': 'req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:47.862274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0bcba91f3a4e749c46c491d5270fe2', 'request_id': 'req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:47.915443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] The token cache is being invalidate because project ca0bcba91f3a4e749c46c491d5270fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:07:47.915775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:47.917124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c23860ae-e9a2-40b4-8e36-ca73e0a5c6fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:07:47.919411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2137/4255] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:07:47 2022] DELETE /identity/v3/projects/ca0bcba91f3a4e749c46c491d5270fe2 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:47.924573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:47.925102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:47.925344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:47.958274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:47.966554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:48.083788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:48.117155 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2119/4256] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:48.124663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.125283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.125804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.163886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:48.165535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:48.187905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2138/4257] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:48.192011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.205457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74590f-c630-49a5-a1f6-52e9c81cbb59 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.225156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.226258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.226756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.228141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.234260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:07:48.235614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.241334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.282978 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2120/4258] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:07:48.287254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.299459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5830b-0581-4af2-be3e-ef8042d969db None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.312992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.313785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.314131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.314715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.315502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.317573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.384904 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2139/4259] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:48 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:48.385609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.411688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061424-5b36-4864-9d84-b6727b508eb7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.523864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.526247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.526530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.527130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.528714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.531618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.564512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.574009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2121/4260] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:48 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:07:48.578902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9cf84-57c9-423b-aadf-4d0463ecd563 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.587592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.588681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.589539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.589995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.590903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.592833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.613163 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2140/4261] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:48.614583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.626870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc296b-46f5-4e82-b4f2-915b7bd95967 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.632293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.633316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.633779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.634238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.635198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.637150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832780b-5c63-4cb2-ba9e-0d542c71a887 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.656363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:48.657571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2122/4262] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:48.669263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b55f2-41ae-4289-9920-4fe4e52dafde admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:48.675849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:48.677244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.677910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.678359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] PATH_INFO: `/v3/projects/8983a71e4a2142fc9fa3460969b2f425/users/10c0287a5f02499cb26cc144cd7588cf/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.701164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8983a71e4a2142fc9fa3460969b2f425, user_id=10c0287a5f02499cb26cc144cd7588cf, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:48.704594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:48.729982 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2141/4263] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:48 2022] PUT /identity/v3/projects/8983a71e4a2142fc9fa3460969b2f425/users/10c0287a5f02499cb26cc144cd7588cf/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:07:48.732625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362b0-4e8c-4aae-aa92-d0917ab0ed4c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:48.733251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362b0-4e8c-4aae-aa92-d0917ab0ed4c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:48.733788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362b0-4e8c-4aae-aa92-d0917ab0ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:48.807668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ad4362b0-4e8c-4aae-aa92-d0917ab0ed4c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:48.809253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ad4362b0-4e8c-4aae-aa92-d0917ab0ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:49.000975 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2123/4264] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:49.012099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:49.017365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:49.194750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d7a95-90a8-413f-a6a1-705ad50622a7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:49.208616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:49.209304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:49.209587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:49.209864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:49.246639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:49.248346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:49.275525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2142/4265] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:07:53.967528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:53.968106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:53.968106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.003244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] MFA Rules not processed for user `b6aaf0215c7d4342b75c8921f1ac54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:07:54.005248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:54.067154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:54.098806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2124/4266] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:07:54.104140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:54.106514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:07:54.122224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca3b5-98ca-4b3e-81e8-5e2cd7c92763 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:54.131303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:54.132314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:54.132903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:54.133454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.134424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:54.137198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:54.188164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2143/4267] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:07:54 2022] POST /identity/v3/projects => generated 403 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:54.190043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:54.207407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8238d-f69d-4dea-b5a6-d138608eceae None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:54.316404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:54.317626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:54.318135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:54.319190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.320536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:54.322947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:54.399182 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2125/4268] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:07:54 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:07:54.405234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:54.425073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0df3-c579-4161-a110-dccbc3fb2f36 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:54.436736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:54.438014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:54.438491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:54.438832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.439835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:54.442384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:54.478271 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2144/4269] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:54.490217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:54.515416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b836a4-f527-4165-9ba7-73464b53fa30 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:54.532980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:54.533740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:54.534084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:54.534373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.535808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:54.538036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a9588-9c6c-4feb-8964-95cd7d24874e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:54.559241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2126/4270] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:07:54.560375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:07:54.584193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3000d40-5da2-432b-a9b1-61c9bfc54e1a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:07:54.602237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:07:54.602877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:07:54.603160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:07:54.603615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] PATH_INFO: `/v3/projects/7ab1810b8d3f4b779e76e0c393c1c519/users/91429b3bdbb147e6ab7d91ebbba73af4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:07:54.647604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab1810b8d3f4b779e76e0c393c1c519, user_id=91429b3bdbb147e6ab7d91ebbba73af4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:07:54.651349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570feb30-cb28-4727-ab93-a3a91a2fb2fa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:07:54.694566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2145/4271] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:07:54 2022] PUT /identity/v3/projects/7ab1810b8d3f4b779e76e0c393c1c519/users/91429b3bdbb147e6ab7d91ebbba73af4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:02.415453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:02.418076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:02.418363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:02.480367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] MFA Rules not processed for user `ec129d5641ef457c99014e8f95fcfb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:02.487862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:02.654657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2127/4272] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:02.658462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050b2e-61cc-4566-9375-17995e26a211 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:02.661639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050b2e-61cc-4566-9375-17995e26a211 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:02.661912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050b2e-61cc-4566-9375-17995e26a211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:02.728265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-25050b2e-61cc-4566-9375-17995e26a211 None None] MFA Rules not processed for user `ec129d5641ef457c99014e8f95fcfb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:02.729841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25050b2e-61cc-4566-9375-17995e26a211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:02.765308 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2146/4273] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:05.036106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:05.038277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:05.199064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457618f-d4d1-451d-aaef-04de6525c96f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:05.210628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:05.217189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:05.218652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:05.218947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] PATH_INFO: `/v3/users/9c53269024eb4c238ec405606e36a049` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:05.220316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c53269024eb4c238ec405606e36a049)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:05.222957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:05.245115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:05.322081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c53269024eb4c238ec405606e36a049'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:05.346705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c53269024eb4c238ec405606e36a049'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:05.363160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c53269024eb4c238ec405606e36a049'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:05.364193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c53269024eb4c238ec405606e36a049'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:05.365192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a77be2cf-fbf2-4c7f-9c31-003ee834cc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c53269024eb4c238ec405606e36a049'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:05.387212 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2128/4274] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:08:05 2022] DELETE /identity/v3/users/9c53269024eb4c238ec405606e36a049 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:06.901943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:06.903253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:06.903760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:06.944707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:06.970643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:06.975799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.208746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:07.209302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2147/4275] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:07.210976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:07.211449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:07.221614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:07.223043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.276695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:07.278675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.317956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2129/4276] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:07.412659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517eca5-9a10-4afa-9f95-0d22651caa80 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:07.459890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:07.460976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:07.468701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:07.469253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] PATH_INFO: `/v3/projects/1174772192cc45578b127d170fda4ebf` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:07.477645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1174772192cc45578b127d170fda4ebf)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:07.486659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:07.575615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:07.577214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.601712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331d8aa-aeab-454f-8c30-dbab44b0b1b7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:07.613670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:07.615482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:07.615784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:07.618434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] PATH_INFO: `/v3/users/b05a7235318f4ad6a4453603e5310237` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:07.620853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05a7235318f4ad6a4453603e5310237)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:07.624836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:07.674184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1174772192cc45578b127d170fda4ebf', 'request_id': 'req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.697429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1174772192cc45578b127d170fda4ebf', 'request_id': 'req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.728480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1174772192cc45578b127d170fda4ebf', 'request_id': 'req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.745583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05a7235318f4ad6a4453603e5310237'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.770614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05a7235318f4ad6a4453603e5310237'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.805442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05a7235318f4ad6a4453603e5310237'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.807061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05a7235318f4ad6a4453603e5310237'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.808597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-899dcfa9-09f6-49c1-b6f7-960222ad8100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05a7235318f4ad6a4453603e5310237'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.812866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] The token cache is being invalidate because project 1174772192cc45578b127d170fda4ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:08:07.813315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.815593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:07.818216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2148/4277] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:08:07 2022] DELETE /identity/v3/projects/1174772192cc45578b127d170fda4ebf => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:07.819572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:07.821087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.850145 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2130/4278] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:08:07 2022] DELETE /identity/v3/users/b05a7235318f4ad6a4453603e5310237 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:07.852709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddf8a6-ba0f-4351-a6a1-6353f3ab872a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:07.853380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddf8a6-ba0f-4351-a6a1-6353f3ab872a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:07.853873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddf8a6-ba0f-4351-a6a1-6353f3ab872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:07.894456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-24ddf8a6-ba0f-4351-a6a1-6353f3ab872a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:07.895919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-24ddf8a6-ba0f-4351-a6a1-6353f3ab872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:07.944767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:08.017073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:08.051354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2131/4279] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:08.053080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bce53-c1f2-457a-a1ba-37fe60994e6d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.053528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bce53-c1f2-457a-a1ba-37fe60994e6d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.054004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bce53-c1f2-457a-a1ba-37fe60994e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.060849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a63c-02d8-4174-b3f3-6eb32cc5a77f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.091803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-096bce53-c1f2-457a-a1ba-37fe60994e6d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:08.094537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-096bce53-c1f2-457a-a1ba-37fe60994e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:08.117946 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2132/4280] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:08.117946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.117946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.118427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.145527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:08.150790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:08.168060 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2133/4281] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:08.169968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.171857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:08.217321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.218017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.218314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.218573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.227395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:08.344533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a8f35-7313-42e1-99ca-57197a4e5891 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.353931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.354608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.355102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.355305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.373620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.379036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.388668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.392979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.402001 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2134/4282] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:08.403132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.416378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2149/4283] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:08.422142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c2a00-df2e-4378-8108-cca6a7331f1b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.439620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.440829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.441512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.441512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.442017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:08:08.442318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.443992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.464690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.471412 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2135/4284] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:08:08.479882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc932-c089-48aa-8ead-0c3dfbd8af97 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.490407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.491403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.492001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.492516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.493379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.495807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.545472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.545945 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2150/4285] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:08 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:08.556508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5cec0-a6ce-4ad2-860b-516605d76a65 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.714993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.716250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.716873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.717317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.718480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.721054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.772745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2136/4286] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:08 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:08.777181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.792655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634069fc-22dc-4d60-8ab7-8db2dd5dff7f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.811726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.812020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.813917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.814504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.815594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.819247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.835359 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2151/4287] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:08.839867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.850528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff9108-2ad0-482b-b7c3-a485eb9cdb9e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.859420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.859722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.860000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.860906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.861659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.863380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa8f44-9e24-4e34-ac40-d1ef3136ab44 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.881003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:08.890952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2137/4288] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:08.893099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f910-2682-48fe-a0f6-adb43a5b023d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:08.898245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:08.899142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.899428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.899704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] PATH_INFO: `/v3/projects/094538b7d28d413fbea48441d35cad09/users/48103c7f170a4a97a3aa0402a52428c2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:08.923705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] RBAC: Authorizing `identity:create_grant(project_id=094538b7d28d413fbea48441d35cad09, user_id=48103c7f170a4a97a3aa0402a52428c2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:08.934906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:08.959614 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2152/4289] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:08 2022] PUT /identity/v3/projects/094538b7d28d413fbea48441d35cad09/users/48103c7f170a4a97a3aa0402a52428c2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:08.965322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:08.965550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:08.965668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:09.007814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:09.011616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:09.114410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:09.152356 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2138/4290] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:09.160361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:09.188620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:09.285021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4df7-bb92-4d52-9d3b-ce72045b440c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:09.290028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:09.292885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:09.293354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:09.293651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:09.304891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:09.306516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e6884-d719-4694-8657-ce5d84792e9a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:09.328860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2153/4291] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:09.369896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:09.372692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:09.401213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0551a45-9c63-4b7e-824e-a60f6a3b0979 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:09.412755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:09.414801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:09.415092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:09.417482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] PATH_INFO: `/v3/projects/b10b0457e0e94a6c944fa20c3f75e33e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:09.419900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10b0457e0e94a6c944fa20c3f75e33e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:09.445910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:09.562546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10b0457e0e94a6c944fa20c3f75e33e', 'request_id': 'req-c95ee013-45be-4f13-89c3-e564dff65d82'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:09.581477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10b0457e0e94a6c944fa20c3f75e33e', 'request_id': 'req-c95ee013-45be-4f13-89c3-e564dff65d82'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:09.627873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10b0457e0e94a6c944fa20c3f75e33e', 'request_id': 'req-c95ee013-45be-4f13-89c3-e564dff65d82'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:09.656633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] The token cache is being invalidate because project b10b0457e0e94a6c944fa20c3f75e33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:08:09.657685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:09.659917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c95ee013-45be-4f13-89c3-e564dff65d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:09.665071 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2139/4292] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:08:09 2022] DELETE /identity/v3/projects/b10b0457e0e94a6c944fa20c3f75e33e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:09.670353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:09.671201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:09.671624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:09.711469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:09.716029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:09.954505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2154/4293] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:09.962186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:09.962470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:09.962740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.016010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:10.017295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:10.041396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2140/4294] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:10.043705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.060742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287e88-6bc1-43b6-bffb-aee52fbd7a20 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.077655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.083011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.086747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.089166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.093571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:08:10.098349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.102376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.152117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.158550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2155/4295] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:08:10.162968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ab18f-80e0-4450-8bfd-8d8fa222f526 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.176100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.177140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.177595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.178113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.179013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.182727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.185015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:10.194436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.304794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2141/4296] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:10 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:10.305076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.395706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a8d8f-49a2-4580-84ee-91b7182d69a9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.504823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7974259-0938-42cf-97a5-13e08cbec4d0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.535564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.536288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.536901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.537204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.537971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.546524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.553391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.554148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.554519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.554902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.568885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:10.580843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:10.617878 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2142/4297] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:10 2022] POST /identity/v3/users => generated 284 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:10.628025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.648105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dc5d6-faf2-4dd5-b23f-c1587828054f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.660399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.661309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.661598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.661880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.662628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.673750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.700491 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2143/4298] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:10.703757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.738058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4344e9-751f-4438-9324-a5498264d0d4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.764236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.764966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.765251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.765623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.766275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.767917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.796504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.797709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2144/4299] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:08:10.799448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f581e-685a-4463-ad44-157745708c28 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.801128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:10.832292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd60b-fa6b-4a44-b075-d2a9f6be20c0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:10.858596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:10.859523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.859811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.860084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] PATH_INFO: `/v3/projects/7af13716442d4fe3b536c52fbf24cf3f/users/70058402aba54f1690cf90a058ed3131/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:10.876085 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2156/4300] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:08:10.888006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:10.897622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af13716442d4fe3b536c52fbf24cf3f, user_id=70058402aba54f1690cf90a058ed3131, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:10.907160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:10.934198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2145/4301] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:10 2022] PUT /identity/v3/projects/7af13716442d4fe3b536c52fbf24cf3f/users/70058402aba54f1690cf90a058ed3131/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:10.947569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa79c4-1571-44ee-9774-1de872624ec0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:10.947865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa79c4-1571-44ee-9774-1de872624ec0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:10.948148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa79c4-1571-44ee-9774-1de872624ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:11.019617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9faa79c4-1571-44ee-9774-1de872624ec0 None None] MFA Rules not processed for user `70058402aba54f1690cf90a058ed3131`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:11.020929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9faa79c4-1571-44ee-9774-1de872624ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:11.183261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2157/4302] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:11.247103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:11.384380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423482e-e243-4091-821f-ecaec30875b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:11.388269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:11.389229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:11.389367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:11.389657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:11.402524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:11.402894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:11.403172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:11.410284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:11.412981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8448fc2-d7ae-4503-98de-c51ff4ea584a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:11.426577 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2146/4303] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:11.463902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] MFA Rules not processed for user `91429b3bdbb147e6ab7d91ebbba73af4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:11.465348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:11.603984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2158/4304] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:11.615862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3fba-f2c8-4d24-a8de-f81f2f5e0fec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:11.617137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3fba-f2c8-4d24-a8de-f81f2f5e0fec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:11.617788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3fba-f2c8-4d24-a8de-f81f2f5e0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:11.648734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1c3f3fba-f2c8-4d24-a8de-f81f2f5e0fec None None] MFA Rules not processed for user `b6aaf0215c7d4342b75c8921f1ac54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:11.649450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1c3f3fba-f2c8-4d24-a8de-f81f2f5e0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:11.750530 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2147/4305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:11.945840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:11.947899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:11.967446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:12.073760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91283de-80aa-49f8-a689-62eeb69fc85d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:12.085697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:12.086828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:12.087277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:12.087732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:12.091189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:12.104839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:12.106794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:12.120050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2159/4306] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:16.182227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ae4a-3cb0-4336-9aaf-3f80b6243e1c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:16.183179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ae4a-3cb0-4336-9aaf-3f80b6243e1c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:16.183179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ae4a-3cb0-4336-9aaf-3f80b6243e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:16.246829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-79e6ae4a-3cb0-4336-9aaf-3f80b6243e1c None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:16.249364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-79e6ae4a-3cb0-4336-9aaf-3f80b6243e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:16.377377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2148/4307] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:21.598188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:21.601055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:21.645835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635a787-1898-4bfe-9161-8e82f0ac79d8 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:21.652264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:21.653426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:21.653779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:21.654126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:21.656772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:21.684107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:21.688167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:21.721872 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2160/4308] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:22.931447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:22.932402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:22.932959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:22.979701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] MFA Rules not processed for user `48103c7f170a4a97a3aa0402a52428c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:22.981207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:23.065363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:23.170489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:23.176173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:23.192931 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2149/4309] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:23.326699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de71-cfe5-4201-bd34-175628e294ce service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:23.348478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:23.351865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:23.354415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:23.354817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:23.357774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:23.367361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:23.423904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:23.434463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2161/4310] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:23 2022] POST /identity/v3/projects => generated 389 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:23.441857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f4df-4248-4be1-88e3-32319e46bb2f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:23.537843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:23.538680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:23.539052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:23.539398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:23.540176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:23.550396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:23.665072 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2150/4311] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:23 2022] POST /identity/v3/users => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:23.668928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:23.697606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a381124-6294-4a5c-849c-58f680871109 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:23.706581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:23.707291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:23.707579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:23.707887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:23.708635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:23.713023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:23.749462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2162/4312] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:23.750374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:23.767858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd10a-856d-468e-866a-2f9a91b23da3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:23.787996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:23.789267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:23.789557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:23.789841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] PATH_INFO: `/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a/users/35f94ba273864f8f82427b3e8f90773e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:23.815081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c1d77097bd4689bc25eef1b61e4d4a, user_id=35f94ba273864f8f82427b3e8f90773e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:23.818701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:23.838448 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2151/4313] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:23 2022] PUT /identity/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a/users/35f94ba273864f8f82427b3e8f90773e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:23.842969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:23.860869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a2598-d9ff-481b-9579-d34f5dd7c801 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:24.005914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:24.007453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:24.007930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:24.008369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:24.009394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:24.011422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:24.015104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:24.038038 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2163/4314] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:24.044954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:24.065990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4dec-253f-4a13-aeca-ced0e2124116 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:24.080046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:24.082012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:24.083002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:24.085817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] PATH_INFO: `/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a/users/35f94ba273864f8f82427b3e8f90773e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:24.092401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c1d77097bd4689bc25eef1b61e4d4a, user_id=35f94ba273864f8f82427b3e8f90773e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:24.102630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee73e25-492b-4bab-b946-8f2ebca8e082 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:24.138312 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2152/4315] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:24 2022] PUT /identity/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a/users/35f94ba273864f8f82427b3e8f90773e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:34.052729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:34.118168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=57,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:34.608556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:34.679830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609bd9-5362-4846-adf3-91252cd86d13 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:34.737009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:34.737989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:34.738472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:34.739123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:34.741299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:34.753479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:34.755179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b3316-3a0b-4a30-9fcc-053dd12a73c4 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:34.765877 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2164/4316] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:35.264075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:35.264660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:35.264929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:35.346609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:35.347865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:35.483863 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2153/4317] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:40.709526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:40.710626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:40.710908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:40.744354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] MFA Rules not processed for user `35f94ba273864f8f82427b3e8f90773e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:40.745968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:40.883008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2165/4318] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:40.896309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:40.902757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:41.045334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f1ddc-b2b1-496c-aaf7-39ddd561c0ba None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:41.049600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:41.050485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:41.050936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:41.051379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:41.148392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:41.151123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:41.164214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2154/4319] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:42.140579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:42.275991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:42.331756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab271a-795d-4dcb-be77-286a4c10033b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:42.350369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:42.351438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:42.353384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:42.353993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:42.568114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:42.570915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d067-4cb3-4456-b1c4-5df51983f80e service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:42.603084 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2166/4320] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:43.745049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:43.982720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9ec4-98e6-463c-b990-9bc55ea0d3fe service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:43.989422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:43.991046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:43.991503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:43.991958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] PATH_INFO: `/v3/users/70058402aba54f1690cf90a058ed3131` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:43.993352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70058402aba54f1690cf90a058ed3131)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:43.996960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:43.999025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:44.092205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70058402aba54f1690cf90a058ed3131'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:44.118321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70058402aba54f1690cf90a058ed3131'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:44.150508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70058402aba54f1690cf90a058ed3131'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:44.151284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70058402aba54f1690cf90a058ed3131'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:44.152050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70058402aba54f1690cf90a058ed3131'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:44.180042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2155/4321] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:08:43 2022] DELETE /identity/v3/users/70058402aba54f1690cf90a058ed3131 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:44.195441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:44.195441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:44.195441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:44.219488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:44.222401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:44.341587 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2167/4322] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:44.383460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:44.386338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:44.472119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824f8f1-360c-44d9-a21f-310d132c7f8f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:44.479121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:44.480190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:44.480694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:44.491649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:44.506605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:44.508396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d0584-05c3-489a-ade1-e6d2105f74f2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:44.527272 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2156/4323] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:45.135914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.142372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:45.158971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ab007-6320-4207-aa5b-b7906e93c1ac None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.165927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.167152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.167654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.168091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] PATH_INFO: `/v3/projects/7af13716442d4fe3b536c52fbf24cf3f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.171292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af13716442d4fe3b536c52fbf24cf3f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.188143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.283567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af13716442d4fe3b536c52fbf24cf3f', 'request_id': 'req-517dc54c-9847-4ea0-ba4e-76aba10f658b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:45.294375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af13716442d4fe3b536c52fbf24cf3f', 'request_id': 'req-517dc54c-9847-4ea0-ba4e-76aba10f658b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:45.302959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af13716442d4fe3b536c52fbf24cf3f', 'request_id': 'req-517dc54c-9847-4ea0-ba4e-76aba10f658b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:45.317817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] The token cache is being invalidate because project 7af13716442d4fe3b536c52fbf24cf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:08:45.318408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:45.319531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-517dc54c-9847-4ea0-ba4e-76aba10f658b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:45.322075 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2168/4324] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:08:45 2022] DELETE /identity/v3/projects/7af13716442d4fe3b536c52fbf24cf3f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:45.326660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.327611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.328172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.353657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:45.355500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:45.435250 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2157/4325] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:08:45.443355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.444102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.445004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.454935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:45.474808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:45.477950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:45.489538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2169/4326] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:45.493898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.504815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f31e-d29a-48fa-b680-321fa9741a6e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.513278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.514191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.514653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.515107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.516028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:08:45.516903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.519207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.536541 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2158/4327] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:08:45.541503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.554518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b60c-7245-49ff-8f41-bbf89154ae08 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.560104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.561060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.561504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.561972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.562839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.565015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.626002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2170/4328] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:45 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:45.626921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.641722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835883e1-a2e2-4cba-9caf-70cd1f790126 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.662404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:45.787890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.788626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.788912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.789190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.790390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.792795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.830518 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2159/4329] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:45 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:45.833025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.848254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a9de-9a93-41d5-93e8-6ca377669176 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.859565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.860194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.860529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.861701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.865050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.868152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.903775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.914936 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2171/4330] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:45.917241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2594c-01a6-4e3e-a171-db78f57ca750 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.932671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:45.933610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:45.933901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:45.934185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:45.934998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:45.940158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0f8b1-6657-4137-addb-d446a6e7a3cf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:45.970476 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2160/4331] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:45.974846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:45.988726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d57f1-0418-41c2-9030-06faec22732b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:45.999098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:46.002298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:46.002679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:46.002872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] PATH_INFO: `/v3/projects/46e2c992af6245fc8ab99a972d660b4d/users/3138d57fea3d4c3ebef78919d1092354/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:46.045051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e2c992af6245fc8ab99a972d660b4d, user_id=3138d57fea3d4c3ebef78919d1092354, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:46.051805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:46.081520 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2172/4332] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:45 2022] PUT /identity/v3/projects/46e2c992af6245fc8ab99a972d660b4d/users/3138d57fea3d4c3ebef78919d1092354/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:46.093315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:46.093729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:46.093876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:46.137933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] MFA Rules not processed for user `3138d57fea3d4c3ebef78919d1092354`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:46.139985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:46.231566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2161/4333] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:46.304933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:46.307354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:46.445645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708815-7e29-4673-a10d-3d2b0a395613 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:46.450972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:46.452198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:46.452845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:46.453947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:46.487643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:46.489189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11d065-7888-4d3e-9b45-ae8b71cd042a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:46.519680 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2173/4334] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:46.572616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:46.718179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036206-eb07-4670-af14-7d1b095a70bf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:46.724855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:46.725977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:46.726269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:46.726708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] PATH_INFO: `/v3/users/3138d57fea3d4c3ebef78919d1092354` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:46.733059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3138d57fea3d4c3ebef78919d1092354)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:46.735556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:46.798326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:46.850769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3138d57fea3d4c3ebef78919d1092354'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:46.861552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3138d57fea3d4c3ebef78919d1092354'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:46.882628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3138d57fea3d4c3ebef78919d1092354'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:46.883428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3138d57fea3d4c3ebef78919d1092354'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:46.884282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3138d57fea3d4c3ebef78919d1092354'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:46.907630 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2162/4335] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:08:46 2022] DELETE /identity/v3/users/3138d57fea3d4c3ebef78919d1092354 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:46.912008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:46.912516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:46.914160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:46.933152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:46.934413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:47.013797 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2174/4336] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:08:47.031455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:47.033118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:47.111649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2e61-0c3a-481f-bc45-024d60aa2f94 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:47.116194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:47.117067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:47.117355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:47.117636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:47.131219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:47.134183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633b05-ead2-4f4f-a86c-e7c992bda94d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:47.146765 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2163/4337] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:48.114134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.115803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:48.135193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b6ef-3e71-42a8-91ed-d823ad1e67d8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:48.148286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:48.149339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.149871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.150103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] PATH_INFO: `/v3/projects/46e2c992af6245fc8ab99a972d660b4d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.161565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e2c992af6245fc8ab99a972d660b4d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:48.163749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:48.242707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:48.253291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e2c992af6245fc8ab99a972d660b4d', 'request_id': 'req-cc94bf11-6876-43ea-a364-44eec71477df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:48.277119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e2c992af6245fc8ab99a972d660b4d', 'request_id': 'req-cc94bf11-6876-43ea-a364-44eec71477df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:48.286186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e2c992af6245fc8ab99a972d660b4d', 'request_id': 'req-cc94bf11-6876-43ea-a364-44eec71477df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:48.331641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] The token cache is being invalidate because project 46e2c992af6245fc8ab99a972d660b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:08:48.332288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:48.333240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc94bf11-6876-43ea-a364-44eec71477df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:08:48.335606 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2175/4338] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:08:48 2022] DELETE /identity/v3/projects/46e2c992af6245fc8ab99a972d660b4d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:48.340760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.341183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.341361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.370725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:48.373382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:48.545116 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2164/4339] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:48.547451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608f95-507c-4542-9285-5186e450e034 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.548021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608f95-507c-4542-9285-5186e450e034 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.548589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608f95-507c-4542-9285-5186e450e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.594621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21608f95-507c-4542-9285-5186e450e034 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:48.598295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21608f95-507c-4542-9285-5186e450e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:48.641923 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2176/4340] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:48.647341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.661900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2a19c-71e2-4cac-8896-06b30cc5c135 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:48.670906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:48.672785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.673071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.673673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.674410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:08:48.675228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:48.679325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:48.699411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2165/4341] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:08:48.701176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608f95-507c-4542-9285-5186e450e034 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.712301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608f95-507c-4542-9285-5186e450e034 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:48.719312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:48.720327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.720929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.721457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.723166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:48.725631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:48.771480 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2177/4342] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:48 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:48.773463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.783981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527780-4ffc-4490-b6de-381bd852f5d6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:48.825548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:48.871826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:48.873347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.874052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.874622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.875111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:48.879096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:48.916545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2166/4343] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:48 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:48.917792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.932074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dae2-44d9-4f45-914a-ccdc6685aebf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:48.939260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:48.956573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:48.957089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:48.957821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:48.963233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:48.965321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:48.985124 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2178/4344] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:48.986027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:48.998067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f722-8fee-4719-95e9-eccb8715f83a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.005330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.006033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.006376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.006649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.007366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.009124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3043e15-1640-40b1-9fb9-b52343e8d7d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.024203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2167/4345] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:08:49.025496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.036995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e446-4ae1-4d1f-a22f-a83dc1354f7c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.043683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.044640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.045499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.046111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] PATH_INFO: `/v3/projects/99f99b1508a34675a3853518f7a1619a/users/d8fbe71cca9243f9960ecc81cf221439/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.068133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f99b1508a34675a3853518f7a1619a, user_id=d8fbe71cca9243f9960ecc81cf221439, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.071235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.104964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2179/4346] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:49 2022] PUT /identity/v3/projects/99f99b1508a34675a3853518f7a1619a/users/d8fbe71cca9243f9960ecc81cf221439/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:49.108264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.108598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.108926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.141998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] MFA Rules not processed for user `d8fbe71cca9243f9960ecc81cf221439`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:49.143381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:49.236469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2168/4347] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:49.238047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.336435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0e7e8-ead6-4035-a249-0f22e502c682 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.347632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.348512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.348961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.349327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.350612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.362658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.408631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2180/4348] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:08:49 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:08:49.410278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.422641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc10b-aca1-42b0-9c80-3e1da8945e16 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.529055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.531110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.531656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.532229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.533824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.538003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.589215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2169/4349] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:08:49 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:08:49.589448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.610469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e2d6-85fc-42e7-9190-d0bb9e812c94 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.622896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.623600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.623884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.624167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.624929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.626672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.664339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.665441 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2181/4350] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:49.667421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79702-5207-4535-88f0-30da59881082 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.683454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.684382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.684892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.685103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] PATH_INFO: `/v3/projects/3036e0415cdc4b3d9682b56f65934e03/users/affa888d0071446083cc27bcc8e4c20a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.718723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3036e0415cdc4b3d9682b56f65934e03, user_id=affa888d0071446083cc27bcc8e4c20a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.721492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.747360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:49.756038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2170/4351] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:49 2022] PUT /identity/v3/projects/3036e0415cdc4b3d9682b56f65934e03/users/affa888d0071446083cc27bcc8e4c20a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:49.760249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.779797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42522e-2b1b-4fb4-868d-a2a39f1b9f8d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.823454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:49.854276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.855045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.855334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.855621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.856449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.858076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b789d-dae0-4d19-a363-880148e65ae2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.877824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:49.886520 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2182/4352] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:08:49.892862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b73-4188-4ee7-8325-e84c94cc12e1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:49.900027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:49.901193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.901657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.902228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] PATH_INFO: `/v3/projects/3036e0415cdc4b3d9682b56f65934e03/users/affa888d0071446083cc27bcc8e4c20a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.906684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3036e0415cdc4b3d9682b56f65934e03, user_id=affa888d0071446083cc27bcc8e4c20a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:49.910181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:49.925998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2171/4353] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:08:49 2022] PUT /identity/v3/projects/3036e0415cdc4b3d9682b56f65934e03/users/affa888d0071446083cc27bcc8e4c20a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:08:49.936916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:49.937405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:49.937921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:49.975887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] MFA Rules not processed for user `affa888d0071446083cc27bcc8e4c20a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:49.978830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:50.126620 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2183/4354] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:08:50.135606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:50.140513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:50.278184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c217a4-132f-483d-b19c-225836f70df8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:50.283688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:50.286124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:50.286608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:50.287030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:50.307151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:50.310830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339e1c2-76c0-40ac-89b4-943f65e80ef7 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:50.343158 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2172/4355] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:50.486255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:08:50.500161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd0d1-a1eb-42ce-a43b-10d4770b6711 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:08:50.509922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:08:50.511314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:50.511610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:50.511894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:50.585769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:08:50.587897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:08:50.598655 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2184/4356] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:08:50.656893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:08:50.658232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:08:50.658781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:08:50.704679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] MFA Rules not processed for user `69effad76345477987af68f55c90e2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:08:50.708485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:08:50.856687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2173/4357] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:00.593821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=74 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:00.842680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:01.419750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:01.421492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:01.541593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca90e7e-c850-4e83-bbff-951c310cb4b0 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:01.547661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:01.550261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.550788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.551243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] PATH_INFO: `/v3/users/ea5a50f6e8ea470894e19f8c1dec476f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.552975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5a50f6e8ea470894e19f8c1dec476f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:01.555471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:01.560078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:01.577364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f13f-75ab-438f-9617-d8bbe3e0dfaa None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:01.589574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:01.593526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.594781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.595573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] PATH_INFO: `/v3/users/d8fbe71cca9243f9960ecc81cf221439` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.599317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fbe71cca9243f9960ecc81cf221439)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:01.604883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:01.656411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5a50f6e8ea470894e19f8c1dec476f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.660254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5a50f6e8ea470894e19f8c1dec476f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.676238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fbe71cca9243f9960ecc81cf221439'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.687126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fbe71cca9243f9960ecc81cf221439'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.696109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5a50f6e8ea470894e19f8c1dec476f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.711041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fbe71cca9243f9960ecc81cf221439'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.712144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fbe71cca9243f9960ecc81cf221439'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.712793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dac8336e-6432-4512-acb5-aac924478ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fbe71cca9243f9960ecc81cf221439'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.723677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5a50f6e8ea470894e19f8c1dec476f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.731931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e4d5e1f-fab8-4f72-b6e5-6a26c684a615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5a50f6e8ea470894e19f8c1dec476f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:01.737235 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2174/4358] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:01 2022] DELETE /identity/v3/users/d8fbe71cca9243f9960ecc81cf221439 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:01.742921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.743387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.743685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.745360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2185/4359] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:01 2022] DELETE /identity/v3/users/ea5a50f6e8ea470894e19f8c1dec476f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:01.747615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62f7d-89cb-4f6a-989d-7e0925938aed None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.748188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62f7d-89cb-4f6a-989d-7e0925938aed None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.748737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b62f7d-89cb-4f6a-989d-7e0925938aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.790797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] MFA Rules not processed for user `48103c7f170a4a97a3aa0402a52428c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:01.793202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:01.794979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-06b62f7d-89cb-4f6a-989d-7e0925938aed None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:01.800210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06b62f7d-89cb-4f6a-989d-7e0925938aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:01.879278 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2186/4360] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:01.881065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715a35-be14-479c-9f24-6ddfd58a7744 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.881528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715a35-be14-479c-9f24-6ddfd58a7744 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.881963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715a35-be14-479c-9f24-6ddfd58a7744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.905182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cc715a35-be14-479c-9f24-6ddfd58a7744 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:01.906759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc715a35-be14-479c-9f24-6ddfd58a7744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:01.921195 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2175/4361] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:01.921195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:01.921195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:01.937273 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2187/4362] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:01.938999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:01.939665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:01.940109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:01.973504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] MFA Rules not processed for user `48103c7f170a4a97a3aa0402a52428c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:01.975225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:02.000115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2188/4363] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:02.001158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:02.003256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:02.022986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:02.098344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08f867-95f2-4940-9d89-24c2d0942b12 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:02.109615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:02.110295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:02.110579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:02.111284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:02.122045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:02.123510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:02.134652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2176/4364] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:02.147100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56a54f-6420-4d79-a8dc-8099e73d0575 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:02.151366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:02.152355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:02.153212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:02.153212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:02.164205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:02.165786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:02.181293 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2189/4365] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:02.541625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:02.543350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:02.557252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf75636-e354-4c52-b672-cc99ec41f62c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:02.562358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:02.563264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:02.563706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:02.563987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] PATH_INFO: `/v3/projects/99f99b1508a34675a3853518f7a1619a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:02.565461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f99b1508a34675a3853518f7a1619a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:02.568680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:02.588989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:02.635931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f99b1508a34675a3853518f7a1619a', 'request_id': 'req-c7a43104-4362-4b2e-9af5-048a11426243'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.647409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f99b1508a34675a3853518f7a1619a', 'request_id': 'req-c7a43104-4362-4b2e-9af5-048a11426243'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.654347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f99b1508a34675a3853518f7a1619a', 'request_id': 'req-c7a43104-4362-4b2e-9af5-048a11426243'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.672260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] The token cache is being invalidate because project 99f99b1508a34675a3853518f7a1619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:02.674278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.675450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.680035 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2177/4366] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:02 2022] DELETE /identity/v3/projects/99f99b1508a34675a3853518f7a1619a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:02.681962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:02.692362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1135c-4361-40f4-a4e9-ee1feb03f9ef service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:02.767512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:02.768513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:02.768807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:02.769333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] PATH_INFO: `/v3/users/affa888d0071446083cc27bcc8e4c20a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:02.770551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affa888d0071446083cc27bcc8e4c20a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:02.772598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:02.848526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affa888d0071446083cc27bcc8e4c20a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.849757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affa888d0071446083cc27bcc8e4c20a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.860053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affa888d0071446083cc27bcc8e4c20a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.874745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affa888d0071446083cc27bcc8e4c20a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.883175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e5cd4ff-cdca-46e7-a704-974989c75d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affa888d0071446083cc27bcc8e4c20a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:02.892466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2190/4367] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:02 2022] DELETE /identity/v3/users/affa888d0071446083cc27bcc8e4c20a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:03.363573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:03.364857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:03.386378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43104-4362-4b2e-9af5-048a11426243 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:03.464589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:03.466277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.466775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.467960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] PATH_INFO: `/v3/projects/3036e0415cdc4b3d9682b56f65934e03` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.469732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3036e0415cdc4b3d9682b56f65934e03)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:03.474060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:03.562315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3036e0415cdc4b3d9682b56f65934e03', 'request_id': 'req-ae016ca2-7237-4af5-8ece-275a5691440d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.575163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3036e0415cdc4b3d9682b56f65934e03', 'request_id': 'req-ae016ca2-7237-4af5-8ece-275a5691440d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.585424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3036e0415cdc4b3d9682b56f65934e03', 'request_id': 'req-ae016ca2-7237-4af5-8ece-275a5691440d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.598866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] The token cache is being invalidate because project 3036e0415cdc4b3d9682b56f65934e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:03.599232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.600195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.606384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2178/4368] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:03 2022] DELETE /identity/v3/projects/3036e0415cdc4b3d9682b56f65934e03 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:03.609540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326536-240d-4d2b-84e0-301c69a0c767 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.610200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326536-240d-4d2b-84e0-301c69a0c767 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.610552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326536-240d-4d2b-84e0-301c69a0c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.630416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ac326536-240d-4d2b-84e0-301c69a0c767 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:03.631719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ac326536-240d-4d2b-84e0-301c69a0c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:03.671971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:03.674051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:03.675622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:03.726714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:03.758023 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2191/4369] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:03.761402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.762369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.762763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.796281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:03.797571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:03.822491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2192/4370] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:03.826724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:03.831370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016ca2-7237-4af5-8ece-275a5691440d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:03.840982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb546853-beff-4fbb-a631-13ed3a17ad47 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:03.846424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:03.847592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:03.848364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.848609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.849026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.849168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.849429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.850007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:03.850414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] PATH_INFO: `/v3/projects/ccdbe2fec6454cef988cb3ed5466c6fe` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.850538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:03.852276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:03.853287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdbe2fec6454cef988cb3ed5466c6fe)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:03.855266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:03.867569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2193/4371] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:03.871540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:03.884778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14720-0734-4d59-8c5c-8d8145a750a7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:03.891190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:03.892123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:03.893215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:03.893698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:03.894780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:03.897119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:03.933591 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2194/4372] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:03 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:03.937126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:03.950363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'request_id': 'req-73c79b23-7d9a-4f04-86aa-9c36db65f196'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.965844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'request_id': 'req-73c79b23-7d9a-4f04-86aa-9c36db65f196'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:03.974743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'request_id': 'req-73c79b23-7d9a-4f04-86aa-9c36db65f196'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.009114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] The token cache is being invalidate because project ccdbe2fec6454cef988cb3ed5466c6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:04.009409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.014006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.017146 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2179/4373] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:03 2022] DELETE /identity/v3/projects/ccdbe2fec6454cef988cb3ed5466c6fe => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:04.018448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.019864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.028306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e2b-2023-47ba-b562-e44bc3bf8149 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.034188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.035145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.035598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.036068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.037053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.040611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.079346 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2195/4374] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:03 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:04.083418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.085440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.107807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618920d-4dec-4950-9174-df0e1e73bdff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.113600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.114304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.115031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.115031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.115777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.118093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.135232 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2196/4375] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:09:04.140067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.147748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79b23-7d9a-4f04-86aa-9c36db65f196 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.153240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.154627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.155007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.155294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] PATH_INFO: `/v3/users/88463db42cde4aa7927c954a8f482553` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.156702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88463db42cde4aa7927c954a8f482553)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.159396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.165655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c3c-ad5e-4605-b571-6c49f7b2a1d7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.182794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.183487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.183771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.184049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.186787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.188469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.205892 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2197/4376] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:04.206867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.218581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba23c7-6e99-4d34-93a6-6a8079939550 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.225197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.225780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.226184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.226481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] PATH_INFO: `/v3/projects/009ec60ad285485087dcbd0e29b198f1/users/bdf2e3f9486541eab11130f473ec85be/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.251418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=009ec60ad285485087dcbd0e29b198f1, user_id=bdf2e3f9486541eab11130f473ec85be, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.254302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de235ef1-ec05-45ef-b1a3-7584cea9b35d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.258574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88463db42cde4aa7927c954a8f482553'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.273665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88463db42cde4aa7927c954a8f482553'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.289699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88463db42cde4aa7927c954a8f482553'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.291036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88463db42cde4aa7927c954a8f482553'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.292107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88463db42cde4aa7927c954a8f482553'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:04.292631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2198/4377] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:04 2022] PUT /identity/v3/projects/009ec60ad285485087dcbd0e29b198f1/users/bdf2e3f9486541eab11130f473ec85be/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:04.294506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:04.295325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.296974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.297702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.326279 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2180/4378] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:04 2022] DELETE /identity/v3/users/88463db42cde4aa7927c954a8f482553 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:04.335999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] MFA Rules not processed for user `bdf2e3f9486541eab11130f473ec85be`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:04.337429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.361292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:04.429854 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2199/4379] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:04.430083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.431590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.490169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.492169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.506566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cef48-28d9-4650-8283-5b0735897ee4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.512147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.513102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.513463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.513801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.514577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.516910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.565290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2181/4380] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:04 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:04.568993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.597898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6eb21-842d-4758-aa67-164ec6ce03d5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.663152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5261aa9-3a1b-4595-993a-d8fdc41293f5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.670355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.671320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.672912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.673421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.674329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.678159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.696547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.697467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.698689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.698689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.703513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:04.716548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2182/4381] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:04 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:04.718310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.729312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.733683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.738960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ca80-192f-4c06-b8fe-5b7d47b71bc3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.753211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.754106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.754760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.755859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.756091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2200/4382] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:04.758538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.760600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.776201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2183/4383] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:09:04.780659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.798887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97fc6-f8d6-44c8-ad5a-0a15e4ae6df4 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.830888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:04.831831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:04.832525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:04.832814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] PATH_INFO: `/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b/users/f24e49c76ac34591b7f79cbe16003ed5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:04.867032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e60450c3e5249709b06fa04b1ed0c5b, user_id=f24e49c76ac34591b7f79cbe16003ed5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:04.872403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:04.909539 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2201/4384] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:04 2022] PUT /identity/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b/users/f24e49c76ac34591b7f79cbe16003ed5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:04.918950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.942734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34b65a-75ee-46c8-be91-881a3a787695 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:04.976672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:04.979326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.052286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:05.081354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:05.082270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.082780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.083145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.084127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:05.087832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:05.105292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2184/4385] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:05.108625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:05.126544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f767-4d0b-46ae-a948-bca367be8a8f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:05.132531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:05.133595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.134009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.134430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] PATH_INFO: `/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b/users/f24e49c76ac34591b7f79cbe16003ed5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.136689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e60450c3e5249709b06fa04b1ed0c5b, user_id=f24e49c76ac34591b7f79cbe16003ed5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:05.141843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2505-034d-49f1-b7d5-a94ceb1ccab4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:05.159035 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2185/4386] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:05 2022] PUT /identity/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b/users/f24e49c76ac34591b7f79cbe16003ed5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:05.169033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.169329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.169609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.204878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:05.233767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c55-228c-4242-bb11-c6ac68524fc9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:05.242369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] MFA Rules not processed for user `f24e49c76ac34591b7f79cbe16003ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:05.243627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.368177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:05.369123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.369412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.369765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] PATH_INFO: `/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.373241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e9c5ec661d4a0181faabeeb9e393f1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:05.375227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:05.419802 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2186/4387] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:05.428052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:05.429345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.526804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf92bf-ea39-428a-8495-e6b7066365a1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:05.550831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e9c5ec661d4a0181faabeeb9e393f1', 'request_id': 'req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:05.574504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e9c5ec661d4a0181faabeeb9e393f1', 'request_id': 'req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:05.592334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e9c5ec661d4a0181faabeeb9e393f1', 'request_id': 'req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:05.600152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:05.601326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.601849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.602454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.632557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] The token cache is being invalidate because project b9e9c5ec661d4a0181faabeeb9e393f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:05.632819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:05.636812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-919fe1be-34a9-4ed1-b7ec-1ab543616ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:05.652318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2202/4388] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:04 2022] DELETE /identity/v3/projects/b9e9c5ec661d4a0181faabeeb9e393f1 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:05.664511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d504-75da-4062-a2c5-b7303b71f79d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.664836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d504-75da-4062-a2c5-b7303b71f79d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.665095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d504-75da-4062-a2c5-b7303b71f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.675577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:05.774778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fe42d504-75da-4062-a2c5-b7303b71f79d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:05.778298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:05.782373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe42d504-75da-4062-a2c5-b7303b71f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.784133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:05.829628 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2187/4389] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:05.913405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:05.915493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.938282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db812581-07d2-4426-a60b-552a6c838b35 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:05.942231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:05.942893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.943173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.943577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:05.950519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:05.980036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2203/4390] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:05.988631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:05.989836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:05.990503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.020761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:06.026433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:06.040382 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2204/4391] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:06.044945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.070483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a057e0-76b2-48c4-b2dc-3b5a81e9748a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.088671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.090287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.090595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.091141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.091425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.092883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:06.093196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.095025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.099169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.134475 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2188/4392] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:09:06.142846 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2205/4393] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:06.144707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.160077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c04c3-c973-4594-b61c-70b46880a521 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.175146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.175851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.176207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.176583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.177354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.179683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.239060 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2189/4394] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:06.240838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.256292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc669-fb52-4bd0-8e2b-d3965a84361e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.280443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:06.418256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.419107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.419568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.419858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.420695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.422968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.468709 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2206/4395] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:06 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:06.473377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.487878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17525-8276-453d-823c-345a5da34750 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.499275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.500022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.500406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.500809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.501659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.503418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.533819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2190/4396] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:06.538310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.553460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a416d-fd9f-4c73-8232-1ae3821f9964 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.571500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.577811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.580643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.581023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.582298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.591554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808286e-31e7-413c-986c-134566732bb6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.617017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2207/4397] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:06.621294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.661703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54ff1-9edd-45d3-aa27-59ef2a8c0bab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:06.677002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:06.680684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.681073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.682144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] PATH_INFO: `/v3/projects/7cc291ebc8c64e32a229e9a993f517a9/users/bee65f1c37764bdb9985b4e96a97ce9e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.739902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.742049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.743560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.756791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc291ebc8c64e32a229e9a993f517a9, user_id=bee65f1c37764bdb9985b4e96a97ce9e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:06.759741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd24fa-c50c-4d99-8089-12e21975a6dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:06.786581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2191/4398] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:06 2022] PUT /identity/v3/projects/7cc291ebc8c64e32a229e9a993f517a9/users/bee65f1c37764bdb9985b4e96a97ce9e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:06.795797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0021-f856-4442-9721-aa2f2587664c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:06.796184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0021-f856-4442-9721-aa2f2587664c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:06.798061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0021-f856-4442-9721-aa2f2587664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:06.832952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:06.836660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:06.840011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-910e0021-f856-4442-9721-aa2f2587664c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:06.847177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-910e0021-f856-4442-9721-aa2f2587664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:06.961871 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2192/4399] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:06.993761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0021-f856-4442-9721-aa2f2587664c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:06.995565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-910e0021-f856-4442-9721-aa2f2587664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:07.002596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:07.024687 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2208/4400] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:07.098889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0021-f856-4442-9721-aa2f2587664c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:07.107289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:07.107960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:07.108245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:07.108546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:07.146557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:07.148034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:07.162229 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2193/4401] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:08.359353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:08.361382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:08.384523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7314-5b4e-4312-ba19-06c68c2ef7cf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:08.396362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:08.397853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:08.399295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:08.400517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] PATH_INFO: `/v3/users/5b01ed1ecd8d4609a5a277f96e8a8445` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:08.404200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b01ed1ecd8d4609a5a277f96e8a8445)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:08.411783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:08.499218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b01ed1ecd8d4609a5a277f96e8a8445'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:08.500343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b01ed1ecd8d4609a5a277f96e8a8445'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:08.538399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b01ed1ecd8d4609a5a277f96e8a8445'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:08.568619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b01ed1ecd8d4609a5a277f96e8a8445'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:08.580183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea1e4d0b-5e63-40d0-8e6d-25c5d4307fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b01ed1ecd8d4609a5a277f96e8a8445'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:08.594865 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2209/4402] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:08 2022] DELETE /identity/v3/users/5b01ed1ecd8d4609a5a277f96e8a8445 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:09.923303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:09.951223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d689a3-60ac-40d1-8510-5bbb1800ce40 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:10.084641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bedec-5a01-44a6-8695-88b1847d6991 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.085549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bedec-5a01-44a6-8695-88b1847d6991 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.086082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bedec-5a01-44a6-8695-88b1847d6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.108106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e27bedec-5a01-44a6-8695-88b1847d6991 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:10.111231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e27bedec-5a01-44a6-8695-88b1847d6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:10.116644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:10.125117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:10.126118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.126416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.126691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] PATH_INFO: `/v3/projects/29c4645abed4410981601604f61a3d89` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.128069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c4645abed4410981601604f61a3d89)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:10.130084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:10.245156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c4645abed4410981601604f61a3d89', 'request_id': 'req-65e307b4-81ba-46d5-b365-339e7e762ef8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:10.252967 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2210/4403] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:10.266744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c4645abed4410981601604f61a3d89', 'request_id': 'req-65e307b4-81ba-46d5-b365-339e7e762ef8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:10.276539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c4645abed4410981601604f61a3d89', 'request_id': 'req-65e307b4-81ba-46d5-b365-339e7e762ef8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:10.293991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] The token cache is being invalidate because project 29c4645abed4410981601604f61a3d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:10.294515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:10.295379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65e307b4-81ba-46d5-b365-339e7e762ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:10.297979 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2194/4404] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:09 2022] DELETE /identity/v3/projects/29c4645abed4410981601604f61a3d89 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:10.306376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.306888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.307275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.337296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:10.339987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:10.506909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2211/4405] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:10.514622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.516078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.516585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.564885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:10.568555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:10.588788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2195/4406] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:10.593443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:10.615102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1585e-416d-4a1f-b023-fd2b8728fa1d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:10.622879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:10.623768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.624144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.626255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.627219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:10.627716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:10.629635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:10.647989 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2212/4407] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:10.653227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:10.668179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b62399-2134-44c5-a2cd-0dafd7899777 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:10.678038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:10.678836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.679430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.679791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.680992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:10.684878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:10.746643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:10.759234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2196/4408] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:10 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:10.765903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986c968-7b78-4d5b-a406-f3073d1ce3f1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:10.888884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:10.890104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.890526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.890815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.891641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:10.893915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:10.926304 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2213/4409] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:10 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:10.934058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:10.952233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259d368-4d9b-428f-86ca-61b58826b141 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:10.969341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:10.970181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:10.970764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:10.972601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:10.973619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:10.979367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:10.983010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.007180 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2197/4410] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:11.009060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.030224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c76e-ea94-4844-a616-9e8ec9ad4fe6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.044855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.045711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.046205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.046682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.052637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.054273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.062882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.065246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:11.067007 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2214/4411] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:11.076513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.088069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5606-109e-40d9-a850-b67aa0620065 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.090894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240efc-582a-42ae-8c1a-6440e8466c79 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.100437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.100811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.102702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.103034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.103535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.104212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.104551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] PATH_INFO: `/v3/projects/9930d7c5353c49beb52f8dcd9af5341b/users/aaa163b516b64b95896f38bf9e1952d1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.105934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] PATH_INFO: `/v3/users/bdf2e3f9486541eab11130f473ec85be` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.114293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf2e3f9486541eab11130f473ec85be)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.116954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.133221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9930d7c5353c49beb52f8dcd9af5341b, user_id=aaa163b516b64b95896f38bf9e1952d1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.136900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4871d5-9a95-4483-bdd0-a26c942b0c02 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.140859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.160032 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2215/4412] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:11 2022] PUT /identity/v3/projects/9930d7c5353c49beb52f8dcd9af5341b/users/aaa163b516b64b95896f38bf9e1952d1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:11.170812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.171202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.171464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.206865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] MFA Rules not processed for user `aaa163b516b64b95896f38bf9e1952d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:11.208292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:11.218469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf2e3f9486541eab11130f473ec85be'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:11.240074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf2e3f9486541eab11130f473ec85be'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:11.262608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf2e3f9486541eab11130f473ec85be'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:11.263706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf2e3f9486541eab11130f473ec85be'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:11.265707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c1d3185-aadf-4e06-b029-ecd6bcc9c05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf2e3f9486541eab11130f473ec85be'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:11.293930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2198/4413] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:11 2022] DELETE /identity/v3/users/bdf2e3f9486541eab11130f473ec85be => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:11.298882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.299573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.300519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.309535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2216/4414] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:11.315597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.317086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:11.331475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:11.333426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:11.429422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ac9c-edfc-4b38-acb5-612dee394fd0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.436709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.437065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2199/4415] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:11.437944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.438369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.438655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.440628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.444394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.481380 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2217/4416] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:11 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:11.485882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.510045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb209-8196-4811-9e64-a5ecd641d75a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.533712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.536892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:11.672732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf668d9-eb9c-4257-b986-11f1a100e399 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.678823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.679502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.679791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.680135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.680929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.683053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.683438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.684120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.684587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.684872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.700834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.703274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.708141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.722502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2200/4417] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:11 2022] POST /identity/v3/users => generated 307 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:11.726378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2218/4418] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:11.727453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.748628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a17541-a27f-481c-9328-f10aadefceab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.759418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.760462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.761196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.761663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.762476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.764648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.785967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2201/4419] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:11.787628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.801763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff515-8e59-47b8-b1be-56cd592e9d07 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:11.818113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:11.820279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:11.822172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:11.822620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] PATH_INFO: `/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a/users/a7136edaf5e34b59a8fb28c063a17ed7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:11.885809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.901873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08e2aae36cc43d7b9891b7f1f33f13a, user_id=a7136edaf5e34b59a8fb28c063a17ed7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:11.909964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:11.967598 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2219/4420] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:11 2022] PUT /identity/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a/users/a7136edaf5e34b59a8fb28c063a17ed7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:11.971621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:11.984131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815933b8-ca04-471f-b107-1cec5f8e2058 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.139452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.140298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.140868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.141266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.144659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.146402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275be34-5c8b-4dd3-b5a6-94858808d4b7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.181030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2202/4421] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:12.184934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.218867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ab6ef-00cd-40cf-873e-d52b8d26ab96 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.226258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.226718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.227134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.227522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] PATH_INFO: `/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a/users/a7136edaf5e34b59a8fb28c063a17ed7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.229707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08e2aae36cc43d7b9891b7f1f33f13a, user_id=a7136edaf5e34b59a8fb28c063a17ed7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.232600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.267366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2220/4422] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:12 2022] PUT /identity/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a/users/a7136edaf5e34b59a8fb28c063a17ed7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:12.279673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.279967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.280255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.376094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] MFA Rules not processed for user `a7136edaf5e34b59a8fb28c063a17ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:12.377363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:12.472806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.474965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:12.505483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2203/4423] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:12.535054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.562235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db08f1-c722-4b02-b358-99286d168f40 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.570835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7136edaf5e34b59a8fb28c063a17ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.571742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.572272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.572729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.573767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.575240 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:12.575240 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:12.575240 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:12.576296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.587923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626996c6-0c26-4552-a226-205ed367cc2e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.593511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.594397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.594690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.594966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] PATH_INFO: `/v3/projects/009ec60ad285485087dcbd0e29b198f1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.596151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009ec60ad285485087dcbd0e29b198f1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.598273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.604150 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2204/4424] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:09:12 2022] POST /identity/v3/roles => generated 240 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:12.608729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.624044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3bc7-7127-437f-8467-5c3266c3ce27 tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.630162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7136edaf5e34b59a8fb28c063a17ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.631239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.631650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.631937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] PATH_INFO: `/v3/projects/9930d7c5353c49beb52f8dcd9af5341b/users/aaa163b516b64b95896f38bf9e1952d1/roles/bc95432044814457972081515b1f8ee0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.635605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9930d7c5353c49beb52f8dcd9af5341b, user_id=aaa163b516b64b95896f38bf9e1952d1, role_id=bc95432044814457972081515b1f8ee0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.669593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.692465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2205/4425] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:12 2022] PUT /identity/v3/projects/9930d7c5353c49beb52f8dcd9af5341b/users/aaa163b516b64b95896f38bf9e1952d1/roles/bc95432044814457972081515b1f8ee0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:12.694090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.706383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009ec60ad285485087dcbd0e29b198f1', 'request_id': 'req-5512bb26-4db4-413f-a04e-184f789f9995'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:12.726661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009ec60ad285485087dcbd0e29b198f1', 'request_id': 'req-5512bb26-4db4-413f-a04e-184f789f9995'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:12.738032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009ec60ad285485087dcbd0e29b198f1', 'request_id': 'req-5512bb26-4db4-413f-a04e-184f789f9995'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:12.760359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] The token cache is being invalidate because project 009ec60ad285485087dcbd0e29b198f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:12.761095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:12.762231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:12.767693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2221/4426] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:12 2022] DELETE /identity/v3/projects/009ec60ad285485087dcbd0e29b198f1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:12.768923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:12.770082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:12.770982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:12.802046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d426a6-e4cd-4e09-84b4-c863222f430e tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.808940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaa163b516b64b95896f38bf9e1952d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9930d7c5353c49beb52f8dcd9af5341b', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-2028195477', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:12.813179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.813964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.814358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] PATH_INFO: `/v3/users/aaa163b516b64b95896f38bf9e1952d1/application_credentials` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:12.815236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: Authorizing `identity:create_application_credential(user_id=aaa163b516b64b95896f38bf9e1952d1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:12.819590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a6577-70d3-45ae-bc38-0c912f8c9eb5 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:12.897962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512bb26-4db4-413f-a04e-184f789f9995 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:12.910698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:12.955998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2206/4427] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:09:12 2022] POST /identity/v3/users/aaa163b516b64b95896f38bf9e1952d1/application_credentials => generated 660 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:12.959996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:12.960285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:12.960621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:13.036466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] MFA Rules not processed for user `aaa163b516b64b95896f38bf9e1952d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:13.046826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:13.060259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:13.064178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:13.064512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:13.064777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] PATH_INFO: `/v3/users/f24e49c76ac34591b7f79cbe16003ed5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:13.070434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24e49c76ac34591b7f79cbe16003ed5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:13.073081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:13.181977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24e49c76ac34591b7f79cbe16003ed5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.183050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24e49c76ac34591b7f79cbe16003ed5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.196356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24e49c76ac34591b7f79cbe16003ed5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.224108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24e49c76ac34591b7f79cbe16003ed5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.241406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24e49c76ac34591b7f79cbe16003ed5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.246172 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2207/4428] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 25 21:09:13.254525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:13.258000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:13.265234 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2222/4429] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:12 2022] DELETE /identity/v3/users/f24e49c76ac34591b7f79cbe16003ed5 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:13.318472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:13.417965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6bf9-b1d6-4416-9187-7f05466b8d33 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:13.428366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aaa163b516b64b95896f38bf9e1952d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9930d7c5353c49beb52f8dcd9af5341b', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-2028195477', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:13.434400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:13.435163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:13.435434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] PATH_INFO: `/v3/users/aaa163b516b64b95896f38bf9e1952d1/application_credentials/1b71055d64d647d1a479a02cbf82cb75` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:13.438677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: Authorizing `identity:delete_application_credential(user_id=aaa163b516b64b95896f38bf9e1952d1, application_credential_id=1b71055d64d647d1a479a02cbf82cb75)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:13.441839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:13.504861 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2208/4430] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:09:13 2022] DELETE /identity/v3/users/aaa163b516b64b95896f38bf9e1952d1/application_credentials/1b71055d64d647d1a479a02cbf82cb75 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:13.509703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:13.511249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:13.650827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bece34-3f7c-4567-81e8-8de7820c48a6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:13.655852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7136edaf5e34b59a8fb28c063a17ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:13.656778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:13.657681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:13.657971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] PATH_INFO: `/v3/roles/bc95432044814457972081515b1f8ee0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:13.667853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bc95432044814457972081515b1f8ee0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:13.668932 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:13.668932 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:13.668932 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:13.669826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:13.751092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:13.765747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Invalidating the token cache because role bc95432044814457972081515b1f8ee0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:13.766139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.767336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32136e13-d25f-416a-96ca-8923ffd3fd4a tempest-ApplicationCredentialsV3AdminTest-241278191 tempest-ApplicationCredentialsV3AdminTest-241278191-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:13.771453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2223/4431] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:13 2022] DELETE /identity/v3/roles/bc95432044814457972081515b1f8ee0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:13.779753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:13.781933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:13.972095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fc1a5-afcc-4482-b89f-ff5a6c493983 tempest-ApplicationCredentialsV3AdminTest-669096790 tempest-ApplicationCredentialsV3AdminTest-669096790-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:14.217167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:14.220479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:14.221271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:14.221795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] PATH_INFO: `/v3/users/aaa163b516b64b95896f38bf9e1952d1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:14.223341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa163b516b64b95896f38bf9e1952d1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:14.226153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:14.340774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa163b516b64b95896f38bf9e1952d1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:14.349079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:14.366365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa163b516b64b95896f38bf9e1952d1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:14.391674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa163b516b64b95896f38bf9e1952d1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:14.393534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa163b516b64b95896f38bf9e1952d1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:14.394462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa163b516b64b95896f38bf9e1952d1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:14.423132 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2209/4432] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:13 2022] DELETE /identity/v3/users/aaa163b516b64b95896f38bf9e1952d1 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:14.427506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813bf6-5a91-4306-b1ba-6363c7db2fce None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:14.427975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813bf6-5a91-4306-b1ba-6363c7db2fce None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:14.428071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813bf6-5a91-4306-b1ba-6363c7db2fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:14.493700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1a813bf6-5a91-4306-b1ba-6363c7db2fce None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:14.494933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1a813bf6-5a91-4306-b1ba-6363c7db2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:14.603065 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2224/4433] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:14.630372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:14.632297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:14.789859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed2444-1c72-4474-b667-529efb27b79f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:14.795430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:14.796542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:14.797312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:14.797929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:14.830719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:14.833880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:14.849654 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2210/4434] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:15.210195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9a1d-5464-4f00-b951-799f3fdb50f0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:15.211571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9a1d-5464-4f00-b951-799f3fdb50f0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:15.212149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be9a1d-5464-4f00-b951-799f3fdb50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:15.242205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-32be9a1d-5464-4f00-b951-799f3fdb50f0 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:15.243464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-32be9a1d-5464-4f00-b951-799f3fdb50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:15.331093 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2225/4435] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:15.867692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:15.869080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:15.917231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed3fcb-156c-46f8-91dd-5edeae322a9c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:15.946817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:15.947784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:15.947999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:15.950638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] PATH_INFO: `/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:15.953248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e60450c3e5249709b06fa04b1ed0c5b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:15.962242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:16.181205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e60450c3e5249709b06fa04b1ed0c5b', 'request_id': 'req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:16.197985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e60450c3e5249709b06fa04b1ed0c5b', 'request_id': 'req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:16.208969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e60450c3e5249709b06fa04b1ed0c5b', 'request_id': 'req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:16.256618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] The token cache is being invalidate because project 1e60450c3e5249709b06fa04b1ed0c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:16.257798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:16.258768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-559c90c0-2ab6-49d6-ad0d-af7dc9a4610d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:16.269272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.269801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2211/4436] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:15 2022] DELETE /identity/v3/projects/1e60450c3e5249709b06fa04b1ed0c5b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:16.270227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.270506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.329107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:16.330595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:16.465534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2226/4437] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:16.475070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.475839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.476408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.517343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:16.521083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:16.543452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2212/4438] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:16.547471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:16.563311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea021f-8426-4741-a895-512e9aa32950 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:16.577235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:16.578036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.578555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.578907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.579734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:16.581494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:16.587784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:16.627319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:16.628095 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2227/4439] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:16.643891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a79db-c717-4b6f-860c-6282f79e6c53 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:16.650240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:16.650934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.651230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.651504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.652207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:16.654963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5637d1d-f9fa-4a1a-804d-fb8b0327b950 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:16.699902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2213/4440] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:16 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:16.705252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:16.720973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c6c52-e285-4c10-beb1-1e8ce27c8984 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:16.782955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:16.868133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.868659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.868729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.871474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:16.872189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.872498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.872787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.873472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:16.885485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:16.898099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:16.899890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:16.925664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2228/4441] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:16 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:16.926400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:16.931018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:16.939586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:16.957635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde5699-dfbd-489a-ac5b-b7ee03d01ae0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:16.969356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:16.970829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:16.971187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:16.971493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] PATH_INFO: `/v3/projects/9930d7c5353c49beb52f8dcd9af5341b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:16.973301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9930d7c5353c49beb52f8dcd9af5341b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:16.975866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:16.995788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2214/4442] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:16.996907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.017044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3589777-97b3-40f6-bd24-015c82a6d993 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.024642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:17.026337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.027313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.027609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.028470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:17.030573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:17.062440 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2215/4443] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:17.065482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.090017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9930d7c5353c49beb52f8dcd9af5341b', 'request_id': 'req-005783a7-eb6a-4c38-863c-77ca5d778f78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.090393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b5d9-8e8f-4797-9c24-26a0ddae144e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.110010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9930d7c5353c49beb52f8dcd9af5341b', 'request_id': 'req-005783a7-eb6a-4c38-863c-77ca5d778f78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.117052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9930d7c5353c49beb52f8dcd9af5341b', 'request_id': 'req-005783a7-eb6a-4c38-863c-77ca5d778f78'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.153256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] The token cache is being invalidate because project 9930d7c5353c49beb52f8dcd9af5341b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:17.153548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.165013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.169945 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2229/4444] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:16 2022] DELETE /identity/v3/projects/9930d7c5353c49beb52f8dcd9af5341b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:17.170871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.172289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:17.272150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:17.273879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.275653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.276049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.277171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:17.282551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:17.305890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783a7-eb6a-4c38-863c-77ca5d778f78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.314911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2216/4445] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:17.319423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.321006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:17.321939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.322213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.322494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] PATH_INFO: `/v3/users/a7136edaf5e34b59a8fb28c063a17ed7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.324540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7136edaf5e34b59a8fb28c063a17ed7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:17.325438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:17.326495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:17.370950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8a64-c952-4159-b71f-977d9ba89bac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.382933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:17.384365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.384776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.385159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] PATH_INFO: `/v3/projects/85e4ddf1bb8e43038c97299a7a80c28e/users/eb99c351982e43b191b395c4daf1d583/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.430538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:17.432246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7136edaf5e34b59a8fb28c063a17ed7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.433248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7136edaf5e34b59a8fb28c063a17ed7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.434152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e4ddf1bb8e43038c97299a7a80c28e, user_id=eb99c351982e43b191b395c4daf1d583, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:17.440568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277d86-bd65-4c79-bdb3-e44102b6292e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:17.453350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7136edaf5e34b59a8fb28c063a17ed7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.481662 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2217/4446] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:17 2022] PUT /identity/v3/projects/85e4ddf1bb8e43038c97299a7a80c28e/users/eb99c351982e43b191b395c4daf1d583/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:17.482192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7136edaf5e34b59a8fb28c063a17ed7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.491563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.491954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.492402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.494518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7136edaf5e34b59a8fb28c063a17ed7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:17.510877 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2230/4447] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:17 2022] DELETE /identity/v3/users/a7136edaf5e34b59a8fb28c063a17ed7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:17.551332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] MFA Rules not processed for user `eb99c351982e43b191b395c4daf1d583`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:17.557933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:17.650539 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2218/4448] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:17.656088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.657866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:17.794669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099680fc-d0cc-4b34-85c9-d788ddad8697 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.800252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:17.801110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:17.801395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:17.801672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:17.802659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:17.804825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:17.847791 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2231/4449] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:17 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:17.861836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:17.877557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25863-809a-4285-aae8-a458ffeabf49 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:17.929786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:18.024108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.024913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.025218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.025479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.026183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.028147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:18.079409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.079736 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2219/4450] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:17 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:18.098834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646be10-35d7-4afd-9ed5-2b6745824bf7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:18.113736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.116673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.118133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.119593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.120767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.122796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:18.138607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2232/4451] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:09:18.142987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.159127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ed5fe-f310-4ed5-a681-18004b6465ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:18.165684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.167147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.168036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.168555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] PATH_INFO: `/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3/users/070e150c5cac4d98a3f5e398a6ef640c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.215590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e982ef4f24f22b965d81bb595f6a3, user_id=070e150c5cac4d98a3f5e398a6ef640c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.226735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:18.268757 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2220/4452] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:18 2022] PUT /identity/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3/users/070e150c5cac4d98a3f5e398a6ef640c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:18.276227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.301448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30336afc-6311-4467-8c88-3f7e1f332e59 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:18.439555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.440664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.441075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.441456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.442361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.444691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fbd59-344c-4b29-b1be-688b00b257c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:18.472837 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2233/4453] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:18.480331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.498764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448249f-82ea-4879-92c3-06b21da2422c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:18.506000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.507100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.507485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.507868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] PATH_INFO: `/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3/users/070e150c5cac4d98a3f5e398a6ef640c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.510549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e982ef4f24f22b965d81bb595f6a3, user_id=070e150c5cac4d98a3f5e398a6ef640c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.514324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:18.533529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2221/4454] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:18 2022] PUT /identity/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3/users/070e150c5cac4d98a3f5e398a6ef640c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:18.548870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.549204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.549489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.594182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] MFA Rules not processed for user `070e150c5cac4d98a3f5e398a6ef640c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:18.595832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:18.671562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:18.720658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.722616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:18.831378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2234/4455] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:18.845680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:18.848972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:18.901503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5199d-26a1-4385-a6f2-e6c1f22f9e67 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:18.914259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:18.917234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:18.917527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:18.917809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] PATH_INFO: `/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:18.922076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08e2aae36cc43d7b9891b7f1f33f13a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:18.926973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:19.066016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'request_id': 'req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:19.079721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63089ad3-6763-4007-ac7d-7682e4e4f8c9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:19.086294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'request_id': 'req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:19.100902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08e2aae36cc43d7b9891b7f1f33f13a', 'request_id': 'req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:19.126118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] The token cache is being invalidate because project c08e2aae36cc43d7b9891b7f1f33f13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:19.126118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:19.127592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-faf28d22-827f-4b6f-b5c8-ee53cbe24f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:19.141125 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2222/4456] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:18 2022] DELETE /identity/v3/projects/c08e2aae36cc43d7b9891b7f1f33f13a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:19.149171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f2ae-f192-4ae2-ae56-c4b8196a840b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.152441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f2ae-f192-4ae2-ae56-c4b8196a840b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.152441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f2ae-f192-4ae2-ae56-c4b8196a840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.160815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:19.177231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2e68f2ae-f192-4ae2-ae56-c4b8196a840b None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:19.179343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e68f2ae-f192-4ae2-ae56-c4b8196a840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:19.235244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:19.235949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.236301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.236689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.241249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:19.355395 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2223/4457] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:19.357058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.359051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.359416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.403066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:19.405836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:19.451274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:19.452862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789fa4b-7989-4e51-9f64-e20f7e5288b9 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:19.482412 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2235/4458] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:19.568470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2224/4459] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:19.576317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.576632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.576917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.616469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:19.617747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:19.644911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:19.651352 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2236/4460] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:19.655532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcc807-7a9d-4c0d-b3d5-7de40dfa06ce None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:19.673690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:19.674391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.674679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.674960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.675838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:19.676007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:19.678355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:19.712097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:19.718250 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2225/4461] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:19.725647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc086-03a4-44c2-b92a-b0d8c4537235 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:19.744753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:19.745452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:19.745736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:19.746011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:19.746714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:19.750648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:19.759459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:19.815870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:19.820982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:19.830957 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2237/4462] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:19 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:19.831353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:19.860057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35f3e-aae1-4338-b43e-2f745a2c3ae0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.067928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998305d9-5bfa-4b86-9d55-754ee8d42d41 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.098055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.098772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.099210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.099357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.100280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.102412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaee3b-5266-434b-8eb7-249da324814c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.152209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2238/4463] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:19 2022] POST /identity/v3/users => generated 285 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:20.157467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.157760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.158046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.221776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] MFA Rules not processed for user `bee65f1c37764bdb9985b4e96a97ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:20.223023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:20.321738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2239/4464] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:20.322838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.337474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd71f8e-8548-4bb9-b65a-114af380aea3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.348620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.349597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.350021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.350436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.351337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.353154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.365893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2240/4465] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:20.370355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.372294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:20.403380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa792a7-665b-4d63-888f-fb9d822584d1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.414600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.415582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.416006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.416441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.417288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.419397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.490481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2241/4466] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:20 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:20.491426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.574261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:20.578500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.582260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.583560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.584990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] PATH_INFO: `/v3/users/eb99c351982e43b191b395c4daf1d583` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.603404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb99c351982e43b191b395c4daf1d583)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.608699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.625052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0623be-f704-45e1-8c2e-220aafd24388 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.630739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.631440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.631726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.632004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.632827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.634466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.649220 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2242/4467] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:20.650056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.661613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f885e-d8b5-4f9b-86ca-3ea55f391984 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.666733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.667429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.667718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.668169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.668740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.670737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.702488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2243/4468] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:20 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:20.702488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.725669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9e05-ed0a-47fb-a708-0b825c9be357 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:20.741981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:20.742916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.743208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.743544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] PATH_INFO: `/v3/projects/307899f4a594488b9ed018ed9baa0a34/users/f668a88a3e974819ab99d5d46edd89bc/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.772478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:20.781784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307899f4a594488b9ed018ed9baa0a34, user_id=f668a88a3e974819ab99d5d46edd89bc, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:20.787296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:20.792016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb99c351982e43b191b395c4daf1d583'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:20.816046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2244/4469] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:20 2022] PUT /identity/v3/projects/307899f4a594488b9ed018ed9baa0a34/users/f668a88a3e974819ab99d5d46edd89bc/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:20.825956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:20.840200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb99c351982e43b191b395c4daf1d583'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:20.875978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb99c351982e43b191b395c4daf1d583'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:20.877626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb99c351982e43b191b395c4daf1d583'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:20.880414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bf10094-2deb-4e01-8172-c67b0c63d602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb99c351982e43b191b395c4daf1d583'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:20.931708 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2226/4470] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:19 2022] DELETE /identity/v3/users/eb99c351982e43b191b395c4daf1d583 => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:20.936225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:20.938768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:20.939058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:20.994133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9249-104f-4fc7-8c63-7f34f0833346 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.057533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] MFA Rules not processed for user `f668a88a3e974819ab99d5d46edd89bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:21.059804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:21.147527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.148936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.149224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.149502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.150257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.152405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb192-d814-45c7-9067-1c908eca987d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.178251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2245/4471] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:21.179442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.182552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.182552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.205827 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2227/4472] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:21.207179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.209021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:21.214626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:21.215947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:21.235969 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2246/4473] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:21.237024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.240833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:21.254101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411cbbf-86a5-4347-8b57-052de6bca118 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.255395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683424f-0833-470c-80ff-126a5ccb8032 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.260434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.261481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.261947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.262162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.262446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.262602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.262940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.263042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] PATH_INFO: `/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4/users/6412ea72fc614168a6498d20e6a26f3c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.268186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.271242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.288575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932c8bf8a22a43cab5d091b6dfa13ba4, user_id=6412ea72fc614168a6498d20e6a26f3c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.293864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.314873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:21.321570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2247/4474] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:21 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:21.325937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.343789 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2228/4475] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:21 2022] PUT /identity/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4/users/6412ea72fc614168a6498d20e6a26f3c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:21.349804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.362238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:21.409239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551428f9-02e7-4c42-9f77-c5d730f240eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.426656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.427448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.427735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.428055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.430119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.434187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.479024 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2248/4476] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:21 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:21.479857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.497391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e318fa-72ea-48c1-a5b2-99c37d1fcd17 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.512069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b7558-907a-4a2b-a800-431df1d96afb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.517523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.518216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.518507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.518829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.519643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.526113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.547924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2249/4477] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:21.548924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.566344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328112d-c7ab-4c06-9704-e1eff46140f1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.581641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.582342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.582628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.583301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.583876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.587064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.604794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:21.650469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2250/4478] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:21.651691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.698712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.699566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.699924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.700268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.704379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81761dde-d896-49b9-903f-e2484b630832 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.729752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.732531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.737212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:21.738184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.738444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.738726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] PATH_INFO: `/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4/users/6412ea72fc614168a6498d20e6a26f3c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.742669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=932c8bf8a22a43cab5d091b6dfa13ba4, user_id=6412ea72fc614168a6498d20e6a26f3c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:21.748602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031d0a-e0c9-4eb7-8f98-78cbf4dfa95f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:21.767159 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2229/4479] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:21.772278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:21.792706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2251/4480] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:21 2022] PUT /identity/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4/users/6412ea72fc614168a6498d20e6a26f3c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:21.792908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20469a34-f5c0-46eb-ae2a-5605cc5a0567 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:21.914823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:21.915257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:21.915796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:21.952390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:21.955305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:22.059773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:22.063678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:22.066307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:22.067319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] PATH_INFO: `/v3/projects/8b7a000b01014093b3bc406265053b60/users/174039ede018444a83e30b59036b68a7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:22.116357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2252/4481] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:22.130635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7a000b01014093b3bc406265053b60, user_id=174039ede018444a83e30b59036b68a7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:22.133225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:22.164532 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2230/4482] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:21 2022] PUT /identity/v3/projects/8b7a000b01014093b3bc406265053b60/users/174039ede018444a83e30b59036b68a7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:22.168918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:22.190682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72bf7-4d67-4728-ad24-e8d652f65475 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:22.318976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:22.329267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:22.329861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:22.331086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:22.332143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:22.344358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9574e55-9fde-4a67-8937-9a8a817b9d99 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:22.355630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:22.385595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2253/4483] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:22.389951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:22.418413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4910e-1a28-4513-90e8-b8ad7cd93435 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:22.430883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:22.432039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:22.432445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:22.433543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] PATH_INFO: `/v3/projects/8b7a000b01014093b3bc406265053b60/users/174039ede018444a83e30b59036b68a7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:22.440040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7a000b01014093b3bc406265053b60, user_id=174039ede018444a83e30b59036b68a7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:22.447364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:22.491704 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2231/4484] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:22 2022] PUT /identity/v3/projects/8b7a000b01014093b3bc406265053b60/users/174039ede018444a83e30b59036b68a7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:22.502191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:22.504380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:22.506784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:22.593375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] MFA Rules not processed for user `174039ede018444a83e30b59036b68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:22.594647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:22.756983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2254/4485] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:22.760214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:22.785897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe597-d651-493d-88a1-48f1ee772fd5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:22.792148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:22.793015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:22.793270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:22.793713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:22.795944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:22.796285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:22.892634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:22.898850 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2232/4486] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:22 2022] POST /identity/v3/projects => generated 360 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:22.909339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a077f-1cd1-464f-9f44-472bb510bea5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.038564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.041432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:23.046968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.047680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.047963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.048261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.048981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.050864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.152121 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2255/4487] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:22 2022] POST /identity/v3/users => generated 413 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:23.153522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.176589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918049-f4ae-4a52-bd53-68310d652381 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.196158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.197374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.198208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c84c0-f0f1-4ae2-a989-9582537bd294 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.198354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.198759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/users/d3eb3fd767c94c85b0043297c61adbff` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.206079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.207436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.207896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.208224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] PATH_INFO: `/v3/projects/85e4ddf1bb8e43038c97299a7a80c28e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.209854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e4ddf1bb8e43038c97299a7a80c28e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.212456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.231562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_user(user_id=d3eb3fd767c94c85b0043297c61adbff)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.234740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.236742 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2256/4488] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:09:23 2022] GET /identity/v3/users/d3eb3fd767c94c85b0043297c61adbff => generated 413 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:23.240936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.266378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e3060-3656-4c46-9149-91f561860768 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.272094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.273114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.273476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.273821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/users/d3eb3fd767c94c85b0043297c61adbff` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.275206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d3eb3fd767c94c85b0043297c61adbff)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.278897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.296824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:23.335801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3eb3fd767c94c85b0043297c61adbff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.336740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3eb3fd767c94c85b0043297c61adbff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.340566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:23.342728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e4ddf1bb8e43038c97299a7a80c28e', 'request_id': 'req-48160d3f-4846-4d2a-b64a-d5cc0c1defed'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.349661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3eb3fd767c94c85b0043297c61adbff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.362384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e4ddf1bb8e43038c97299a7a80c28e', 'request_id': 'req-48160d3f-4846-4d2a-b64a-d5cc0c1defed'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.377088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e4ddf1bb8e43038c97299a7a80c28e', 'request_id': 'req-48160d3f-4846-4d2a-b64a-d5cc0c1defed'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.393463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3eb3fd767c94c85b0043297c61adbff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.402083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3eb3fd767c94c85b0043297c61adbff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.405119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] The token cache is being invalidate because project 85e4ddf1bb8e43038c97299a7a80c28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:23.405570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.408706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.417402 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2233/4489] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:23 2022] DELETE /identity/v3/projects/85e4ddf1bb8e43038c97299a7a80c28e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:23.417605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2257/4490] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:23 2022] DELETE /identity/v3/users/d3eb3fd767c94c85b0043297c61adbff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:23.419711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.419828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.421371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:23.428618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:23.547566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160d3f-4846-4d2a-b64a-d5cc0c1defed admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.595031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272a65-f064-4446-8f5f-99b18319fbff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:23.606192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.609198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.609656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.610730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/7ce653c159e643ff95e241dcf6de12e1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.614504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ce653c159e643ff95e241dcf6de12e1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.620552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.712677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:23.714018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:23.714520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:23.714799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] PATH_INFO: `/v3/users/070e150c5cac4d98a3f5e398a6ef640c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:23.717071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070e150c5cac4d98a3f5e398a6ef640c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:23.725727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:23.758515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce653c159e643ff95e241dcf6de12e1', 'request_id': 'req-25750d6e-bad5-4499-9750-159ddd8910a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.779062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce653c159e643ff95e241dcf6de12e1', 'request_id': 'req-25750d6e-bad5-4499-9750-159ddd8910a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.791300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce653c159e643ff95e241dcf6de12e1', 'request_id': 'req-25750d6e-bad5-4499-9750-159ddd8910a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.823980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 7ce653c159e643ff95e241dcf6de12e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:23.824279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.825877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.836148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2258/4491] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:23 2022] DELETE /identity/v3/projects/7ce653c159e643ff95e241dcf6de12e1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:23.837386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:23.847204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:23.877506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070e150c5cac4d98a3f5e398a6ef640c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.898387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070e150c5cac4d98a3f5e398a6ef640c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.918389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:23.922224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070e150c5cac4d98a3f5e398a6ef640c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.924285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070e150c5cac4d98a3f5e398a6ef640c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.925543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-99444894-4c8e-4a2e-8658-b33a5e9bb8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070e150c5cac4d98a3f5e398a6ef640c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:23.975607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2234/4492] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:23 2022] DELETE /identity/v3/users/070e150c5cac4d98a3f5e398a6ef640c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:23.991108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:24.002837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d6e-bad5-4499-9750-159ddd8910a7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:24.047266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.047500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.047977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.074961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:24.076598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:24.127869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:24.132875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.133360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.134043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.134816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:24.136924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:24.166885 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2259/4493] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:23 2022] POST /identity/v3/projects => generated 346 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:24.168666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:24.171771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:24.264440 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2235/4494] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:24.362009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690faf41-cf4b-40c4-bf1f-a8d77f79a2de tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:24.368818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:24.369657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.370216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.370721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.372112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:24.372579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:24.374174 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:24.374174 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:24.374174 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:24.375387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:24.408031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2260/4495] 10.222.0.39 () {58 vars in 1159 bytes} [Sat Jun 25 21:09:24 2022] GET /identity/v3/projects?is_domain=True => generated 1018 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:24.409158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:24.424516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f803-8946-43d2-a8b8-c39e59c9cebd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:24.438534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:24.439634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.440140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.440727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.441909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:24.447841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:24.470860 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2236/4496] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 21:09:24 2022] GET /identity/v3/domains => generated 827 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:24.475229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:24.490512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded44-3dc2-4e20-b4f4-502121099dd0 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:24.504539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:24.505686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.507483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.508347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ac752996f3404efca785ed0c14fa1f90` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.510039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_project(project_id=ac752996f3404efca785ed0c14fa1f90)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:24.511447 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:24.511447 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:24.511447 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:24.513347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:24.526365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.527559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.578640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.579896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.589065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:24.591179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:24.599307 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2261/4497] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:09:24 2022] PATCH /identity/v3/projects/ac752996f3404efca785ed0c14fa1f90 => generated 360 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:24.617621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09d2b0-e37f-4a91-ac67-835733d13196 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:24.731557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:24.733390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:24.733913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:24.734745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ac752996f3404efca785ed0c14fa1f90` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:24.763821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac752996f3404efca785ed0c14fa1f90)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:24.766021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:24.809710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.823464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.893871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:24.900606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.917815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.935958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.959462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project ac752996f3404efca785ed0c14fa1f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:24.959849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.960952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.974836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.981259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.982585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ac752996f3404efca785ed0c14fa1f90', 'request_id': 'req-010d0706-a403-459f-bd8e-be8dc6874e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:24.998356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:25.004734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2237/4498] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:24 2022] DELETE /identity/v3/projects/ac752996f3404efca785ed0c14fa1f90 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:25.018410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc720-ebe7-4eb0-a767-e4d4967fcb42 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:25.140339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:25.141537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:25.142790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:25.144446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:25.145496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:25.148150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa666a3-3b4c-4d25-85af-cebeb64733d3 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:25.171552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:25.313560 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2262/4499] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:24 2022] POST /identity/v3/projects => generated 359 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:25.317716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:25.320414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:25.359940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0706-a403-459f-bd8e-be8dc6874e6e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:25.415503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:25.421084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:25.421651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:25.462004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:25.466357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:25.554362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:25.557368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:25.560002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:25.560404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ceb1bcd2eb75465fa45b37af1db711be` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:25.563108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2263/4500] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:25.564492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=ceb1bcd2eb75465fa45b37af1db711be)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:25.566718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:25.576070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:25.577471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2238/4501] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:25 2022] GET /identity/v3/projects/ceb1bcd2eb75465fa45b37af1db711be => generated 359 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:25.600844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59c64-d08e-4502-ae3b-efa6b2e6b380 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:25.608383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:25.622154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:25.622622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:25.623015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ceb1bcd2eb75465fa45b37af1db711be` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:25.624660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ceb1bcd2eb75465fa45b37af1db711be)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:25.635073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:25.712551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb1bcd2eb75465fa45b37af1db711be', 'request_id': 'req-833618a6-c39d-41cd-8a74-1717b256cfee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:25.733350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb1bcd2eb75465fa45b37af1db711be', 'request_id': 'req-833618a6-c39d-41cd-8a74-1717b256cfee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:25.753830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:25.756892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:25.759198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb1bcd2eb75465fa45b37af1db711be', 'request_id': 'req-833618a6-c39d-41cd-8a74-1717b256cfee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:25.807319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project ceb1bcd2eb75465fa45b37af1db711be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:25.808234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:25.809444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:25.822591 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2264/4502] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:25 2022] DELETE /identity/v3/projects/ceb1bcd2eb75465fa45b37af1db711be => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:25.826214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:25.828502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:25.954991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba8872-2da4-4ca7-adfd-486b64200823 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.026357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833618a6-c39d-41cd-8a74-1717b256cfee tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.041530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.042225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.042514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.042791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.043502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.045489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.103339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:26.121037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.122314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.122604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.122878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] PATH_INFO: `/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.127971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7e982ef4f24f22b965d81bb595f6a3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.135941 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2265/4503] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:25 2022] POST /identity/v3/projects => generated 360 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:26.138031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.147389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.166903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:26.296459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7e982ef4f24f22b965d81bb595f6a3', 'request_id': 'req-d58298c4-dedb-4a97-800e-47951180a210'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.314272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7e982ef4f24f22b965d81bb595f6a3', 'request_id': 'req-d58298c4-dedb-4a97-800e-47951180a210'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.329478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7e982ef4f24f22b965d81bb595f6a3', 'request_id': 'req-d58298c4-dedb-4a97-800e-47951180a210'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.359538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed698e9c-6e50-4b91-bc0a-31075685f30c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.363295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] The token cache is being invalidate because project ea7e982ef4f24f22b965d81bb595f6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:26.363817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.364756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d58298c4-dedb-4a97-800e-47951180a210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.370952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2239/4504] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:25 2022] DELETE /identity/v3/projects/ea7e982ef4f24f22b965d81bb595f6a3 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:26.373884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb1ad-1f7a-4425-9fa1-0eeb4b64237d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.374329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb1ad-1f7a-4425-9fa1-0eeb4b64237d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.374766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeb1ad-1f7a-4425-9fa1-0eeb4b64237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.401042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cddeb1ad-1f7a-4425-9fa1-0eeb4b64237d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:26.403558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cddeb1ad-1f7a-4425-9fa1-0eeb4b64237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:26.519597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.522004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.523155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.523861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/eb1405165aac4074b7446a2bd77fb200` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.526304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=eb1405165aac4074b7446a2bd77fb200)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.532635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.544754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2240/4505] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:26.553046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.553727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.554220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.562901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2266/4506] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:26 2022] GET /identity/v3/projects/eb1405165aac4074b7446a2bd77fb200 => generated 360 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:26.562901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.565950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:26.580960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1695-adb2-4746-b053-0efc65975400 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.591656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.592605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.592942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.601010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/eb1405165aac4074b7446a2bd77fb200` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.602810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb1405165aac4074b7446a2bd77fb200)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.605803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.624970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:26.626452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:26.648519 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2241/4507] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:26.652573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.666843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b3ec7-0cbf-4b55-889a-6c2035b0ecb6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.673658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.675192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.675303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.678097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.679727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:26.680152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.683121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.702179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1405165aac4074b7446a2bd77fb200', 'request_id': 'req-7aa622c9-c361-4506-b338-bcc7ba0d70b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.709084 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2242/4508] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:09:26.711170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.716213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1405165aac4074b7446a2bd77fb200', 'request_id': 'req-7aa622c9-c361-4506-b338-bcc7ba0d70b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.717882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:26.726235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1405165aac4074b7446a2bd77fb200', 'request_id': 'req-7aa622c9-c361-4506-b338-bcc7ba0d70b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.747045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d099d9-8430-4232-b3fc-fc5f7abbb782 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.748104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project eb1405165aac4074b7446a2bd77fb200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:26.748645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.749671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:26.753019 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2267/4509] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:26 2022] DELETE /identity/v3/projects/eb1405165aac4074b7446a2bd77fb200 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:26.756983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.759987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:26.806966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:26.851829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa622c9-c361-4506-b338-bcc7ba0d70b7 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:26.879749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.881926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.882577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.884133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:26.884559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.885404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.886385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:26.888377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:26.888960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] PATH_INFO: `/v3/users/b6aaf0215c7d4342b75c8921f1ac54d3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:26.891150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.892097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6aaf0215c7d4342b75c8921f1ac54d3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:26.895747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:26.944301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:26.960343 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2268/4510] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:26 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:26.966995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:26.972085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:27.004508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6aaf0215c7d4342b75c8921f1ac54d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.021461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6aaf0215c7d4342b75c8921f1ac54d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.048564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6aaf0215c7d4342b75c8921f1ac54d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.050385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6aaf0215c7d4342b75c8921f1ac54d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.052209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6aaf0215c7d4342b75c8921f1ac54d3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.071311 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2243/4511] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:26 2022] DELETE /identity/v3/users/b6aaf0215c7d4342b75c8921f1ac54d3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:27.072721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.079426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31d69d-475d-40ed-a8ce-fb4ef564dc4a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.090145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:27.190716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.191503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.191794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.192105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.193367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.194810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c652ec-301f-4abc-93ee-579677a9d598 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.252263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2269/4512] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:09:26 2022] POST /identity/v3/projects => generated 347 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:27.254547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.255282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.256002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.294795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:27.296511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:27.320049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0053-825b-4a78-a602-835ff8172c87 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.426171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:27.453121 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2270/4513] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:27.454422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.456572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:27.494694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.496131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.496769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.497273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.498216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.503275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.554337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2244/4514] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:27 2022] POST /identity/v3/users => generated 293 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:27.558484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.578712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc92e-047c-4fbf-a439-4cc267b3a5f2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.579256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e307d-ee91-44d7-a217-819d507eb535 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.586604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.587878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.588866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.589375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/3d373d719fb34a89bc8f7a91cc8c4402` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.590960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d373d719fb34a89bc8f7a91cc8c4402)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.591578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.592090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.592483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.593417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.593666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.595897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.597012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.598506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2271/4515] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:27 2022] GET /identity/v3/projects/3d373d719fb34a89bc8f7a91cc8c4402 => generated 347 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:27.602863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.623420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616b33-5d3f-4c5f-938b-6f2d9a52ddd9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.625834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2245/4516] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:27.630156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.632146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.633069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.633356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.634329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/3d373d719fb34a89bc8f7a91cc8c4402` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.639038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d373d719fb34a89bc8f7a91cc8c4402)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.641170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.652377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3775f4-016a-4122-b126-432e7317bed8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.659827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.660561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.660847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.661126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.662244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.663892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.708327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2246/4517] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:27.715516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.743499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a48215-ceed-4990-876f-268808153e70 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.765023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:27.804744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d373d719fb34a89bc8f7a91cc8c4402', 'request_id': 'req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.819822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d373d719fb34a89bc8f7a91cc8c4402', 'request_id': 'req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.845029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d373d719fb34a89bc8f7a91cc8c4402', 'request_id': 'req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.869871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 3d373d719fb34a89bc8f7a91cc8c4402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:27.870171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.871457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:27.876594 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2272/4518] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:27 2022] DELETE /identity/v3/projects/3d373d719fb34a89bc8f7a91cc8c4402 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:27.880352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.883583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:27.887270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.888181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.888501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.888787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] PATH_INFO: `/v3/projects/6c2db543e1f6498ca352cb4c10f97407/users/ba111f294d66480cbdbe17c8fc7ad0f4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.905046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265f7a-5eb5-47ce-83d6-1806f4be3ccb tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:27.910049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2db543e1f6498ca352cb4c10f97407, user_id=ba111f294d66480cbdbe17c8fc7ad0f4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.912099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:27.913013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.914833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:27.915498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:27.915870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] PATH_INFO: `/v3/projects/26b2606c05e441e58e2bba46a8ee48e5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:27.920476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b2606c05e441e58e2bba46a8ee48e5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:27.920722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:27.942030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2247/4519] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:27 2022] PUT /identity/v3/projects/6c2db543e1f6498ca352cb4c10f97407/users/ba111f294d66480cbdbe17c8fc7ad0f4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:27.952179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:27.953990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.009494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b2606c05e441e58e2bba46a8ee48e5', 'request_id': 'req-27ba7dda-d197-499b-a1a6-009f2fda9193'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.026627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b2606c05e441e58e2bba46a8ee48e5', 'request_id': 'req-27ba7dda-d197-499b-a1a6-009f2fda9193'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.043937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b2606c05e441e58e2bba46a8ee48e5', 'request_id': 'req-27ba7dda-d197-499b-a1a6-009f2fda9193'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.061547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] The token cache is being invalidate because project 26b2606c05e441e58e2bba46a8ee48e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:28.062884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.064042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ba7dda-d197-499b-a1a6-009f2fda9193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.068496 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2273/4520] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:27 2022] DELETE /identity/v3/projects/26b2606c05e441e58e2bba46a8ee48e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:28.069919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d1d4-dc77-4581-a8e8-bae179441b7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.071096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.071839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.072388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.081235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:28.123114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] MFA Rules not processed for user `ba111f294d66480cbdbe17c8fc7ad0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:28.125474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.186172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.187561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.187986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.188991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.190021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.191626 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:28.191626 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:28.191626 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:28.193423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.223617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2248/4521] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:09:27 2022] POST /identity/v3/domains => generated 277 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:28.225374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.227397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.231081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2274/4522] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:28.231081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.231281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.249111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b73bb-e3d3-4d62-9158-2394f94f3322 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.277774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:28.334771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1091f-e6f5-4edb-9236-d5f16e83950a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.342829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.344756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.345136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.345739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] PATH_INFO: `/v3/users/91429b3bdbb147e6ab7d91ebbba73af4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.347935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91429b3bdbb147e6ab7d91ebbba73af4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.351572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.355611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.356550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.356866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.357195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.357958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.361919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.434533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91429b3bdbb147e6ab7d91ebbba73af4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.439206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2275/4523] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:28 2022] POST /identity/v3/projects => generated 404 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:28.440227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.442411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.454848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91429b3bdbb147e6ab7d91ebbba73af4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.487167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91429b3bdbb147e6ab7d91ebbba73af4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.487957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91429b3bdbb147e6ab7d91ebbba73af4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.488398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91429b3bdbb147e6ab7d91ebbba73af4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.510161 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2249/4524] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:28 2022] DELETE /identity/v3/users/91429b3bdbb147e6ab7d91ebbba73af4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:28.513716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.518791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.580488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8e4-55cd-48c9-aa7f-3da7011ba5fa tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.599929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:28.648969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47480e-834d-43d6-84ca-6a1b16328937 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.657046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.657950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.658462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.658756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/7004801421ef49ca916db9264a76d7a1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.660388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=7004801421ef49ca916db9264a76d7a1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.663511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.665872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2250/4525] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:28 2022] GET /identity/v3/projects/7004801421ef49ca916db9264a76d7a1 => generated 404 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:28.670200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.682688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.684610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.686285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c434d1a-2e1f-47e9-ae3e-571e3a2bba2a tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:28.686993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.687495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.689335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.692303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.692729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:28.693808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:28.694097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:28.694380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/7004801421ef49ca916db9264a76d7a1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:28.695627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7004801421ef49ca916db9264a76d7a1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:28.698967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:28.762016 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2276/4526] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:28 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:28.766314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.771515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.825645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7004801421ef49ca916db9264a76d7a1', 'request_id': 'req-2b279ce3-e4cb-4df0-98be-8342d8111068'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.832044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:28.852326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7004801421ef49ca916db9264a76d7a1', 'request_id': 'req-2b279ce3-e4cb-4df0-98be-8342d8111068'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.870409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7004801421ef49ca916db9264a76d7a1', 'request_id': 'req-2b279ce3-e4cb-4df0-98be-8342d8111068'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.887579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 7004801421ef49ca916db9264a76d7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:28.888022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.888804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:28.893213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2251/4527] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:28 2022] DELETE /identity/v3/projects/7004801421ef49ca916db9264a76d7a1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:28.897001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:28.898581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:28.930953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6680b8-971e-462a-988e-2d2f934f31d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.000257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b279ce3-e4cb-4df0-98be-8342d8111068 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.017046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.020772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.020963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.021107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.021330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] PATH_INFO: `/v3/projects/7ab1810b8d3f4b779e76e0c393c1c519` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.022206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.024321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab1810b8d3f4b779e76e0c393c1c519)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.024804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.025247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.026100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.026929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.032642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.086553 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2277/4528] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:28 2022] POST /identity/v3/users => generated 294 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:29.087251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.091840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.110831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab1810b8d3f4b779e76e0c393c1c519', 'request_id': 'req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.122672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab1810b8d3f4b779e76e0c393c1c519', 'request_id': 'req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.133937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab1810b8d3f4b779e76e0c393c1c519', 'request_id': 'req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.169523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:29.171868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] The token cache is being invalidate because project 7ab1810b8d3f4b779e76e0c393c1c519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:29.172686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.173708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.182119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2252/4529] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:28 2022] DELETE /identity/v3/projects/7ab1810b8d3f4b779e76e0c393c1c519 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:29.182119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.185984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.217827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453e1e-0fb1-4137-aa9f-08543f9cb657 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.314760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4d9d-0fb6-467e-80ef-cefbdc63fb4f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.320660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.322573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.323107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.323582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/a3b552bb6378409f99bf787769ef3560` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.325467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a3b552bb6378409f99bf787769ef3560)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.325717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.327137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.327336 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:29.327336 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:29.327336 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:29.328895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.329114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.330056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.331420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.339130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd34cc-2d20-4832-9ae7-0e786af6c389 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.391779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2253/4530] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:29.393678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.394098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.394523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.397104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.398974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.418466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:29.452834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:29.455140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.466303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.468265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:29.476986 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2278/4531] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:09:29 2022] PATCH /identity/v3/domains/a3b552bb6378409f99bf787769ef3560 => generated 278 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:29.478399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.485040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.612946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f2e1b-3750-4f43-b988-8c88f1bba66c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.622389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.624097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.624383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.624709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.631437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.636819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35046cb-8808-44ff-a35c-629d18815451 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.648322 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2254/4532] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:29.649667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.670861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2279/4533] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:29.672098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.672329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.672655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.672974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.697122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:29.698354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:29.724712 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2280/4534] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:29.730590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.761911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b24c-6a2f-4ff6-9ddd-d786a8f6fb8d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.780225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:29.783578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:29.784783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:29.785212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] PATH_INFO: `/v3/projects/314b97f50c064672baac673f2c9a6ee0/users/7753c2b161e342ef8f9e1232229d87a7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:29.823631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] RBAC: Authorizing `identity:create_grant(project_id=314b97f50c064672baac673f2c9a6ee0, user_id=7753c2b161e342ef8f9e1232229d87a7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:29.827608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:29.873338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2281/4535] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:29 2022] PUT /identity/v3/projects/314b97f50c064672baac673f2c9a6ee0/users/7753c2b161e342ef8f9e1232229d87a7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:29.873338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:29.896936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15270f-6619-4639-97fb-f8085b94d160 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:29.938077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:30.100851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43b9c-56fe-4819-a1f2-893c740c378e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:30.109090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:30.110095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.114752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:30.115470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.115768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.116397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.117147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.117591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:30.117696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/a3b552bb6378409f99bf787769ef3560` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.117782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:30.119368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b57d25-4965-4631-8d37-93eb6c1b427c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:30.149562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2282/4536] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:30.150860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4651-71c3-4e71-8857-1d87eecf114e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.151158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4651-71c3-4e71-8857-1d87eecf114e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.151445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4651-71c3-4e71-8857-1d87eecf114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.159311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a3b552bb6378409f99bf787769ef3560)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:30.160578 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:30.160578 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:30.160578 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:30.161915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:30.210647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d75e4651-71c3-4e71-8857-1d87eecf114e None None] MFA Rules not processed for user `7753c2b161e342ef8f9e1232229d87a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:30.212066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d75e4651-71c3-4e71-8857-1d87eecf114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:30.225617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.239732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a3b552bb6378409f99bf787769ef3560'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.340879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:30.415166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.422202 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2283/4537] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:30.424162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c56f9-5031-4b3f-b712-52a867ce44bf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.425541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c56f9-5031-4b3f-b712-52a867ce44bf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.425932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c56f9-5031-4b3f-b712-52a867ce44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.429260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.446275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.479129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cc6c56f9-5031-4b3f-b712-52a867ce44bf None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:30.480818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project a3b552bb6378409f99bf787769ef3560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:30.482315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc6c56f9-5031-4b3f-b712-52a867ce44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:30.482732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.486598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.512065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.530821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.536161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a3b552bb6378409f99bf787769ef3560', 'request_id': 'req-6c39e604-3ebd-4862-8a58-ed1398b6e633'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:30.560873 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2255/4538] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:29 2022] DELETE /identity/v3/domains/a3b552bb6378409f99bf787769ef3560 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:30.570316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:30.585376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:30.671647 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2284/4539] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:30.673173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.686184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.686537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.764173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39e604-3ebd-4862-8a58-ed1398b6e633 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:30.817781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:30.820020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:30.820385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:30.820733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:30.821725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:30.844985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:30.845444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:30.848781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:30.900652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:30.934623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2256/4540] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:30 2022] POST /identity/v3/projects => generated 363 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:30.943479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:30.950005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:31.014861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2285/4541] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:31.015966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.020919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:31.186193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d06ab-1efe-489b-b425-728f4052f4e6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.247832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.248950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.249632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.250192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.251100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.253217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.260991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f694-ebfb-49e1-8095-ab06fdac7a7d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.364723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:31.388237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2257/4542] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:30 2022] POST /identity/v3/projects => generated 387 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:31.389468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.415254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.415972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.416249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.416563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.417314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.418354 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:31.418354 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:31.418354 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:31.420047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.454476 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2286/4543] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:09:31 2022] POST /identity/v3/domains => generated 277 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:31.458474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.477972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:31.532924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6bd78-d557-4306-afe9-f000d5bc4006 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.583098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:31.600375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.601417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.601704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.601978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.602677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.604656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.608234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea13a2-d332-4dd5-b1fa-5046a0d0bc48 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.618078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.620070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.621047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.621922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.634759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2258/4544] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:31 2022] POST /identity/v3/users => generated 282 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:31.635923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.648272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7e8b-a7a4-4924-b42c-c9fcd23a3967 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.667731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.668449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.668750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.669028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.669728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.672389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.724842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2259/4545] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:31 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:31.726036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.743433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.746489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.757865 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2287/4546] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:31.759877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.771765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c22d3-3323-4b0c-b886-c7bf2ec0956e service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.797095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.797837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.798130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.798410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.799430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.802060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.835651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2288/4547] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:31.835651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.848168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b67f06-158b-411f-8d8f-55016d18cf60 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.853172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.854424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.854715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.854990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.855722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.857660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.874781 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2289/4548] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:31.875636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.889225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47853b2-0dbc-4c4b-b842-feedacae8811 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.895034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.895809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.896095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.896373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.897150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.898907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.909239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdc2fc-d605-4f63-8e71-b3de574a15a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.920584 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2290/4549] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:31.921526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:31.926168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.928074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.929778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.931387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.932627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.934260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7314d4-7cf5-4d65-9653-1acaa731f5b3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:31.935657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:31.939326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:31.940371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:31.944359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:31.944359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] PATH_INFO: `/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc/users/adf6aa90e6774838affb5ecf8f6d14eb/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:31.983732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fe86e5bc5e4a8fbe34861960b589fc, user_id=adf6aa90e6774838affb5ecf8f6d14eb, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:31.987666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:32.001455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:32.026634 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2291/4550] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:31 2022] PUT /identity/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc/users/adf6aa90e6774838affb5ecf8f6d14eb/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:32.028942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:32.036491 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2260/4551] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:31 2022] POST /identity/v3/projects => generated 409 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:32.037612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:32.173814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27f44-bcd7-45f2-8e21-7541418ebf75 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:32.190084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:32.191291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.191895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.192699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] PATH_INFO: `/v3/projects/bef145fbccb74031a07d8ee987b3e75e/users/21c6e7055a004a6baa989682f2657f75/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.193630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e5920-405a-42fa-9a59-67a8afd2726c tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:32.205082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:32.208676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.209279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.209760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.212204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:32.215741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:32.215865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef145fbccb74031a07d8ee987b3e75e, user_id=21c6e7055a004a6baa989682f2657f75, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:32.218693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:32.248740 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2292/4552] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:32 2022] PUT /identity/v3/projects/bef145fbccb74031a07d8ee987b3e75e/users/21c6e7055a004a6baa989682f2657f75/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:32.259386 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2261/4553] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:32.259386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:32.261330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:32.357480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:32.391323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16ba1-2d48-4d4f-a225-d2cb43ce9def admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:32.505515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d41e-e7ba-4ad2-85db-3982a1e34c4d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:32.523657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:32.524166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.524467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.524752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] PATH_INFO: `/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc/users/adf6aa90e6774838affb5ecf8f6d14eb/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.529388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fe86e5bc5e4a8fbe34861960b589fc, user_id=adf6aa90e6774838affb5ecf8f6d14eb, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:32.534757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf79016-ef93-4b28-847d-3a3a149549d4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:32.566177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2293/4554] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:32 2022] PUT /identity/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc/users/adf6aa90e6774838affb5ecf8f6d14eb/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:32.567851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.568144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.568691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.599491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:32.600520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.600958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.601381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.602262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:32.604467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b093f-689e-42dc-bf2b-33280864a409 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:32.638411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] MFA Rules not processed for user `21c6e7055a004a6baa989682f2657f75`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:32.640626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:32.741943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2262/4555] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:32 2022] POST /identity/v3/projects => generated 404 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:32.746431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:32.746726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:32.753621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:32.854754 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2294/4556] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:32.855794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:32.885319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] MFA Rules not processed for user `adf6aa90e6774838affb5ecf8f6d14eb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:32.886606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:32.915791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:32.996286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f14e-8f3c-483c-8adf-4e6f5a0b7947 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:33.102970 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2263/4557] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:33.113414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:33.114988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:33.125417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:33.149387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:33.150873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:33.151009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:33.151334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/9d520581f28d478983582670ef3529e5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:33.155268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d520581f28d478983582670ef3529e5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:33.158698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:33.207416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5996e-ea9f-49b4-a5ee-e439126b471b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:33.230477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:33.231310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:33.231628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:33.231955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:33.245908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:33.250986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:33.284013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2264/4558] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:33.287983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:33.294193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:33.304432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d520581f28d478983582670ef3529e5', 'request_id': 'req-162aa644-ffc8-4094-b955-332b5032e924'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:33.329282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d520581f28d478983582670ef3529e5', 'request_id': 'req-162aa644-ffc8-4094-b955-332b5032e924'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:33.349018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d520581f28d478983582670ef3529e5', 'request_id': 'req-162aa644-ffc8-4094-b955-332b5032e924'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:33.399784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 9d520581f28d478983582670ef3529e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:33.400126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:33.409013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:33.411018 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2295/4559] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:32 2022] DELETE /identity/v3/projects/9d520581f28d478983582670ef3529e5 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:33.416647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:33.420236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:33.558211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278570-deb5-4b52-a500-d14b5f506b84 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:33.653235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa644-ffc8-4094-b955-332b5032e924 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:33.667052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:33.667968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:33.670358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:33.671343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/84172edf083948aa8c07d630a1a82d2d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:33.675094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84172edf083948aa8c07d630a1a82d2d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:33.681770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:33.688684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:33.755642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:33.763679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:33.763937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:33.764369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:33.779371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:34.006952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84172edf083948aa8c07d630a1a82d2d', 'request_id': 'req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.015937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:34.027089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:34.046974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84172edf083948aa8c07d630a1a82d2d', 'request_id': 'req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.054226 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2265/4560] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:34.057471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84172edf083948aa8c07d630a1a82d2d', 'request_id': 'req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.082170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 84172edf083948aa8c07d630a1a82d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:34.082423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.083883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.093432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:34.096541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2296/4561] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:33 2022] DELETE /identity/v3/projects/84172edf083948aa8c07d630a1a82d2d => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:34.116938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec63e-1ec6-45fb-babd-ea3d858f05b4 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:34.296399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:34.305745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:34.306195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:34.306591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/74073d7452594b3981e349051e373e1e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:34.312058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=74073d7452594b3981e349051e373e1e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:34.313286 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:34.313286 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:34.313286 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:34.316166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:34.393876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.396683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.461070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.462636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.470640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2266/4562] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:09:34 2022] PATCH /identity/v3/domains/74073d7452594b3981e349051e373e1e => generated 278 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:34.472883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:34.474508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:34.518873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ffb3-f83e-4f15-9e4c-8121c5ef2d2e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:34.559778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:34.620602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:34.622543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:34.749210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:34.750533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:34.751026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:34.751512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/74073d7452594b3981e349051e373e1e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:34.759144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:34.773590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527679-bbbc-418c-942f-ca59e63a027e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:34.787368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:34.789011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:34.789454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:34.789873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:34.797490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:34.809321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74073d7452594b3981e349051e373e1e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:34.810509 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:34.810509 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:34.810509 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:34.811653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:34.902185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.920134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '74073d7452594b3981e349051e373e1e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:34.953598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:34.965014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:34.987538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2267/4563] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:34.996694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:34.998290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:35.107572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.121249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.136261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.175545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42187e7-4845-4fd0-a142-6fc487855f20 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:35.177359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 74073d7452594b3981e349051e373e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:35.177825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.180118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.218469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.237282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.238592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '74073d7452594b3981e349051e373e1e', 'request_id': 'req-e04646d7-7f10-4980-9ba0-1e41bf3394ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.255266 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2297/4564] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:34 2022] DELETE /identity/v3/domains/74073d7452594b3981e349051e373e1e => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:35.259461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:35.265260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:35.399815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:35.401119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:35.401402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:35.401679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] PATH_INFO: `/v3/users/21c6e7055a004a6baa989682f2657f75` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:35.404364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c6e7055a004a6baa989682f2657f75)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:35.408098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:35.482172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:35.532952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04646d7-7f10-4980-9ba0-1e41bf3394ff tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:35.533445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c6e7055a004a6baa989682f2657f75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.538993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:35.553616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c6e7055a004a6baa989682f2657f75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.554517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:35.555337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:35.555736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:35.556667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:35.557130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:35.559226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:35.590716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c6e7055a004a6baa989682f2657f75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.591980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c6e7055a004a6baa989682f2657f75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.593649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871d4373-c671-4ab2-9350-6e82ec709dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c6e7055a004a6baa989682f2657f75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:35.631820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2268/4565] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:34 2022] DELETE /identity/v3/users/21c6e7055a004a6baa989682f2657f75 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:35.634753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:35.639732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:35.640030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:35.699427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:35.702723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:35.704259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2298/4566] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:35 2022] POST /identity/v3/projects => generated 376 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:35.705133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:35.717545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:35.830537 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2269/4567] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:35.842347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:35.844279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:35.987651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb130e-39d7-4709-bbb7-eefbfb51ca4a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:35.998162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:35.998843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:35.999139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.000319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.035687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.037654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:36.050332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2695cd-a338-4ad4-b56a-47813d8e678f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:36.068144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:36.069099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:36.069382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.069662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/d1f1a186f571495d8419d89037996cfb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.076570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=d1f1a186f571495d8419d89037996cfb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.078828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:36.082210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2270/4568] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:09:36.085225 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2299/4569] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:35 2022] GET /identity/v3/projects/d1f1a186f571495d8419d89037996cfb => generated 376 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:36.089655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:36.107568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ab7d-c912-4878-afc8-d0f7686f16d5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:36.127704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:36.128890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:36.129190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.129475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.130319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.132224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:36.203170 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2271/4570] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:09:36 2022] GET /identity/v3/projects => generated 8069 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:09:36.205396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:36.217902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d743cfe-4808-41b1-86ca-0996d7f94f03 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:36.241068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:36.242141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:36.242596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.243030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/d1f1a186f571495d8419d89037996cfb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.246623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1f1a186f571495d8419d89037996cfb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.248882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:36.398071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f1a186f571495d8419d89037996cfb', 'request_id': 'req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:36.414648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f1a186f571495d8419d89037996cfb', 'request_id': 'req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:36.424698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f1a186f571495d8419d89037996cfb', 'request_id': 'req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:36.463499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project d1f1a186f571495d8419d89037996cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:36.463764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:36.464613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:36.467464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2300/4571] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:36 2022] DELETE /identity/v3/projects/d1f1a186f571495d8419d89037996cfb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:36.471885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:36.474345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:36.499478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3d7f6-eb88-4c52-8e7f-016834a67706 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:36.627402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:36.647318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:36.648555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:36.648857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.649148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.649868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.651784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:36.718282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2272/4572] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:09:36 2022] POST /identity/v3/projects => generated 348 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:36.722179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:36.734433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928793-1a0d-4dc0-9ef4-1f716cef6bb8 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:36.948330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:36.979157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:36.982106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:36.982408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:36.982699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:36.992808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_project(project_id=46ac5ea744f14a4a8dd6d17a844bebea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:36.996272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:37.070497 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2301/4573] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:09:36 2022] PATCH /identity/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea => generated 361 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:37.073525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:37.092632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4baa11-3dc6-4763-8206-013f9c36882f tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:37.101185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:37.102322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:37.103942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:37.104386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:37.124828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=46ac5ea744f14a4a8dd6d17a844bebea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:37.132198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:37.137893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2273/4574] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:37 2022] GET /identity/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea => generated 348 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:37.141618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:37.157966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1f45-5f18-4aca-884e-e45b29ce9121 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:37.168950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:37.170908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:37.172931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:37.173306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:37.181458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46ac5ea744f14a4a8dd6d17a844bebea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:37.187882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:37.329718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ac5ea744f14a4a8dd6d17a844bebea', 'request_id': 'req-e31c6fea-5b67-4e12-829c-0949e9920800'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:37.341365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ac5ea744f14a4a8dd6d17a844bebea', 'request_id': 'req-e31c6fea-5b67-4e12-829c-0949e9920800'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:37.361683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ac5ea744f14a4a8dd6d17a844bebea', 'request_id': 'req-e31c6fea-5b67-4e12-829c-0949e9920800'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:37.394074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project 46ac5ea744f14a4a8dd6d17a844bebea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:37.394369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:37.401397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:37.404131 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2302/4575] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:37 2022] DELETE /identity/v3/projects/46ac5ea744f14a4a8dd6d17a844bebea => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:37.409340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:37.411802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:37.456267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e2c3-0d9e-4109-b19c-8656acb06766 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:37.653385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:37.654129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:37.669635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:37.669635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:37.669635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:37.669635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:37.757401 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2274/4576] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:37 2022] POST /identity/v3/projects => generated 361 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:37.761674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:37.799278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6fea-5b67-4e12-829c-0949e9920800 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:37.947068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:37.948305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:37.948903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:37.949191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/d4340fef6fa344c9a42345a7362241eb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:37.950584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_project(project_id=d4340fef6fa344c9a42345a7362241eb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:37.954105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:38.130540 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2303/4577] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:09:37 2022] PATCH /identity/v3/projects/d4340fef6fa344c9a42345a7362241eb => generated 373 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:09:38.134463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:38.157070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d92c6-3ba1-4de7-ad02-a3c12e990c73 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:38.164504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:38.165419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:38.165750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:38.166028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/d4340fef6fa344c9a42345a7362241eb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:38.220688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4340fef6fa344c9a42345a7362241eb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:38.223157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:38.241003 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2275/4578] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:38 2022] GET /identity/v3/projects/d4340fef6fa344c9a42345a7362241eb => generated 360 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:38.245455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:38.266631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca747dc-8eab-411a-8817-310280a44eb9 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:38.287803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:38.294939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:38.297749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:38.298072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/d4340fef6fa344c9a42345a7362241eb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:38.303645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4340fef6fa344c9a42345a7362241eb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:38.315001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:38.376286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:38.452020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4340fef6fa344c9a42345a7362241eb', 'request_id': 'req-e0269c1c-5824-40a2-872b-e9fae603187e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:38.480547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4340fef6fa344c9a42345a7362241eb', 'request_id': 'req-e0269c1c-5824-40a2-872b-e9fae603187e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:38.488742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4340fef6fa344c9a42345a7362241eb', 'request_id': 'req-e0269c1c-5824-40a2-872b-e9fae603187e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:38.503570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project d4340fef6fa344c9a42345a7362241eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:38.504057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:38.504969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:38.507705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2304/4579] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:38 2022] DELETE /identity/v3/projects/d4340fef6fa344c9a42345a7362241eb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:38.514697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:38.516080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:38.539938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26645cf8-f21b-48b2-b0cc-013f60c21957 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:38.704581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:38.706947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:38.707345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:38.707736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:38.709045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:38.711261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:38.798378 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2276/4580] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:38 2022] POST /identity/v3/projects => generated 352 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:38.800733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:38.815419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0269c1c-5824-40a2-872b-e9fae603187e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:38.989231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:38.999468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:39.000657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:39.001099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ba31bb6a89c74825999e13e06102c67b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:39.002810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:update_project(project_id=ba31bb6a89c74825999e13e06102c67b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:39.006389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:39.075482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2305/4581] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:09:38 2022] PATCH /identity/v3/projects/ba31bb6a89c74825999e13e06102c67b => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:39.080114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:39.096201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c70e4-2079-41fe-899c-0f7bbe4158c6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:39.104657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:39.105876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:39.106321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:39.106715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ba31bb6a89c74825999e13e06102c67b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:39.146612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba31bb6a89c74825999e13e06102c67b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:39.156515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:39.156515 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2277/4582] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:09:39 2022] GET /identity/v3/projects/ba31bb6a89c74825999e13e06102c67b => generated 354 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:39.159308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:39.181809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3018c7-1078-4540-b927-86912a06ad9e tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:39.206123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:39.208841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:39.210980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:39.211476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/projects/ba31bb6a89c74825999e13e06102c67b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:39.213792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba31bb6a89c74825999e13e06102c67b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:39.222474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:39.461533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba31bb6a89c74825999e13e06102c67b', 'request_id': 'req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:39.495496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba31bb6a89c74825999e13e06102c67b', 'request_id': 'req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:39.521879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba31bb6a89c74825999e13e06102c67b', 'request_id': 'req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:39.557558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] The token cache is being invalidate because project ba31bb6a89c74825999e13e06102c67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:39.558204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:39.563898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:39.577992 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2306/4583] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:39 2022] DELETE /identity/v3/projects/ba31bb6a89c74825999e13e06102c67b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:39.583045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:39.586975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:39.622253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8e497-927e-4a8b-b57c-27b1dce2bd36 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:39.647509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:39.788765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:39.789686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:39.790209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:39.790497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/74073d7452594b3981e349051e373e1e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:39.825098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Could not find domain: 74073d7452594b3981e349051e373e1e.: keystone.exception.DomainNotFound: Could not find domain: 74073d7452594b3981e349051e373e1e. Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74073d7452594b3981e349051e373e1e. Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:09:39.863839 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:09:39.865824 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 74073d7452594b3981e349051e373e1e. Jun 25 21:09:39.867499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:09:39.868990 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2278/4584] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:09:39 2022] PATCH /identity/v3/domains/74073d7452594b3981e349051e373e1e => generated 112 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:09:39.869541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:39.892265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4cbb-bb9d-4d56-a718-a2dc10ae5c58 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:39.897457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174039ede018444a83e30b59036b68a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b7a000b01014093b3bc406265053b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:39.898306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:39.898600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:39.898897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] PATH_INFO: `/v3/domains/a3b552bb6378409f99bf787769ef3560` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:39.901881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:39.907874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Could not find domain: a3b552bb6378409f99bf787769ef3560.: keystone.exception.DomainNotFound: Could not find domain: a3b552bb6378409f99bf787769ef3560. Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a3b552bb6378409f99bf787769ef3560. Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:09:39.952162 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:09:39.953032 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a3b552bb6378409f99bf787769ef3560. Jun 25 21:09:39.953855 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:09:39.963527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:39.965555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:39.968737 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2307/4585] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:09:39 2022] PATCH /identity/v3/domains/a3b552bb6378409f99bf787769ef3560 => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:09:40.075897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:40.078137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.133710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6459a-12d4-42e5-9321-528f0e61d7b6 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.146526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:40.147590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.147977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.148370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] PATH_INFO: `/v3/users/f668a88a3e974819ab99d5d46edd89bc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.156777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f668a88a3e974819ab99d5d46edd89bc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:40.159812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:40.322474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184765f-a1dc-438f-baa3-a6f9bae9a227 tempest-ProjectsTestJSON-1699246697 tempest-ProjectsTestJSON-1699246697-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.345297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f668a88a3e974819ab99d5d46edd89bc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.354705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:40.357028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.357342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.359808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] PATH_INFO: `/v3/projects/bef145fbccb74031a07d8ee987b3e75e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.366038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef145fbccb74031a07d8ee987b3e75e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:40.374961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:40.397667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f668a88a3e974819ab99d5d46edd89bc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.417071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f668a88a3e974819ab99d5d46edd89bc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.419878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f668a88a3e974819ab99d5d46edd89bc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.421143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-276c9a8f-40e1-4444-a244-5684bd9698c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f668a88a3e974819ab99d5d46edd89bc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.436561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2279/4586] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:39 2022] DELETE /identity/v3/users/f668a88a3e974819ab99d5d46edd89bc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:40.440979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231822-91cc-4938-b824-6be1e200e836 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.441493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231822-91cc-4938-b824-6be1e200e836 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.441928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231822-91cc-4938-b824-6be1e200e836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.477306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97231822-91cc-4938-b824-6be1e200e836 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:40.478730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97231822-91cc-4938-b824-6be1e200e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.512347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef145fbccb74031a07d8ee987b3e75e', 'request_id': 'req-27171662-5672-4f56-bd3d-adb2cdf8b1ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.513283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:40.530935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef145fbccb74031a07d8ee987b3e75e', 'request_id': 'req-27171662-5672-4f56-bd3d-adb2cdf8b1ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.540950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef145fbccb74031a07d8ee987b3e75e', 'request_id': 'req-27171662-5672-4f56-bd3d-adb2cdf8b1ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.563598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] The token cache is being invalidate because project bef145fbccb74031a07d8ee987b3e75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:40.565375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.566444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27171662-5672-4f56-bd3d-adb2cdf8b1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:40.570774 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2308/4587] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:40 2022] DELETE /identity/v3/projects/bef145fbccb74031a07d8ee987b3e75e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:40.575398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f722f-344a-41f1-9f3f-817c99656c25 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.575693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f722f-344a-41f1-9f3f-817c99656c25 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.575982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f722f-344a-41f1-9f3f-817c99656c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.589193 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2280/4588] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:40.590614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231822-91cc-4938-b824-6be1e200e836 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:40.596457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97231822-91cc-4938-b824-6be1e200e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.623418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b24f722f-344a-41f1-9f3f-817c99656c25 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:40.624719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b24f722f-344a-41f1-9f3f-817c99656c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.641029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2309/4589] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:40.649145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.649575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.649962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.712693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:40.714305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.737701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2310/4590] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:40.738748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:40.742000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.761292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231822-91cc-4938-b824-6be1e200e836 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.773274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:40.774339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.774623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.775247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.780874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:40.879200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:40.884248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:40.897847 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2281/4591] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:40.898801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:40.921884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2e68-def6-47d4-b742-104c77030c62 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.942480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8733-e1c0-4a99-aae1-7b3edb69f7e8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.944077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:40.944870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.945279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.945575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.946314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:40.946625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:40.951607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:40.957483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:40.957483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:40.957483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:40.958775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:40.965994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2282/4592] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:40.971142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:40.984683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:40.986662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:40.991602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460c00-d910-4ed1-aa8b-fe5e8c080e6e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:40.999354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:41.000502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.000944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.001230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.002497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:41.004873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:41.008077 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2311/4593] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:41.075620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:41.089414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2283/4594] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:40 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:41.091961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f19be-b828-4e55-8a8f-2b1a0fe0a92a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:41.133326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:41.282458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:41.284956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.285762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.286453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.287444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:41.290703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:41.345364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2312/4595] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:41 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:41.350206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:41.382282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67703-183f-4e5a-8920-e329c5901e55 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:41.439040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:41.440116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.440670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.441260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.442031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:41.443844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:41.455313 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2284/4596] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:41.459111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:41.474462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a1336-e287-4256-8534-7c73bb9d9dd3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:41.481895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:41.483312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.483782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.484645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.485946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:41.487986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852976d-4bec-4543-96ae-fab360af0f2f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:41.505427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2313/4597] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:41.509456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:41.534962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94453e13-f94a-42b8-80c6-b4f77b73e483 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:41.565733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:41.567306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.567973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.569355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] PATH_INFO: `/v3/projects/a5b521724c3d49069bb1aa8c2428b75c/users/6bcfb45bd9404205aefe7d1d2b33cd25/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.657346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b521724c3d49069bb1aa8c2428b75c, user_id=6bcfb45bd9404205aefe7d1d2b33cd25, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:41.664275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:41.692658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2285/4598] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:41 2022] PUT /identity/v3/projects/a5b521724c3d49069bb1aa8c2428b75c/users/6bcfb45bd9404205aefe7d1d2b33cd25/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:41.698151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:41.698683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:41.698963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:41.733042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:41.738411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:41.895703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2314/4599] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:41.926892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:41.929955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:42.016068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:42.149398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559e491-d406-47e3-92f1-6a1b9accb952 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:42.157827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:42.158722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:42.160867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:42.161285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:42.186943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:42.188599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:42.214385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2286/4600] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:42.301783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:42.303316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:42.463471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9d09-95ea-49c2-990b-ad862058d3d5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:42.514898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:42.515587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:42.515870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:42.516146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:42.524732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:42.547729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:42.549417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:42.564705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2315/4601] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:42.928372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:42.951390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449f86-8bd2-4f17-a0d2-37734797b4a9 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:42.966901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:42.968025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:42.968564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:42.969069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:42.977473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:43.007745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:43.009907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b1ed3-f999-4eaf-ad48-5caf409672a6 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:43.028458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2287/4602] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:44.302811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:44.304234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:44.331325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b048b6-79fe-4849-9c53-63d19a460af6 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:44.343516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:44.344630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:44.344911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:44.345190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] PATH_INFO: `/v3/users/ba111f294d66480cbdbe17c8fc7ad0f4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:44.349749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba111f294d66480cbdbe17c8fc7ad0f4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:44.351751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:44.396392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:44.457347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba111f294d66480cbdbe17c8fc7ad0f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.458960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba111f294d66480cbdbe17c8fc7ad0f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.474322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba111f294d66480cbdbe17c8fc7ad0f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.496637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba111f294d66480cbdbe17c8fc7ad0f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.506530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba111f294d66480cbdbe17c8fc7ad0f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.520270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:44.521463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:44.522977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:44.531549 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2316/4603] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:44 2022] DELETE /identity/v3/users/ba111f294d66480cbdbe17c8fc7ad0f4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:44.559598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:44.562199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:44.673195 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2288/4604] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:44.684696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:44.686588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:44.694578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:44.703520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:44.739588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fd595-aba3-4e44-b436-2ddb65e31069 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:44.752093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:44.753375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:44.754053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:44.754758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] PATH_INFO: `/v3/projects/307899f4a594488b9ed018ed9baa0a34` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:44.758405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=307899f4a594488b9ed018ed9baa0a34)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:44.763160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:44.839889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939236b3-1570-4789-850a-fbe167eaae96 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:44.869176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307899f4a594488b9ed018ed9baa0a34', 'request_id': 'req-ca5ba499-24c5-4c11-b60c-363af89ee66a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.892254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307899f4a594488b9ed018ed9baa0a34', 'request_id': 'req-ca5ba499-24c5-4c11-b60c-363af89ee66a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.899771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307899f4a594488b9ed018ed9baa0a34', 'request_id': 'req-ca5ba499-24c5-4c11-b60c-363af89ee66a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.924438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] The token cache is being invalidate because project 307899f4a594488b9ed018ed9baa0a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:44.925106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.926245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:44.931932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2289/4605] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:44 2022] DELETE /identity/v3/projects/307899f4a594488b9ed018ed9baa0a34 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:44.933903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:44.939582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:44.940801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:44.942035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:44.942699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:44.943170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:44.945857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:45.039955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:45.080336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:45.081990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3972b-4dde-47c7-a803-2f25adeb9fca service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:45.097669 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2317/4606] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:09:45.103303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68339755-2edb-431a-8179-e1ca96c7bbc5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:45.103799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68339755-2edb-431a-8179-e1ca96c7bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:45.104194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68339755-2edb-431a-8179-e1ca96c7bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:45.116696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:45.142338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-68339755-2edb-431a-8179-e1ca96c7bbc5 None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:45.143599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-68339755-2edb-431a-8179-e1ca96c7bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:45.164382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba499-24c5-4c11-b60c-363af89ee66a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:45.178494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:45.180626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:45.180839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:45.181715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] PATH_INFO: `/v3/users/174039ede018444a83e30b59036b68a7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:45.185701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174039ede018444a83e30b59036b68a7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:45.189653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:45.268271 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2318/4607] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:45.277975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174039ede018444a83e30b59036b68a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:45.296566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174039ede018444a83e30b59036b68a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:45.318979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174039ede018444a83e30b59036b68a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:45.320275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174039ede018444a83e30b59036b68a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:45.321095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174039ede018444a83e30b59036b68a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:45.359496 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2290/4608] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:44 2022] DELETE /identity/v3/users/174039ede018444a83e30b59036b68a7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:45.967467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:45.968410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:45.969524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:46.056373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] MFA Rules not processed for user `6412ea72fc614168a6498d20e6a26f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:46.063852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:46.099733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:46.102788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:46.286205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e3f2-eb9a-4268-88d6-fef32dcee294 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:46.300244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:46.301411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:46.301676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:46.301955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] PATH_INFO: `/v3/projects/6c2db543e1f6498ca352cb4c10f97407` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:46.304578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2db543e1f6498ca352cb4c10f97407)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:46.306537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:46.339166 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2319/4609] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:46.481417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:46.483077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:46.489574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2db543e1f6498ca352cb4c10f97407', 'request_id': 'req-e3e133fb-db32-4329-b80d-93eee5ed9435'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:46.497760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:46.533166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2db543e1f6498ca352cb4c10f97407', 'request_id': 'req-e3e133fb-db32-4329-b80d-93eee5ed9435'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:46.545186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2db543e1f6498ca352cb4c10f97407', 'request_id': 'req-e3e133fb-db32-4329-b80d-93eee5ed9435'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:46.577681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] The token cache is being invalidate because project 6c2db543e1f6498ca352cb4c10f97407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:46.579456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:46.580187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3e133fb-db32-4329-b80d-93eee5ed9435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:46.584934 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2291/4610] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:46 2022] DELETE /identity/v3/projects/6c2db543e1f6498ca352cb4c10f97407 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:46.587090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:46.587386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:46.591689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:46.637654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:46.639939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:46.782484 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2292/4611] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:46.790165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:46.792289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:46.849181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8663-f7a5-4b4a-ae1e-fe75ebf068e3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:46.957659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:46.998166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7d9ea-2905-4b0c-9c4b-84f67c76fdcb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:47.012220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:47.015105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.015858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.017497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] PATH_INFO: `/v3/users/7753c2b161e342ef8f9e1232229d87a7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.019658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7753c2b161e342ef8f9e1232229d87a7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:47.025294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:47.043736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:47.044693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.045075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.046352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.050720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:47.168129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:47.170540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:47.175695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7753c2b161e342ef8f9e1232229d87a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.182696 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2320/4612] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:09:47.183692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:47.186271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:47.204846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7753c2b161e342ef8f9e1232229d87a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.211660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb56a8-c02e-4ccf-9b67-a7f70b1804b1 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:47.218113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:47.219350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.219736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.220116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] PATH_INFO: `/v3/projects/8b7a000b01014093b3bc406265053b60` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.222538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7a000b01014093b3bc406265053b60)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:47.224723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:47.236458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7753c2b161e342ef8f9e1232229d87a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.240227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7753c2b161e342ef8f9e1232229d87a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.245414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e762c94b-c04e-49c7-a70c-1b613de26853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7753c2b161e342ef8f9e1232229d87a7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.294928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2293/4613] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:46 2022] DELETE /identity/v3/users/7753c2b161e342ef8f9e1232229d87a7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:47.326725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7a000b01014093b3bc406265053b60', 'request_id': 'req-988fe94f-9313-45c5-9e39-75ef81904606'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.361847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7a000b01014093b3bc406265053b60', 'request_id': 'req-988fe94f-9313-45c5-9e39-75ef81904606'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.373705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7a000b01014093b3bc406265053b60', 'request_id': 'req-988fe94f-9313-45c5-9e39-75ef81904606'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.393307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] The token cache is being invalidate because project 8b7a000b01014093b3bc406265053b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:47.395432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.396504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-988fe94f-9313-45c5-9e39-75ef81904606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:47.398518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2321/4614] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:47 2022] DELETE /identity/v3/projects/8b7a000b01014093b3bc406265053b60 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:47.408304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.408651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.408942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.422210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:47.486928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:47.486928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:47.765770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2294/4615] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:47.772944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.773238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.773582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.812293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:47.814578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:47.841335 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2322/4616] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:47.845683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:47.861209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0b1dd-6bd0-468d-a2e3-2a56c09e0ec3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:47.868850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:47.869793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.871598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.872117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.873302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:47.873840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:47.876312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:47.892169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2295/4617] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:47.896276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:47.910640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7e75-6125-42fb-bbb4-cb1af75fcd15 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:47.916120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:47.917688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:47.917688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:47.917688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:47.924901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:47.927759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:47.976108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:47.976462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2323/4618] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:47 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:48.002399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2a9af-5228-4047-ad7e-610e7ea11f31 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:48.249160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:48.249859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:48.250286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:48.250574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:48.251281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:48.256761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:48.304045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2296/4619] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:47 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:48.305766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:48.323204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398b78-dd10-4da7-8d6d-5b564629ea39 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:48.338953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:48.340549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:48.340985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:48.341405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:48.342281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:48.349121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:48.375200 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2324/4620] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:48.377750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:48.397385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532f96a-8f43-4ff0-9d62-ec6267910f58 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:48.408215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:48.410692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:48.410989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:48.411272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:48.413842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:48.418309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c906-5c6e-4694-80a6-f5085b3f00af admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:48.446323 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2297/4621] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:48.448150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:48.464388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72a5cb-7b07-435e-9d4e-af1abd27ba6f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:48.485916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:48.490182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:48.491977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:48.493253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] PATH_INFO: `/v3/projects/2232183d17d14517bf0fa67fe68ff976/users/99a4efb5b1cd4619a978251a76c6e4a3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:48.524450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:48.538913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2232183d17d14517bf0fa67fe68ff976, user_id=99a4efb5b1cd4619a978251a76c6e4a3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:48.547162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:48.581484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2325/4622] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:48 2022] PUT /identity/v3/projects/2232183d17d14517bf0fa67fe68ff976/users/99a4efb5b1cd4619a978251a76c6e4a3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:48.594291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:48.594638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:48.594994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:48.690636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] MFA Rules not processed for user `99a4efb5b1cd4619a978251a76c6e4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:48.692455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:48.889651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:48.915390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2298/4623] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:48.916692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:49.110324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f365c6-3a2d-4048-b911-cf91c1be19f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:49.132844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:49.137940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:49.138449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:49.138942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:49.140266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:49.161919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:49.299968 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2326/4624] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:48 2022] POST /identity/v3/projects => generated 369 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:49.301343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:49.330685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14422a-5d42-4dd2-bd49-b794f3f027ae None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:49.455817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:49.475043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:49.475666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:49.494547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:49.500678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:49.533522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:49.587103 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2299/4625] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:49 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:49.588825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:49.606384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab18f-2843-4e64-bdce-4c5401758efd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:49.623261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:49.624350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:49.624669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:49.624945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:49.625967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:49.631061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:49.660993 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2327/4626] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:09:49.662515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:49.679324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e987-62c8-4217-becb-c57294955c11 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:49.694680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:49.695648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:49.696108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:49.698210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] PATH_INFO: `/v3/projects/7f80107395cb4053aeee3a3f99bc4695/users/ea008362cd684301acbdfe11e6717801/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:49.745645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f80107395cb4053aeee3a3f99bc4695, user_id=ea008362cd684301acbdfe11e6717801, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:49.749891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:49.795240 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2300/4627] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:49 2022] PUT /identity/v3/projects/7f80107395cb4053aeee3a3f99bc4695/users/ea008362cd684301acbdfe11e6717801/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:49.796696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:49.840831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6678-0065-443e-84d6-84b1bebfcb42 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:49.973325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:49.974137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:49.975183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:49.975183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:49.975648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:49.977986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854613d-72c1-48d9-8910-14507c614c24 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:49.997720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:50.000163 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2328/4628] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:50.014338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1ecb-479b-4781-97ce-bc0927e3ca48 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:50.039635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:50.040793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.041331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.041755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] PATH_INFO: `/v3/projects/7f80107395cb4053aeee3a3f99bc4695/users/ea008362cd684301acbdfe11e6717801/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.047766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f80107395cb4053aeee3a3f99bc4695, user_id=ea008362cd684301acbdfe11e6717801, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:50.050736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:50.097813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22138da-3828-4592-8520-560ee8638718 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.098983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22138da-3828-4592-8520-560ee8638718 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.099489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22138da-3828-4592-8520-560ee8638718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.101123 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2301/4629] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:49 2022] PUT /identity/v3/projects/7f80107395cb4053aeee3a3f99bc4695/users/ea008362cd684301acbdfe11e6717801/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:50.146501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c22138da-3828-4592-8520-560ee8638718 None None] MFA Rules not processed for user `ea008362cd684301acbdfe11e6717801`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:50.149872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c22138da-3828-4592-8520-560ee8638718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:50.286739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:50.355764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2329/4630] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:50.360853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:50.387617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b6c95-98da-4c47-b8f1-81d85582f0fb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:50.419086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:50.419927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.420398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.420784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.426705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:50.428884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:50.492051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22138da-3828-4592-8520-560ee8638718 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:50.496713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2302/4631] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:09:50 2022] POST /identity/v3/projects => generated 329 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:50.510489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22138da-3828-4592-8520-560ee8638718 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:50.732865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:50.734587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.735255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.735752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.736921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:50.740221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:50.790904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:50.802248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2330/4632] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:50 2022] POST /identity/v3/users => generated 416 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:50.837200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24f30-3317-41cf-958d-33e3cf750469 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:50.877450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:50.878503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.879011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.879553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.880555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:50.884077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:50.919089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2303/4633] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:09:50 2022] POST /identity/v3/roles => generated 244 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:50.922863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:50.939805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd093d-7dbd-47b2-b958-e2ba0a2ce4a8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:50.951724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:50.952406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:50.954173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:50.954621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:50.955400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:50.959335 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:50.959335 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:50.959335 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:50.960348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:51.025751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2331/4634] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:09:50 2022] POST /identity/v3/roles => generated 247 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:51.030403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:51.052343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75090a5-e0f4-41c6-9d1d-7873f4aae198 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:51.083491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:51.083491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:51.083491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:51.083903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/d383d8a1a5a54a989d0a73610e5c7749/users/9cecdf1817814018b6504de5d51af44b/roles/1443b5b441044003b6f6033c94c4f682` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:51.140112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d383d8a1a5a54a989d0a73610e5c7749, user_id=9cecdf1817814018b6504de5d51af44b, role_id=1443b5b441044003b6f6033c94c4f682)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:51.149620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:51.192093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:51.192808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2304/4635] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:51 2022] PUT /identity/v3/projects/d383d8a1a5a54a989d0a73610e5c7749/users/9cecdf1817814018b6504de5d51af44b/roles/1443b5b441044003b6f6033c94c4f682 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:51.209705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888df25-4bf1-474a-a26d-7037d28a1e26 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:51.401020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:51.403491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:51.404396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:51.405385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/d383d8a1a5a54a989d0a73610e5c7749/users/9cecdf1817814018b6504de5d51af44b/roles/e8184f86a5554f51bf47a2a194dd110a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:51.413054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d383d8a1a5a54a989d0a73610e5c7749, user_id=9cecdf1817814018b6504de5d51af44b, role_id=e8184f86a5554f51bf47a2a194dd110a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:51.422532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:51.463970 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2332/4636] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:51 2022] PUT /identity/v3/projects/d383d8a1a5a54a989d0a73610e5c7749/users/9cecdf1817814018b6504de5d51af44b/roles/e8184f86a5554f51bf47a2a194dd110a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:51.464974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:51.480042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8881-2f1f-47aa-9d0d-40d8f01b5f88 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:51.639172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:51.641795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:51.674338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:51.696904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:51.697285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:51.697574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:51.697877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:51.702076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:51.713691 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:51.713691 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:51.713691 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:51.716346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76b9b5-bfd8-4f3e-982a-62a59f512b96 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:51.917591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2305/4637] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:51 2022] GET /identity/v3/users => generated 8932 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:51.919160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191a87-3bf5-495a-8b3d-d0782ca55b95 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:51.919454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191a87-3bf5-495a-8b3d-d0782ca55b95 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:51.919747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191a87-3bf5-495a-8b3d-d0782ca55b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:52.012557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:52.036472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3303de-6789-4d1c-bcc3-4bc411172567 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:52.063594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:52.064555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:52.064839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:52.065118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] PATH_INFO: `/v3/projects/314b97f50c064672baac673f2c9a6ee0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:52.077610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=314b97f50c064672baac673f2c9a6ee0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:52.079372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:52.089341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-69191a87-3bf5-495a-8b3d-d0782ca55b95 None None] MFA Rules not processed for user `9cecdf1817814018b6504de5d51af44b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:52.090616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-69191a87-3bf5-495a-8b3d-d0782ca55b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:52.340787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314b97f50c064672baac673f2c9a6ee0', 'request_id': 'req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.365477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314b97f50c064672baac673f2c9a6ee0', 'request_id': 'req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.380241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314b97f50c064672baac673f2c9a6ee0', 'request_id': 'req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.445659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] The token cache is being invalidate because project 314b97f50c064672baac673f2c9a6ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:52.445998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.448451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.450817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2333/4638] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:51 2022] DELETE /identity/v3/projects/314b97f50c064672baac673f2c9a6ee0 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:52.455556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:52.458117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:52.531610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2306/4639] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 613 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:52.541946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:52.542970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:52.543446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:52.620982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] MFA Rules not processed for user `9cecdf1817814018b6504de5d51af44b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:52.625373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:52.679808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9d5a-23f8-44d3-9bf4-e69a687ad89b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:52.695531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:52.696978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:52.699777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:52.700300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] PATH_INFO: `/v3/users/adf6aa90e6774838affb5ecf8f6d14eb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:52.702162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf6aa90e6774838affb5ecf8f6d14eb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:52.706522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:52.789034 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2307/4640] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:09:52.791344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:52.815190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03a855-7077-4b2c-bcfe-5525ae32894e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:52.842928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cecdf1817814018b6504de5d51af44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd383d8a1a5a54a989d0a73610e5c7749', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1289570030', 'tempest-NotDelegatedRole-1737010779'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:52.845150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf6aa90e6774838affb5ecf8f6d14eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.845939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:52.846441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:52.847423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf6aa90e6774838affb5ecf8f6d14eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.848462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:52.850336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: Authorizing `identity:create_trust()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:52.857526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:52.875284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf6aa90e6774838affb5ecf8f6d14eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.919045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf6aa90e6774838affb5ecf8f6d14eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.940399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf6aa90e6774838affb5ecf8f6d14eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:52.960147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2334/4641] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:52 2022] DELETE /identity/v3/users/adf6aa90e6774838affb5ecf8f6d14eb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:53.136871 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2308/4642] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:09:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:53.140748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:53.142216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:53.150795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:53.302810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be6717-8283-4215-a020-0425ce503a60 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:53.318646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:53.319341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:53.319630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:53.319911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:53.320661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:53.321763 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:53.321763 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:09:53.321763 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:09:53.322673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:53.340138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2335/4643] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 21:09:53 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:53.343941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:53.351377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:53.372972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:53.382708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408fe7-f5fe-4c83-8e50-e9c8c8235b18 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:53.523636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cecdf1817814018b6504de5d51af44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd383d8a1a5a54a989d0a73610e5c7749', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1289570030', 'tempest-NotDelegatedRole-1737010779'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:53.524705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:53.525080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:53.525452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] PATH_INFO: `/v3/OS-TRUST/trusts/7e955c8090b044e19e54e24d62949a92` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:53.557148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: Authorizing `identity:delete_trust(trust_id=7e955c8090b044e19e54e24d62949a92)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:53.559001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:53.627322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e955c8090b044e19e54e24d62949a92', 'request_id': 'req-afba655d-b3c8-4267-b915-dfb86106d361'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:53.628341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e955c8090b044e19e54e24d62949a92', 'request_id': 'req-afba655d-b3c8-4267-b915-dfb86106d361'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:53.629609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7e955c8090b044e19e54e24d62949a92', 'request_id': 'req-afba655d-b3c8-4267-b915-dfb86106d361'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:53.677795 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2309/4644] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:09:53 2022] DELETE /identity/v3/OS-TRUST/trusts/7e955c8090b044e19e54e24d62949a92 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:53.681630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:53.683875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:53.717761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceea9-9430-4c6e-8bf4-48228d8dfd02 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:53.737574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cecdf1817814018b6504de5d51af44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd383d8a1a5a54a989d0a73610e5c7749', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1289570030', 'tempest-NotDelegatedRole-1737010779'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:53.738952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:53.743697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:53.744797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] PATH_INFO: `/v3/OS-TRUST/trusts/7e955c8090b044e19e54e24d62949a92` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Could not find trust: 7e955c8090b044e19e54e24d62949a92.: keystone.exception.TrustNotFound: Could not find trust: 7e955c8090b044e19e54e24d62949a92. Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 25 21:09:53.810620 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7e955c8090b044e19e54e24d62949a92. Jun 25 21:09:53.811597 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:09:53.814522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2336/4645] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:09:53 2022] GET /identity/v3/OS-TRUST/trusts/7e955c8090b044e19e54e24d62949a92 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:09:53.818530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:53.820250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:53.855345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba655d-b3c8-4267-b915-dfb86106d361 tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:53.885362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:53.886770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:53.887251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:53.887739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/e8184f86a5554f51bf47a2a194dd110a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:53.889527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e8184f86a5554f51bf47a2a194dd110a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:53.890815 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:09:53.890815 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:09:53.890815 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:09:53.892065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:54.011186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role e8184f86a5554f51bf47a2a194dd110a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:54.011776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.012873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.018290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2310/4646] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:53 2022] DELETE /identity/v3/roles/e8184f86a5554f51bf47a2a194dd110a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:54.023402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:54.025671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:54.048744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcedcaa-592f-47d6-a65e-18b1ccd44dbd tempest-TrustsV3TestJSON-1463228626 tempest-user-1414547951] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:54.217136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:54.218234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:54.218610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:54.219006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/1443b5b441044003b6f6033c94c4f682` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:54.220662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1443b5b441044003b6f6033c94c4f682)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:54.222487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:54.334446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 1443b5b441044003b6f6033c94c4f682 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:54.335651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.337509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.343242 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2337/4647] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:54 2022] DELETE /identity/v3/roles/1443b5b441044003b6f6033c94c4f682 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:54.347192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:54.364380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce0418-9749-4a19-89ab-9e27827d400b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:54.489535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:54.491959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:54.492818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:54.493379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/9cecdf1817814018b6504de5d51af44b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:54.495223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9cecdf1817814018b6504de5d51af44b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:54.497819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:54.586077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:54.631844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cecdf1817814018b6504de5d51af44b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.666637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cecdf1817814018b6504de5d51af44b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.734062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cecdf1817814018b6504de5d51af44b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.738000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cecdf1817814018b6504de5d51af44b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.741904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cecdf1817814018b6504de5d51af44b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:54.809977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2311/4648] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:54 2022] DELETE /identity/v3/users/9cecdf1817814018b6504de5d51af44b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:54.814995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:54.817645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:54.861924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538e898-1040-4480-9db3-652993228ce5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.033868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.034844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.035153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.035477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/d383d8a1a5a54a989d0a73610e5c7749` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:55.045068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d383d8a1a5a54a989d0a73610e5c7749)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:55.046957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:55.048805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:55.155865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd383d8a1a5a54a989d0a73610e5c7749', 'request_id': 'req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:55.170867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd383d8a1a5a54a989d0a73610e5c7749', 'request_id': 'req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:55.178385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd383d8a1a5a54a989d0a73610e5c7749', 'request_id': 'req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:55.204900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project d383d8a1a5a54a989d0a73610e5c7749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:55.205492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:55.208484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:55.210346 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2338/4649] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:54 2022] DELETE /identity/v3/projects/d383d8a1a5a54a989d0a73610e5c7749 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:09:55.217062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.219116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:55.237477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f4c9-e904-4377-ac4e-e130a8dfd2da tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.391126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.392068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.392617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.393312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:55.407071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:55.409373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:55.478584 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2312/4650] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:09:55 2022] POST /identity/v3/projects => generated 328 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:55.482637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.485210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:55.506333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29ea87-6426-41aa-be7b-cb27e4e1a9ef tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.633053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.634064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.634508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.634932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:55.635807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:55.637918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:55.686597 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2339/4651] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:55 2022] POST /identity/v3/users => generated 416 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:55.690857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.709045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a390f1-0560-451a-9b2b-1dc2c403bea8 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.719280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.719982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.720281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.720785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:55.721547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:55.723270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:55.777458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2313/4652] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:09:55 2022] POST /identity/v3/roles => generated 244 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:55.778391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.795957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dc7f4-0ebc-4c2a-b47f-901d547feab2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.820852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.820852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.820852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.821241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:55.831883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:55.835215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:55.879216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2340/4653] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:09:55 2022] POST /identity/v3/roles => generated 245 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:09:55.882846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.889710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:55.906507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:55.910156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15d6e2-a478-49d7-a376-9880153e590b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:55.937685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:55.941750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:55.942410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:55.942410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/4354af7f25854d84ae188905b6e8b336/users/3682e19659494797ad3a51ad9ce40c9c/roles/e957607ca6d044148a8d584a33f5f950` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.002903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4354af7f25854d84ae188905b6e8b336, user_id=3682e19659494797ad3a51ad9ce40c9c, role_id=e957607ca6d044148a8d584a33f5f950)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:56.006706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:56.040335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2314/4654] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:55 2022] PUT /identity/v3/projects/4354af7f25854d84ae188905b6e8b336/users/3682e19659494797ad3a51ad9ce40c9c/roles/e957607ca6d044148a8d584a33f5f950 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:56.044273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:56.228945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98a51e-81fb-4cf7-b186-5e8631b01c85 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:56.243371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:56.244056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:56.244416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:56.248987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/4354af7f25854d84ae188905b6e8b336/users/3682e19659494797ad3a51ad9ce40c9c/roles/359e29ad4fe34457b7d4aa7601ff5846` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.261217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4354af7f25854d84ae188905b6e8b336, user_id=3682e19659494797ad3a51ad9ce40c9c, role_id=359e29ad4fe34457b7d4aa7601ff5846)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:56.264363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:56.275557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:56.308534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2315/4655] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:56 2022] PUT /identity/v3/projects/4354af7f25854d84ae188905b6e8b336/users/3682e19659494797ad3a51ad9ce40c9c/roles/359e29ad4fe34457b7d4aa7601ff5846 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:56.312335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:56.338616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95e597-ede3-4a94-a6e1-f38371be94f3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:56.369281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:56.514225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:56.519726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:56.520105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:56.526022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] PATH_INFO: `/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.529410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fe86e5bc5e4a8fbe34861960b589fc)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:56.533692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:56.583641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a34a8-ded5-48fb-a320-63a782a5e541 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:56.608092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:56.608852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:56.609141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:56.609436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.610219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:56.612133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f99f1-8009-4a6b-9073-6813e5cab9a0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:56.700366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fe86e5bc5e4a8fbe34861960b589fc', 'request_id': 'req-97b5f81d-1368-481b-bfde-2035f01fa1f2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:56.720947 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2316/4656] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:56 2022] GET /identity/v3/users => generated 8641 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:56.723033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fe86e5bc5e4a8fbe34861960b589fc', 'request_id': 'req-97b5f81d-1368-481b-bfde-2035f01fa1f2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:56.724305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345602-e7fe-4884-a059-2bfd77acdb4a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:56.724990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345602-e7fe-4884-a059-2bfd77acdb4a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:56.725725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345602-e7fe-4884-a059-2bfd77acdb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.745656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fe86e5bc5e4a8fbe34861960b589fc', 'request_id': 'req-97b5f81d-1368-481b-bfde-2035f01fa1f2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:56.791931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] The token cache is being invalidate because project 66fe86e5bc5e4a8fbe34861960b589fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:56.792240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:56.800677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-97b5f81d-1368-481b-bfde-2035f01fa1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:56.829045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-26345602-e7fe-4884-a059-2bfd77acdb4a None None] MFA Rules not processed for user `3682e19659494797ad3a51ad9ce40c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:56.829362 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2341/4657] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:55 2022] DELETE /identity/v3/projects/66fe86e5bc5e4a8fbe34861960b589fc => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:56.830617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-26345602-e7fe-4884-a059-2bfd77acdb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:56.836192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23d11-e770-4218-92e1-59a1f2433eee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:56.836514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23d11-e770-4218-92e1-59a1f2433eee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:56.836797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23d11-e770-4218-92e1-59a1f2433eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:56.910236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-97e23d11-e770-4218-92e1-59a1f2433eee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:56.911175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-97e23d11-e770-4218-92e1-59a1f2433eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:57.047798 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2317/4658] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:57.052238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.055352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.055352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.100615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] MFA Rules not processed for user `bee65f1c37764bdb9985b4e96a97ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:57.103235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:57.146371 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2342/4659] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:57.150977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021186a4-18a9-4089-8282-3fa06acd4407 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.151204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021186a4-18a9-4089-8282-3fa06acd4407 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.151478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021186a4-18a9-4089-8282-3fa06acd4407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.228494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-021186a4-18a9-4089-8282-3fa06acd4407 None None] MFA Rules not processed for user `3682e19659494797ad3a51ad9ce40c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:57.236305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-021186a4-18a9-4089-8282-3fa06acd4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:57.265091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2343/4660] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:57.267043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.267571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.268047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.319260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:57.321021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:57.347538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2344/4661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:57.348910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:57.433904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353a48-ac2b-4409-ba6a-9f966b26ceee None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:57.454824 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2318/4662] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:57.489402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:57.492412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3682e19659494797ad3a51ad9ce40c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4354af7f25854d84ae188905b6e8b336', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-17128951', 'tempest-DelegatedRole-1750977608'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:57.498952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.510028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.516746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.519876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorizing `identity:create_trust()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:57.530440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:57.619199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c15f-4ed0-4862-ac5e-a36d98ab6bc1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:57.631668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:57.632482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.633745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.634130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.635661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:09:57.637402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:57.640834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:57.669691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:57.689594 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2319/4663] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:57.693682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:57.748351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4a2d-8913-4992-8678-1676f4dc3789 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:57.772179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:57.773486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:57.773881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:57.774258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:57.775832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:57.779338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:57.795135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:57.899739 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2345/4664] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:57.904469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:57.913757 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2320/4665] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:57.917422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:57.929176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b212-0623-4d28-abef-ba5977903acd tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.080004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3682e19659494797ad3a51ad9ce40c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4354af7f25854d84ae188905b6e8b336', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-17128951', 'tempest-DelegatedRole-1750977608'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.082143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.085529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.086091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.087044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.098151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.101724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eebe-9f69-48e8-819a-810237de1e72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.117866 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2346/4666] 10.222.0.39 () {58 vars in 1251 bytes} [Sat Jun 25 21:09:57 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=3682e19659494797ad3a51ad9ce40c9c => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:09:58.118486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.135037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.135957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.136248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.136564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.137268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.139758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.184656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0b624-e039-4a60-a79b-0c8e04216260 tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.204862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3682e19659494797ad3a51ad9ce40c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4354af7f25854d84ae188905b6e8b336', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-17128951', 'tempest-DelegatedRole-1750977608'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.205722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.206034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.206319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] PATH_INFO: `/v3/OS-TRUST/trusts/f1b7e1047b0b4cd79fe6cd9fb96bfbff` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.233915 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2321/4667] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:09:57 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:09:58.237875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.244387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorizing `identity:delete_trust(trust_id=f1b7e1047b0b4cd79fe6cd9fb96bfbff)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.246873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.260983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956d16f-2631-4e37-8a2a-559688b5b89b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.282697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.283418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.283697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.283994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.284751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.286468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.331479 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2322/4668] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:58 2022] GET /identity/v3/roles => generated 1891 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:58.334324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.338744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f1b7e1047b0b4cd79fe6cd9fb96bfbff', 'request_id': 'req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:58.343207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f1b7e1047b0b4cd79fe6cd9fb96bfbff', 'request_id': 'req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:58.344505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f1b7e1047b0b4cd79fe6cd9fb96bfbff', 'request_id': 'req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:58.367899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe39ad-799d-462c-a487-4e52809fef3b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.394378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2347/4669] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:09:58 2022] DELETE /identity/v3/OS-TRUST/trusts/f1b7e1047b0b4cd79fe6cd9fb96bfbff => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:58.399293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.405539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.406257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.406653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.406813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.407295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:58.407565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.409251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.436513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24235c0-8ce9-4943-b95f-07fdd4a4b33a tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.451571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3682e19659494797ad3a51ad9ce40c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4354af7f25854d84ae188905b6e8b336', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-17128951', 'tempest-DelegatedRole-1750977608'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.452946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.453389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.453818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] PATH_INFO: `/v3/OS-TRUST/trusts/f1b7e1047b0b4cd79fe6cd9fb96bfbff` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.481283 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2323/4670] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:09:58 2022] GET /identity/v3/roles => generated 1891 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:09:58.494550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.496941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Could not find trust: f1b7e1047b0b4cd79fe6cd9fb96bfbff.: keystone.exception.TrustNotFound: Could not find trust: f1b7e1047b0b4cd79fe6cd9fb96bfbff. Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 25 21:09:58.504852 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f1b7e1047b0b4cd79fe6cd9fb96bfbff. Jun 25 21:09:58.506092 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:09:58.509360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2348/4671] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:09:58 2022] GET /identity/v3/OS-TRUST/trusts/f1b7e1047b0b4cd79fe6cd9fb96bfbff => generated 111 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:09:58.515222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:58.525331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:58.537166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f1b5-f8d3-448f-b7a8-c2fb2335798e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.610719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.614447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.616544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.617057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] PATH_INFO: `/v3/projects/dc2d0a5c55aa4b37a53cb0fdf6c6ea45/users/3eb2928f8d734e61b71ae17ea712ac3d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.678335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2d0a5c55aa4b37a53cb0fdf6c6ea45, user_id=3eb2928f8d734e61b71ae17ea712ac3d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.686654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6a617-5151-422a-821d-9dd65ca28c5e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:58.730279 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2324/4672] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:09:58 2022] PUT /identity/v3/projects/dc2d0a5c55aa4b37a53cb0fdf6c6ea45/users/3eb2928f8d734e61b71ae17ea712ac3d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:58.755593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.763479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.765537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.767715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7330-1e1f-4ae4-85e5-b805bc20b2bb tempest-TrustsV3TestJSON-341541199 tempest-user-1415969141] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:58.805600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:58.903704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:58.904541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:58.904852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:58.905090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/359e29ad4fe34457b7d4aa7601ff5846` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:58.906706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:09:58.913316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=359e29ad4fe34457b7d4aa7601ff5846)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:58.914773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:58.922002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:59.026684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 359e29ad4fe34457b7d4aa7601ff5846 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:59.026992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.028453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.036491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2349/4673] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:58 2022] DELETE /identity/v3/roles/359e29ad4fe34457b7d4aa7601ff5846 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:59.041865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:59.045909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:59.077614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2325/4674] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:09:59.142990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:59.144790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:59.166573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626f7b-8709-4cab-9f0f-48662bd5710f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:59.174203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:59.175205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:59.175532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:59.177293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/e957607ca6d044148a8d584a33f5f950` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:59.179196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e957607ca6d044148a8d584a33f5f950)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:59.184510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:59.222418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:59.265012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b753364-efba-4cea-9f99-0e0aeb7e2e42 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:59.293098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role e957607ca6d044148a8d584a33f5f950 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:09:59.293399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.296949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.303170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2350/4675] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:59 2022] DELETE /identity/v3/roles/e957607ca6d044148a8d584a33f5f950 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:59.316493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:59.317303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:59.376184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:59.377006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:59.377301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:59.377581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:59.380733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:09:59.449426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:59.495292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2277c6-7f28-43d1-8efc-7119c76314ce tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:59.509723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:59.513581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:59.514069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:59.515359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/3682e19659494797ad3a51ad9ce40c9c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:59.518536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3682e19659494797ad3a51ad9ce40c9c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:59.524397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:59.550330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:59.552929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:09:59.583609 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2326/4676] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:59.615741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3682e19659494797ad3a51ad9ce40c9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.617177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3682e19659494797ad3a51ad9ce40c9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.636072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3682e19659494797ad3a51ad9ce40c9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.680332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3682e19659494797ad3a51ad9ce40c9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.690608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3682e19659494797ad3a51ad9ce40c9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:09:59.703108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2351/4677] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:09:59 2022] DELETE /identity/v3/users/3682e19659494797ad3a51ad9ce40c9c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:09:59.707135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:09:59.732942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c9b8f-25e6-4a13-af3a-71f49970f05a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:09:59.898402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:09:59.899663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:09:59.899798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:09:59.900100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/4354af7f25854d84ae188905b6e8b336` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:09:59.906646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4354af7f25854d84ae188905b6e8b336)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:09:59.949522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.064509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:00.083743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4354af7f25854d84ae188905b6e8b336', 'request_id': 'req-d8328071-ea95-47c7-8aaa-ad491ba9a147'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:00.101274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4354af7f25854d84ae188905b6e8b336', 'request_id': 'req-d8328071-ea95-47c7-8aaa-ad491ba9a147'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:00.114025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4354af7f25854d84ae188905b6e8b336', 'request_id': 'req-d8328071-ea95-47c7-8aaa-ad491ba9a147'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:00.137460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project 4354af7f25854d84ae188905b6e8b336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:00.138076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:00.138964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:00.141183 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2327/4678] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:09:59 2022] DELETE /identity/v3/projects/4354af7f25854d84ae188905b6e8b336 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:00.148922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.150982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:00.172924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934287-ab2d-430c-ab8d-20328a89a4ae tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:00.289636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:00.290746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:00.291368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:00.291820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:00.294852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:00.297218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.343170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2352/4679] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:10:00 2022] POST /identity/v3/projects => generated 329 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:00.346950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.351679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:00.370314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328071-ea95-47c7-8aaa-ad491ba9a147 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:00.558180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:00.559021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:00.559313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:00.561807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:00.563045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:00.566585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.636646 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2328/4680] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:00 2022] POST /identity/v3/users => generated 413 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:00.637681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.666499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6582-f469-4908-849b-cc84fb25c7f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:00.685507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:00.686367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:00.686729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:00.688818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:00.689788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:00.695985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.729222 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2353/4681] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:00 2022] POST /identity/v3/roles => generated 244 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:00.732892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.753269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d6315-7502-4d05-ab8b-c09fe6e529fc tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:00.761657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:00.762521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:00.762927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:00.763225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:00.765052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:00.768459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.797524 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2329/4682] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:00 2022] POST /identity/v3/roles => generated 246 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:00.798838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.813357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112b38-670f-4be9-89a1-8cefe453ed11 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:00.819653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:00.821351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:00.821647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:00.822046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989/users/98b294e49d794cb4bf177bafc29c8b0a/roles/7ac5be3b830044cc83eb786aaffebcb6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:00.847253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ca4b870d20b4dd7ae6295ba1ec0b989, user_id=98b294e49d794cb4bf177bafc29c8b0a, role_id=7ac5be3b830044cc83eb786aaffebcb6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:00.863675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:00.894244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:00.895607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2354/4683] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:00 2022] PUT /identity/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989/users/98b294e49d794cb4bf177bafc29c8b0a/roles/7ac5be3b830044cc83eb786aaffebcb6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:00.916021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b681893-129a-4c49-9d4d-88a1357b8c8e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:01.057393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:01.058548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.060832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.062283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989/users/98b294e49d794cb4bf177bafc29c8b0a/roles/87010ef3d78a44d3ac1aee3186033816` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.067593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ca4b870d20b4dd7ae6295ba1ec0b989, user_id=98b294e49d794cb4bf177bafc29c8b0a, role_id=87010ef3d78a44d3ac1aee3186033816)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:01.071128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93b33-3fcc-4a4a-b204-239d95ca801f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:01.098990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:01.099847 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2330/4684] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:00 2022] PUT /identity/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989/users/98b294e49d794cb4bf177bafc29c8b0a/roles/87010ef3d78a44d3ac1aee3186033816 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:01.112797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77800c-cccc-488c-a092-7351fbc355eb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:01.135947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:01.201672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:01.202678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.203325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.210197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.211231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:01.212383 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:10:01.212383 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:10:01.212383 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:10:01.214036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7f023-46a9-425a-a498-7bbbe406285d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:01.271562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.272038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.272536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.275631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2355/4685] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:01 2022] GET /identity/v3/users => generated 8915 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:01.337264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] MFA Rules not processed for user `98b294e49d794cb4bf177bafc29c8b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:01.339257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:01.366682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:01.500445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.500861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.501333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.503681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2331/4686] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:01.565626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] MFA Rules not processed for user `98b294e49d794cb4bf177bafc29c8b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:01.567974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:01.613686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2356/4687] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:01.619895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:01.654224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4f0f6-adab-4bfd-a48f-4c97d10c35d8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:01.667844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:01.668417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.668750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.669029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.669781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:create_trust()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:01.671275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:01.813042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2332/4688] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:10:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:01.822565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:01.855948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354914a-c018-402a-ab7c-07be5c208512 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:01.870576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:01.871844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.872145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.872539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.899030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:get_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:01.902932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:01.928972 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2357/4689] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:01 2022] GET /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143 => generated 859 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:01.930943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:01.945412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b2df-6635-4b21-b379-f5c3d01710a3 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:01.952041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:01.953930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:01.954221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:01.955040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:01.977766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:01.979279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.003521 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2333/4690] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:10:01 2022] GET /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:02.006248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.019828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5306b-de75-47dc-908b-b0cf205f0156 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.026055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.030273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.030570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.030899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/7ac5be3b830044cc83eb786aaffebcb6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.047487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:get_role_for_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143, role_id=7ac5be3b830044cc83eb786aaffebcb6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.049482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.071074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2358/4691] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:02 2022] GET /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/7ac5be3b830044cc83eb786aaffebcb6 => generated 244 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:02.074885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.115259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4bb3-ec0d-4c20-b39d-3f40d2a18fdb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.134121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.140525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.141056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.144742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/7ac5be3b830044cc83eb786aaffebcb6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.170723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:get_role_for_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143, role_id=7ac5be3b830044cc83eb786aaffebcb6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.199692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.238470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2334/4692] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:02 2022] HEAD /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/7ac5be3b830044cc83eb786aaffebcb6 => generated 0 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 25 21:10:02.242900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.259593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c73fc-c3aa-4d40-b073-7acfe24cd244 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.279618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.280259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.280459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.281247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/87010ef3d78a44d3ac1aee3186033816` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.302041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:get_role_for_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143, role_id=87010ef3d78a44d3ac1aee3186033816)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.306786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Could not find role: 87010ef3d78a44d3ac1aee3186033816.: keystone.exception.RoleNotFound: Could not find role: 87010ef3d78a44d3ac1aee3186033816. Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:02.352029 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:02.356596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 87010ef3d78a44d3ac1aee3186033816. Jun 25 21:10:02.356596 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:10:02.356596 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2359/4693] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:02 2022] GET /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/87010ef3d78a44d3ac1aee3186033816 => generated 110 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:10:02.356802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.386129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d00e9-8eb7-438a-ac2c-873c6f987ef8 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.397638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.399510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.399803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.400086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/87010ef3d78a44d3ac1aee3186033816` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.413392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:get_role_for_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143, role_id=87010ef3d78a44d3ac1aee3186033816)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.417515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Could not find role: 87010ef3d78a44d3ac1aee3186033816.: keystone.exception.RoleNotFound: Could not find role: 87010ef3d78a44d3ac1aee3186033816. Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:02.438153 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:02.439304 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 87010ef3d78a44d3ac1aee3186033816. Jun 25 21:10:02.439304 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:02.443286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2335/4694] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:02 2022] HEAD /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143/roles/87010ef3d78a44d3ac1aee3186033816 => generated 0 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 25 21:10:02.445507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.460164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c8c2e-8f14-4761-85b9-db6d6302bec7 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.475615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.476801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.477137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.477397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.494559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorizing `identity:delete_trust(trust_id=76ce71be31c541aeabc05fba1aeb6143)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.496277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.536165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '76ce71be31c541aeabc05fba1aeb6143', 'request_id': 'req-d541c132-05eb-4d99-9df8-5498c34c3d7d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:02.537072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '76ce71be31c541aeabc05fba1aeb6143', 'request_id': 'req-d541c132-05eb-4d99-9df8-5498c34c3d7d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:02.537774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '76ce71be31c541aeabc05fba1aeb6143', 'request_id': 'req-d541c132-05eb-4d99-9df8-5498c34c3d7d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:02.579843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2360/4695] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:10:02 2022] DELETE /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:02.584609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.586860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:02.610489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c988b-1af0-46d7-93da-7ad00de020cb tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.621193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b294e49d794cb4bf177bafc29c8b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-757759297', 'tempest-DelegatedRole-1236313276'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.622069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.622356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.622637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] PATH_INFO: `/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Could not find trust: 76ce71be31c541aeabc05fba1aeb6143.: keystone.exception.TrustNotFound: Could not find trust: 76ce71be31c541aeabc05fba1aeb6143. Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 25 21:10:02.652140 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 76ce71be31c541aeabc05fba1aeb6143. Jun 25 21:10:02.653340 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:02.658017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.659002 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2336/4696] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:02 2022] GET /identity/v3/OS-TRUST/trusts/76ce71be31c541aeabc05fba1aeb6143 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:10:02.659643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:02.691800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c132-05eb-4d99-9df8-5498c34c3d7d tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.701913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.702850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.703122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.703403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/87010ef3d78a44d3ac1aee3186033816` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.710640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=87010ef3d78a44d3ac1aee3186033816)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.712310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:02.786368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 87010ef3d78a44d3ac1aee3186033816 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:02.786757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:02.789192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:02.793132 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2361/4697] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:02 2022] DELETE /identity/v3/roles/87010ef3d78a44d3ac1aee3186033816 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:02.796914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:02.801628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:02.839274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15998a-020e-4928-a380-643048213797 tempest-TrustsV3TestJSON-1970764288 tempest-user-915863591] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:02.934980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:02.977100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:02.978194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:02.978485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:02.978772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/7ac5be3b830044cc83eb786aaffebcb6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:02.981873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ac5be3b830044cc83eb786aaffebcb6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:02.984214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:03.060626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 7ac5be3b830044cc83eb786aaffebcb6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:03.060976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.062443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.068194 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2337/4698] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:02 2022] DELETE /identity/v3/roles/7ac5be3b830044cc83eb786aaffebcb6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:03.069749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:03.088637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb633d2-29d9-48b9-86ca-842f7a2f50a6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:03.150896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:03.201358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:03.202846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:03.203341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:03.206790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/98b294e49d794cb4bf177bafc29c8b0a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:03.209679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98b294e49d794cb4bf177bafc29c8b0a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:03.212995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:03.350841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b294e49d794cb4bf177bafc29c8b0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.352097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b294e49d794cb4bf177bafc29c8b0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.377315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b294e49d794cb4bf177bafc29c8b0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.409640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b294e49d794cb4bf177bafc29c8b0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.427411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f2c2add4-38e5-463a-b29a-fbee8fb013a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b294e49d794cb4bf177bafc29c8b0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.437540 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2362/4699] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:03 2022] DELETE /identity/v3/users/98b294e49d794cb4bf177bafc29c8b0a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:03.443998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:03.447776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:03.472816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814369-d498-4353-8b0c-208ad534b718 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:03.577639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:03.579091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:03.579365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:03.579653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:03.581092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ca4b870d20b4dd7ae6295ba1ec0b989)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:03.584436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:03.640117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:03.642366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:03.642770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:03.709520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] MFA Rules not processed for user `6bcfb45bd9404205aefe7d1d2b33cd25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:03.710949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:03.752133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'request_id': 'req-47e55820-2b17-4b2d-a02a-c32998560715'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.773826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'request_id': 'req-47e55820-2b17-4b2d-a02a-c32998560715'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.794371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca4b870d20b4dd7ae6295ba1ec0b989', 'request_id': 'req-47e55820-2b17-4b2d-a02a-c32998560715'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.815832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project 3ca4b870d20b4dd7ae6295ba1ec0b989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:03.816098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.816835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-47e55820-2b17-4b2d-a02a-c32998560715 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:03.823303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2338/4700] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:03 2022] DELETE /identity/v3/projects/3ca4b870d20b4dd7ae6295ba1ec0b989 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:03.823303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:03.823303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:03.823303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:03.871666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2363/4701] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:03.872676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:03.881212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:03.894421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] MFA Rules not processed for user `3eb2928f8d734e61b71ae17ea712ac3d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:03.896275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:03.936971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74e9a0-9ff5-4fab-bb8d-25451491648d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:03.941580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:04.066967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:04.097171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2339/4702] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:04.098177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.099173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.099667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:04.100101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.100893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.101390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.102438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.105862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.170552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2364/4703] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:10:03 2022] POST /identity/v3/projects => generated 329 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.172646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.177631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:04.272307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74e07-1537-4ab5-b760-a002d99ad331 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.393678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf413-fc5d-420e-b54d-4ed9c8e097c0 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.410253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.411046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.411360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.411636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.413739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:04.430929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.431766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.432051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.432327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.433063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.449156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.532113 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2365/4704] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:04 2022] POST /identity/v3/projects => generated 373 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.533126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.542799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:04.591087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.593525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.621951 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2340/4705] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:04.623013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.632527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:04.647302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d096-86c9-4d82-9bcc-fe0d0acf7ef2 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.690491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395832-61e8-4ae4-88f5-6f23d9c206b2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.700259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.701067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.701826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.701826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.703015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.709131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.764300 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2366/4706] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:04 2022] POST /identity/v3/users => generated 410 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.772662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.803299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e692-0ef3-42b3-b13c-e109c97df3f6 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.826878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744450-5029-4799-801b-30072beda38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.827569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744450-5029-4799-801b-30072beda38a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.827859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744450-5029-4799-801b-30072beda38a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.828228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744450-5029-4799-801b-30072beda38a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.828875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18744450-5029-4799-801b-30072beda38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.829885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.830879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18744450-5029-4799-801b-30072beda38a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.832588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.833508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.834084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.835196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.837533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.866211 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2367/4707] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:04 2022] POST /identity/v3/roles => generated 242 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.874128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.888308 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2341/4708] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:04 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.892166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51554-e100-4c1f-a0b7-bf1f68dbbfc3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.893619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744450-5029-4799-801b-30072beda38a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.902942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.904592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.905560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.905680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744450-5029-4799-801b-30072beda38a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.906163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.907358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.910669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.916818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.917671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.918018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.918262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.918962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:04.920615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:04.938167 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2342/4709] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:04 2022] GET /identity/v3/roles => generated 1653 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:04.942563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.953537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2368/4710] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:04 2022] POST /identity/v3/roles => generated 246 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:04.954618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:04.958605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894b3d-a80c-44b7-88cf-3889c3d51e0e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.970771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.971696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.971981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.972264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] PATH_INFO: `/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d/users/d50e25fc50a14156bdfdcfd9cd65c268/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:04.980008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0addf7-6876-462a-a900-a3735a4e2e38 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:04.995151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:04.996090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:04.996369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:04.996691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/b3d78ed92fe34403b119c984c129e803/users/ea34f3ba99b441a0bf572b43f4927d6b/roles/14d310ec2741461aa54692056b130a46` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.002496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed5fa30ed2940638c504a7b2c3ace6d, user_id=d50e25fc50a14156bdfdcfd9cd65c268, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.014411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.034006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:05.037012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2343/4711] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:04 2022] PUT /identity/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d/users/d50e25fc50a14156bdfdcfd9cd65c268/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:05.042519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:05.046584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3d78ed92fe34403b119c984c129e803, user_id=ea34f3ba99b441a0bf572b43f4927d6b, role_id=14d310ec2741461aa54692056b130a46)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.049437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.095513 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2369/4712] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:04 2022] PUT /identity/v3/projects/b3d78ed92fe34403b119c984c129e803/users/ea34f3ba99b441a0bf572b43f4927d6b/roles/14d310ec2741461aa54692056b130a46 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:05.097117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:05.157112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974327b7-07c9-4384-9338-c8c4b3267edb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:05.247907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:05.248776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.249183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.249578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.250412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.253297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.257055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10c3c-491c-48ca-8d0a-3767f6d382bf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:05.260013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:05.272573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2344/4713] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:05 2022] GET /identity/v3/roles => generated 1890 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:05.274092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:05.281873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:05.285810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.286869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.287927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/b3d78ed92fe34403b119c984c129e803/users/ea34f3ba99b441a0bf572b43f4927d6b/roles/17152e12bf22457abe5d0244118b57fb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.288281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a3546-e9dc-49bd-91d8-6f8bf07784e0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:05.297717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b3d78ed92fe34403b119c984c129e803, user_id=ea34f3ba99b441a0bf572b43f4927d6b, role_id=17152e12bf22457abe5d0244118b57fb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.301991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:05.303164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.303651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.304103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] PATH_INFO: `/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d/users/d50e25fc50a14156bdfdcfd9cd65c268/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.307017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.309867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed5fa30ed2940638c504a7b2c3ace6d, user_id=d50e25fc50a14156bdfdcfd9cd65c268, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.315507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c6ac-b697-4d0e-843d-911043660e42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.343406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2370/4714] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:05 2022] PUT /identity/v3/projects/b3d78ed92fe34403b119c984c129e803/users/ea34f3ba99b441a0bf572b43f4927d6b/roles/17152e12bf22457abe5d0244118b57fb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:05.347582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2345/4715] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:05 2022] PUT /identity/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d/users/d50e25fc50a14156bdfdcfd9cd65c268/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:05.352038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:05.511183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6de3-f667-4c5c-95cb-a9c9c574f842 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:05.519236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:05.520290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.520694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.521350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.522938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:05.525293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d4d4c-cf03-48cf-a086-ba2979fb499d tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:05.578275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2371/4716] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:05 2022] GET /identity/v3/users => generated 9196 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:05.583503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.584067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.584553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.671692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] MFA Rules not processed for user `ea34f3ba99b441a0bf572b43f4927d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:05.674437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:05.915134 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2346/4717] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:05.926458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:05.927306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:05.927306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:05.965625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] MFA Rules not processed for user `ea34f3ba99b441a0bf572b43f4927d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:05.969523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:05.994788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2372/4718] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:06.000120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:06.014815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d458f-bb5f-4b17-803c-9bfd7740609c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:06.029909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea34f3ba99b441a0bf572b43f4927d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3d78ed92fe34403b119c984c129e803', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-276683018', 'tempest-DelegatedRole-25121031'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:06.033440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:06.033814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:06.034497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:06.037540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] RBAC: Authorizing `identity:create_trust()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:06.038786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jun 25 21:10:06.194440 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jun 25 21:10:06.195385 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 25 21:10:06.196515 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:06.202512 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2347/4719] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:10:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 201 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:10:06.203819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:06.227414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0378-5db8-468f-ba60-4c7fc082b6ad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:06.248803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:06.249708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:06.249993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:06.250275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/17152e12bf22457abe5d0244118b57fb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:06.253521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=17152e12bf22457abe5d0244118b57fb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:06.254997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:06.360720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 17152e12bf22457abe5d0244118b57fb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:06.361759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.363689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.367229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2373/4720] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:06 2022] DELETE /identity/v3/roles/17152e12bf22457abe5d0244118b57fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:06.373699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:06.378384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:06.400893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3229b-33c3-4a83-b1c1-0709053a08da tempest-TrustsV3TestJSON-1501552121 tempest-user-57216869] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:06.503066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:06.504183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:06.504541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:06.504840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/14d310ec2741461aa54692056b130a46` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:06.508330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=14d310ec2741461aa54692056b130a46)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:06.510246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:06.539399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:06.606651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 14d310ec2741461aa54692056b130a46 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:06.607238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.608381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.612116 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2348/4721] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:06 2022] DELETE /identity/v3/roles/14d310ec2741461aa54692056b130a46 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:06.616670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:06.630716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81fc1-06e5-4629-9774-2d10268e78db tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:06.670335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:06.712544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:06.713969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:06.714474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:06.714758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/ea34f3ba99b441a0bf572b43f4927d6b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:06.716223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ea34f3ba99b441a0bf572b43f4927d6b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:06.718915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:06.783845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea34f3ba99b441a0bf572b43f4927d6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.784992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea34f3ba99b441a0bf572b43f4927d6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.800124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea34f3ba99b441a0bf572b43f4927d6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.857635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea34f3ba99b441a0bf572b43f4927d6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.880332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea34f3ba99b441a0bf572b43f4927d6b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:06.898183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2374/4722] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:06 2022] DELETE /identity/v3/users/ea34f3ba99b441a0bf572b43f4927d6b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:06.904036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:06.905453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:06.943729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d487d-9c9d-49df-85d9-c3ee6bcae8a3 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:07.148753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:07.149841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:07.151412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:07.152472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/b3d78ed92fe34403b119c984c129e803` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:07.155143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3d78ed92fe34403b119c984c129e803)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:07.158534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:07.294728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d78ed92fe34403b119c984c129e803', 'request_id': 'req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:07.321887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d78ed92fe34403b119c984c129e803', 'request_id': 'req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:07.358782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d78ed92fe34403b119c984c129e803', 'request_id': 'req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:07.397903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project b3d78ed92fe34403b119c984c129e803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:07.398198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:07.398888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:07.402299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2349/4723] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:06 2022] DELETE /identity/v3/projects/b3d78ed92fe34403b119c984c129e803 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:07.408636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:07.413333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:07.452550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a68d-d1ce-496c-9915-39cb7db88549 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:07.555382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:07.556715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:07.557277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:07.557785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:07.558712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:07.561309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:07.597798 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2375/4724] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:10:07 2022] POST /identity/v3/projects => generated 329 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:07.602276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:07.603943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:07.641769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9caef-5ba7-4c4a-887d-c61c1b37cc76 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:07.844691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:07.849769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:07.860370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:07.863382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:07.870464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:07.879746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:07.907747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:07.930365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:07.931819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2350/4725] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:07 2022] POST /identity/v3/users => generated 416 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:07.943618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56d9d-67ae-49e2-8823-58c6374c3304 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:07.950291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:07.951572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:07.952076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:07.952629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:07.953992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:07.956104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:07.990162 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2376/4726] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:07 2022] POST /identity/v3/roles => generated 243 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:07.994097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:08.007067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7270d2-4fe9-4d9e-bdd1-500aece164c5 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:08.012555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:08.013524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.013905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.014284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.015142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:08.017828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:08.046422 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2351/4727] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:07 2022] POST /identity/v3/roles => generated 247 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:08.047166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:08.065477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05448c-4031-448c-9bb6-77d21ee86451 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:08.079927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:08.081043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.081395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.081683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/7e966c5a8ea74039beec868e478b6a8f/users/eb22799d957949c8b013bc265e998df7/roles/fa19d22fe94e4f198c3ad1f6825b58ab` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.137503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7e966c5a8ea74039beec868e478b6a8f, user_id=eb22799d957949c8b013bc265e998df7, role_id=fa19d22fe94e4f198c3ad1f6825b58ab)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:08.140226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:08.171323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:08.191566 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2377/4728] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:08 2022] PUT /identity/v3/projects/7e966c5a8ea74039beec868e478b6a8f/users/eb22799d957949c8b013bc265e998df7/roles/fa19d22fe94e4f198c3ad1f6825b58ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:08.196678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:08.204813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:08.211659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:08.240724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2c6d-aa7d-4b7e-ae34-d93c7a3bc27b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:08.357323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598567bc-70c4-4a4f-a2af-4b4073bb729b tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:08.370226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:08.372592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.373224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.373573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.377828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:08.392858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:08.394139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.395486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.396644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/7e966c5a8ea74039beec868e478b6a8f/users/eb22799d957949c8b013bc265e998df7/roles/55c19d53257a46c2821545789cfc8377` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.404133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7e966c5a8ea74039beec868e478b6a8f, user_id=eb22799d957949c8b013bc265e998df7, role_id=55c19d53257a46c2821545789cfc8377)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:08.412337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513779b-92c6-43cc-9b79-1109fed60beb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:08.446803 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2352/4729] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:08 2022] PUT /identity/v3/projects/7e966c5a8ea74039beec868e478b6a8f/users/eb22799d957949c8b013bc265e998df7/roles/55c19d53257a46c2821545789cfc8377 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:08.451209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdec38-be9f-42bb-82f0-99c14f285a4a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.451604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdec38-be9f-42bb-82f0-99c14f285a4a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.452785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdec38-be9f-42bb-82f0-99c14f285a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.537223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-29cdec38-be9f-42bb-82f0-99c14f285a4a None None] MFA Rules not processed for user `d50e25fc50a14156bdfdcfd9cd65c268`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:08.538740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29cdec38-be9f-42bb-82f0-99c14f285a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:08.580558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:08.584375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:08.604230 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2378/4730] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:10:08.605840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:08.630087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0f15-8ca4-4d58-935a-eb2055cc55d6 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:08.700835 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2353/4731] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:08.714318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51200-c56d-458f-b9ec-c3b3abacddcd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.715444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51200-c56d-458f-b9ec-c3b3abacddcd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.715862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa51200-c56d-458f-b9ec-c3b3abacddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.744877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-faa51200-c56d-458f-b9ec-c3b3abacddcd None None] MFA Rules not processed for user `3eb2928f8d734e61b71ae17ea712ac3d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:08.750986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:08.752718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-faa51200-c56d-458f-b9ec-c3b3abacddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:08.752874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.753172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.755988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.758417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:08.766337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907c65-9900-47a1-9174-1434e73e71ff tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:08.854234 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2379/4732] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:08 2022] GET /identity/v3/users => generated 9202 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:08.861094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:08.861446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:08.861725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:08.900141 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2354/4733] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:08.921401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:08.959443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] MFA Rules not processed for user `eb22799d957949c8b013bc265e998df7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:08.966095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:09.165611 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2380/4734] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:09.178241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.178422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.178708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.196779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:09.209219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] MFA Rules not processed for user `eb22799d957949c8b013bc265e998df7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:09.210460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:09.224416 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2355/4735] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:09.228576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.242694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83bbe-1b96-471e-8aae-4263b7e76fa3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.255987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.256811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.257178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.257928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.258343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:create_trust()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.259784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.407625 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2381/4736] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:10:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:09.409410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.424051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd2e93-4f44-4165-93aa-5bc0febf7c75 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.431883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.433244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.433674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.434039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.443990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:get_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.447090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.464465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2356/4737] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:09 2022] GET /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e => generated 833 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:09.466973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.482125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccc92-36e7-4d95-abee-78eae58c7ae4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.530820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.533476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.534939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.535357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.552128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.553866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9160278-a08d-4215-9973-5bf3400efa5d tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.581273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.583591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:09.585193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2382/4738] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:10:09 2022] GET /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles => generated 370 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:09.588069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.589231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.590392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.619495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] MFA Rules not processed for user `6bcfb45bd9404205aefe7d1d2b33cd25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:09.621213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:09.724959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2383/4739] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:09.726206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.740126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a49be5-dfa2-4407-9a95-c55864fe48f3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.753758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.754724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.755914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.756140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/fa19d22fe94e4f198c3ad1f6825b58ab` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.760387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d7ebd-6eb0-4cbb-ae0d-40c02e9d803a tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.769301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e, role_id=fa19d22fe94e4f198c3ad1f6825b58ab)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.770374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.771980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.773583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.773702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.773806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.775442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:09.776296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:09.788476 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2384/4740] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:09 2022] GET /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/fa19d22fe94e4f198c3ad1f6825b58ab => generated 243 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:09.793205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.802969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.806001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.809707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173fd0a-a4e3-4c87-8aea-8787082446c4 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.816683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.817716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.818001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.818281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/fa19d22fe94e4f198c3ad1f6825b58ab` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.819132 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2357/4741] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:09.826888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e, role_id=fa19d22fe94e4f198c3ad1f6825b58ab)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.828797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.840475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2385/4742] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:09 2022] HEAD /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/fa19d22fe94e4f198c3ad1f6825b58ab => generated 0 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 25 21:10:09.844402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.859830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773652-a1ad-4c77-8691-f737e257e8e0 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.865937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.867249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.867597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.867951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/55c19d53257a46c2821545789cfc8377` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.876566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e, role_id=55c19d53257a46c2821545789cfc8377)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.878116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Could not find role: 55c19d53257a46c2821545789cfc8377.: keystone.exception.RoleNotFound: Could not find role: 55c19d53257a46c2821545789cfc8377. Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:09.895812 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:09.896951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 55c19d53257a46c2821545789cfc8377. Jun 25 21:10:09.896951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:09.909590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2358/4743] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:09 2022] GET /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/55c19d53257a46c2821545789cfc8377 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:10:09.914474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.930039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808e08f-6f26-4c5c-8682-faa43984d8a2 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.935666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.937860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.937860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.938364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/55c19d53257a46c2821545789cfc8377` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.947228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e, role_id=55c19d53257a46c2821545789cfc8377)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.949024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Could not find role: 55c19d53257a46c2821545789cfc8377.: keystone.exception.RoleNotFound: Could not find role: 55c19d53257a46c2821545789cfc8377. Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:09.967073 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:09.968538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 55c19d53257a46c2821545789cfc8377. Jun 25 21:10:09.968538 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:10:09.972753 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2386/4744] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:09 2022] HEAD /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e/roles/55c19d53257a46c2821545789cfc8377 => generated 0 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 25 21:10:09.972927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:09.983895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13aa-7766-46e2-a9fb-e474ac34f6c1 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:09.988597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:09.989521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:09.989775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:09.990080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:09.997424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorizing `identity:delete_trust(trust_id=c36779866ff24eeba9224d5dfef9e40e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:09.999372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:10.024082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c36779866ff24eeba9224d5dfef9e40e', 'request_id': 'req-d97bae40-b619-4eeb-bda3-4699f02a0780'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.025045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c36779866ff24eeba9224d5dfef9e40e', 'request_id': 'req-d97bae40-b619-4eeb-bda3-4699f02a0780'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.026024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c36779866ff24eeba9224d5dfef9e40e', 'request_id': 'req-d97bae40-b619-4eeb-bda3-4699f02a0780'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.047713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2359/4745] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:10:09 2022] DELETE /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:10.052240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.054617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:10.069788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d67df-4f9a-40fe-abdc-98cdfbc669e9 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:10.075506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb22799d957949c8b013bc265e998df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e966c5a8ea74039beec868e478b6a8f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-679836952', 'tempest-NotDelegatedRole-2041114020'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:10.076363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:10.076716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:10.076999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] PATH_INFO: `/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Could not find trust: c36779866ff24eeba9224d5dfef9e40e.: keystone.exception.TrustNotFound: Could not find trust: c36779866ff24eeba9224d5dfef9e40e. Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 25 21:10:10.094255 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c36779866ff24eeba9224d5dfef9e40e. Jun 25 21:10:10.095633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:10:10.099248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2387/4746] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:10 2022] GET /identity/v3/OS-TRUST/trusts/c36779866ff24eeba9224d5dfef9e40e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:10:10.100330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.102245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:10.121750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bae40-b619-4eeb-bda3-4699f02a0780 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:10.131156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:10.132052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:10.132582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:10.132878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/55c19d53257a46c2821545789cfc8377` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:10.135717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55c19d53257a46c2821545789cfc8377)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:10.137351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:10.189730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 55c19d53257a46c2821545789cfc8377 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:10.190033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.190746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.193188 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2360/4747] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:10 2022] DELETE /identity/v3/roles/55c19d53257a46c2821545789cfc8377 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:10.197696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.199834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:10.220781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dac2-3765-4910-a54d-5c45e0bafbc8 tempest-TrustsV3TestJSON-1994438070 tempest-user-1830499186] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:10.290364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:10.291485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:10.291649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:10.292120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/fa19d22fe94e4f198c3ad1f6825b58ab` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:10.293896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fa19d22fe94e4f198c3ad1f6825b58ab)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:10.296252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:10.351100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role fa19d22fe94e4f198c3ad1f6825b58ab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:10.351711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.352880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.356326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2388/4748] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:10 2022] DELETE /identity/v3/roles/fa19d22fe94e4f198c3ad1f6825b58ab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:10.361556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.373460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0037-8ee6-4dc0-84ed-72c669a1d442 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:10.409360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:10.454502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:10.455829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:10.456126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:10.456781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/eb22799d957949c8b013bc265e998df7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:10.458212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb22799d957949c8b013bc265e998df7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:10.460966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:10.525137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb22799d957949c8b013bc265e998df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.535977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb22799d957949c8b013bc265e998df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.552244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb22799d957949c8b013bc265e998df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.553426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb22799d957949c8b013bc265e998df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.554174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb22799d957949c8b013bc265e998df7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.571641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2361/4749] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:10 2022] DELETE /identity/v3/users/eb22799d957949c8b013bc265e998df7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:10.576460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.578535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:10.597345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52087-0435-43a0-9c7f-e5da723aeaa7 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:10.695378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:10.696810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:10.697190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:10.697479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/7e966c5a8ea74039beec868e478b6a8f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:10.699472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e966c5a8ea74039beec868e478b6a8f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:10.702960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:10.747092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:10.830057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e966c5a8ea74039beec868e478b6a8f', 'request_id': 'req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.842729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e966c5a8ea74039beec868e478b6a8f', 'request_id': 'req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.858849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e966c5a8ea74039beec868e478b6a8f', 'request_id': 'req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.877785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project 7e966c5a8ea74039beec868e478b6a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:10.878545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.879970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:10.882767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2389/4750] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:10 2022] DELETE /identity/v3/projects/7e966c5a8ea74039beec868e478b6a8f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:10.889712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:10.892029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:10.909978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506941-07b8-4e5f-805d-2eeea32da7cb tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.104590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.105354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.105663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.105968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.107867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.111179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.175114 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2362/4751] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:10:10 2022] POST /identity/v3/projects => generated 329 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:11.179564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.181019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:11.222915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf088fa1-2a9d-47b3-acb8-213d5b7afebf tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.436673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.437978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.438313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.438598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.440079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.442576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.476021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.476531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2390/4752] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:11 2022] POST /identity/v3/users => generated 410 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:10:11.498627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4852ec-f370-40fd-a007-655889118813 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.517557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.518540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.519006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.519627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.521229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.523091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.566886 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2363/4753] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:11 2022] POST /identity/v3/roles => generated 244 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:10:11.571683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.597787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b73fa-8bea-4e35-baf9-61b0d4d62ab1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.611544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.612396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.613343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.613843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.614835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.617197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.647229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2391/4754] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:10:11 2022] POST /identity/v3/roles => generated 246 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:11.647498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.675177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a18f5-0b76-40cf-b3b3-c7498bae9471 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.686302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.687238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.688132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.688459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/10badd449d9d4fedade4ff7462ed69c1/users/153120ea5c254a359881313d0b22b151/roles/02c9d87616f64f14aeec43c138250d9d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.721922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10badd449d9d4fedade4ff7462ed69c1, user_id=153120ea5c254a359881313d0b22b151, role_id=02c9d87616f64f14aeec43c138250d9d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.729836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.736308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:11.754639 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2364/4755] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:11 2022] PUT /identity/v3/projects/10badd449d9d4fedade4ff7462ed69c1/users/153120ea5c254a359881313d0b22b151/roles/02c9d87616f64f14aeec43c138250d9d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:11.759396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.775818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a53a3-2b76-453c-8de4-9ff147d807f4 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:11.896346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:11.907214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:11.907214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:11.907214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/10badd449d9d4fedade4ff7462ed69c1/users/153120ea5c254a359881313d0b22b151/roles/563bdb4138f640f1b6028389af2e9777` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:11.907214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10badd449d9d4fedade4ff7462ed69c1, user_id=153120ea5c254a359881313d0b22b151, role_id=563bdb4138f640f1b6028389af2e9777)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:11.908112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99589d33-be56-4437-832b-cbf17738a0ea tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:11.935219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2392/4756] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:11 2022] PUT /identity/v3/projects/10badd449d9d4fedade4ff7462ed69c1/users/153120ea5c254a359881313d0b22b151/roles/563bdb4138f640f1b6028389af2e9777 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:11.936772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:11.953266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d547af-91f4-4f47-9bb4-82d5172070f2 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.060168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.060811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.061290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.061815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.063781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.073329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780554f5-fe5c-4b1f-9198-45516a5b2d95 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.127887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.128253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.128453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.132173 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2365/4757] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:11 2022] GET /identity/v3/users => generated 9196 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:12.202009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:12.220320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] MFA Rules not processed for user `153120ea5c254a359881313d0b22b151`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:12.223533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:12.348683 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2393/4758] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:12.357293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.357584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.358212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.378401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] MFA Rules not processed for user `153120ea5c254a359881313d0b22b151`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:12.379732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:12.387756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2366/4759] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:12.392836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.403532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d153c-061a-405a-804b-f1b0e27fbc36 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.409111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.410421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.410421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.410421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.411158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:create_trust()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.412714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.541310 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2394/4760] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:10:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:12.545316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.555829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333e331-396c-4b68-a122-8ab38f40b644 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.560998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.561879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.562123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.562392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.569908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:get_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.572120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.587481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2367/4761] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:12 2022] GET /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d => generated 835 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:12.588129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.600547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537d1d7-28bc-4314-ac95-22788e7f2319 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.605479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.606465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.606849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.607234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.615885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.617789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.626767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2395/4762] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:10:12 2022] GET /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:12.640263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.653012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9ef83-20fc-4f17-b3a9-49b00f8f3789 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.658681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.659961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.660591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.661998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/02c9d87616f64f14aeec43c138250d9d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.672293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d, role_id=02c9d87616f64f14aeec43c138250d9d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.675326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.691276 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2368/4763] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:12 2022] GET /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/02c9d87616f64f14aeec43c138250d9d => generated 244 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:12.692834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.706141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c9f1d-4fe9-4f93-952a-f4fa08fdcb89 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.711584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.713100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.713521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.713902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/02c9d87616f64f14aeec43c138250d9d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.723902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d, role_id=02c9d87616f64f14aeec43c138250d9d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.726052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.739516 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2396/4764] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:12 2022] HEAD /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/02c9d87616f64f14aeec43c138250d9d => generated 0 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:12.743570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.759335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ca87-3750-45d4-8891-2a8b8dee7cba tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.767496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.768843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.769360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.769778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/563bdb4138f640f1b6028389af2e9777` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.797681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d, role_id=563bdb4138f640f1b6028389af2e9777)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.801605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Could not find role: 563bdb4138f640f1b6028389af2e9777.: keystone.exception.RoleNotFound: Could not find role: 563bdb4138f640f1b6028389af2e9777. Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:12.844154 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:12.845655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 563bdb4138f640f1b6028389af2e9777. Jun 25 21:10:12.845655 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:10:12.845655 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2369/4765] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:10:12 2022] GET /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/563bdb4138f640f1b6028389af2e9777 => generated 110 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:10:12.851171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.868902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f423313-1802-4fb1-9b64-24a5c5424771 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.882252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.886305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.886944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.887467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/563bdb4138f640f1b6028389af2e9777` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:12.905742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d, role_id=563bdb4138f640f1b6028389af2e9777)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:12.907787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Could not find role: 563bdb4138f640f1b6028389af2e9777.: keystone.exception.RoleNotFound: Could not find role: 563bdb4138f640f1b6028389af2e9777. Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 25 21:10:12.951717 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:10:12.952724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 563bdb4138f640f1b6028389af2e9777. Jun 25 21:10:12.952724 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:10:12.964369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2397/4766] 10.222.0.39 () {58 vars in 1368 bytes} [Sat Jun 25 21:10:12 2022] HEAD /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d/roles/563bdb4138f640f1b6028389af2e9777 => generated 0 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 25 21:10:12.968861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:12.981515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfaf0-1b1c-4500-b4e1-b68faf533e77 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:12.996806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:12.997964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:12.998394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:12.998815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.012567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorizing `identity:delete_trust(trust_id=a4d78f21022546ee838c23e6d0b8874d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:13.014342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:13.051639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4d78f21022546ee838c23e6d0b8874d', 'request_id': 'req-8d12d864-2613-4e29-a64e-b882397d9521'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.052500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4d78f21022546ee838c23e6d0b8874d', 'request_id': 'req-8d12d864-2613-4e29-a64e-b882397d9521'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.053204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a4d78f21022546ee838c23e6d0b8874d', 'request_id': 'req-8d12d864-2613-4e29-a64e-b882397d9521'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.095239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2370/4767] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:10:12 2022] DELETE /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:13.099082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:13.103743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:13.123505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e49-c24b-42b2-836e-220de1a07bf1 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:13.137972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '153120ea5c254a359881313d0b22b151', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10badd449d9d4fedade4ff7462ed69c1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-633728486', 'tempest-DelegatedRole-1342811657'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:13.139606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:13.140545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:13.140875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] PATH_INFO: `/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Could not find trust: a4d78f21022546ee838c23e6d0b8874d.: keystone.exception.TrustNotFound: Could not find trust: a4d78f21022546ee838c23e6d0b8874d. Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 25 21:10:13.170585 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a4d78f21022546ee838c23e6d0b8874d. Jun 25 21:10:13.171628 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:10:13.172389 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2398/4768] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:10:13 2022] GET /identity/v3/OS-TRUST/trusts/a4d78f21022546ee838c23e6d0b8874d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:10:13.178340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:13.180486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:13.207452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12d864-2613-4e29-a64e-b882397d9521 tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:13.214567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:13.215772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:13.216292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:13.217087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/563bdb4138f640f1b6028389af2e9777` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.219607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=563bdb4138f640f1b6028389af2e9777)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:13.221444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:13.286406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 563bdb4138f640f1b6028389af2e9777 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:13.286842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.288045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.294282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2371/4769] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:13 2022] DELETE /identity/v3/roles/563bdb4138f640f1b6028389af2e9777 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:13.295495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:13.297748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:13.330422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c328f-462e-4ea4-91ea-125426d0bdfe tempest-TrustsV3TestJSON-1522977903 tempest-user-71130778] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:13.378311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:13.419016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:13.420395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:13.420395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:13.420678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/roles/02c9d87616f64f14aeec43c138250d9d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.422466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02c9d87616f64f14aeec43c138250d9d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:13.425398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:13.498248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invalidating the token cache because role 02c9d87616f64f14aeec43c138250d9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:13.498961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.499982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.502621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2399/4770] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:13 2022] DELETE /identity/v3/roles/02c9d87616f64f14aeec43c138250d9d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:13.507186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:13.528779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fb75-fe3c-4edb-962b-66ec827cc7a1 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:13.546620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:13.624135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:13.625593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:13.626074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:13.626771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/users/153120ea5c254a359881313d0b22b151` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.628796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_user(user_id=153120ea5c254a359881313d0b22b151)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:13.633371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:13.735471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153120ea5c254a359881313d0b22b151'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.755923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153120ea5c254a359881313d0b22b151'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.778011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153120ea5c254a359881313d0b22b151'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.779827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153120ea5c254a359881313d0b22b151'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.780763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153120ea5c254a359881313d0b22b151'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:13.804336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:13.806647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:13.809347 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2372/4771] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:13 2022] DELETE /identity/v3/users/153120ea5c254a359881313d0b22b151 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:13.825835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18891b84-4889-4063-b6bd-300d76312d9f tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:13.945904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea008362cd684301acbdfe11e6717801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f80107395cb4053aeee3a3f99bc4695', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:13.946880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:13.947175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:13.947491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] PATH_INFO: `/v3/projects/10badd449d9d4fedade4ff7462ed69c1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:13.949018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10badd449d9d4fedade4ff7462ed69c1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:13.952829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:14.045279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10badd449d9d4fedade4ff7462ed69c1', 'request_id': 'req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.077142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10badd449d9d4fedade4ff7462ed69c1', 'request_id': 'req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.104031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10badd449d9d4fedade4ff7462ed69c1', 'request_id': 'req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.129010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] The token cache is being invalidate because project 10badd449d9d4fedade4ff7462ed69c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:14.129404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.130260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff6d0317-ccbe-4b8e-84be-03dcdcf4470e tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.132392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2400/4772] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:13 2022] DELETE /identity/v3/projects/10badd449d9d4fedade4ff7462ed69c1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:14.148482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:14.148482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:14.293151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcc77-4e66-4379-b4c5-bf0fadecc987 tempest-TrustsV3TestJSON-1618550856 tempest-TrustsV3TestJSON-1618550856-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:14.369419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:14.417935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:14.418942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:14.419138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:14.419416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] PATH_INFO: `/v3/users/99a4efb5b1cd4619a978251a76c6e4a3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:14.421155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a4efb5b1cd4619a978251a76c6e4a3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:14.426459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:14.611029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a4efb5b1cd4619a978251a76c6e4a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.626845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a4efb5b1cd4619a978251a76c6e4a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.657330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a4efb5b1cd4619a978251a76c6e4a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.658228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a4efb5b1cd4619a978251a76c6e4a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.658990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a4efb5b1cd4619a978251a76c6e4a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:14.683248 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2373/4773] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:14 2022] DELETE /identity/v3/users/99a4efb5b1cd4619a978251a76c6e4a3 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:14.689429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:14.689916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:14.690219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:14.719215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:14.722580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:14.753699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:14.868357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2401/4774] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:14.886647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:14.889218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:14.999046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101267c-c3e3-443e-84ea-e85d16b400fb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:14.999046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:14.999046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:14.999046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:15.000404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:15.013696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:15.015774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:15.030754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2374/4775] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:16.110433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:16.113287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:16.133626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7370b-0f1d-4faf-a029-bb4320d7e179 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:16.144812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:16.147735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:16.148593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:16.149087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] PATH_INFO: `/v3/projects/2232183d17d14517bf0fa67fe68ff976` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:16.152123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2232183d17d14517bf0fa67fe68ff976)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:16.154846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:16.295485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2232183d17d14517bf0fa67fe68ff976', 'request_id': 'req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.312969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2232183d17d14517bf0fa67fe68ff976', 'request_id': 'req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.334984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2232183d17d14517bf0fa67fe68ff976', 'request_id': 'req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.369195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] The token cache is being invalidate because project 2232183d17d14517bf0fa67fe68ff976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:16.370193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.371473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dbf5e437-76d7-41e7-8ef2-6f9895aeb770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.373885 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2402/4776] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:16 2022] DELETE /identity/v3/projects/2232183d17d14517bf0fa67fe68ff976 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:16.378411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:16.421653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbed88-fe82-4fb9-bb97-992df16441ae service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:16.564734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:16.567406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:16.567781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:16.568244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] PATH_INFO: `/v3/users/ea008362cd684301acbdfe11e6717801` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:16.570281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea008362cd684301acbdfe11e6717801)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:16.582900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:16.585288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:16.620698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:16.621190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:16.621802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:16.646891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] MFA Rules not processed for user `10c0287a5f02499cb26cc144cd7588cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:16.648123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:16.697799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea008362cd684301acbdfe11e6717801'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.711624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea008362cd684301acbdfe11e6717801'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.735095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea008362cd684301acbdfe11e6717801'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.736498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea008362cd684301acbdfe11e6717801'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.737243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96fb36b3-ed9d-41ec-9cea-aa1b9d84f5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea008362cd684301acbdfe11e6717801'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:16.762587 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2403/4777] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:16.773268 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2375/4778] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:16 2022] DELETE /identity/v3/users/ea008362cd684301acbdfe11e6717801 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:17.468276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:17.469885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:17.494805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d16d-d41a-4229-a675-8df2ccb46cec None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:17.561376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:17.586352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:17.587347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:17.588184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:17.588671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] PATH_INFO: `/v3/projects/7f80107395cb4053aeee3a3f99bc4695` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:17.590197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f80107395cb4053aeee3a3f99bc4695)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:17.592307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:17.651751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f80107395cb4053aeee3a3f99bc4695', 'request_id': 'req-9b19c56f-1920-48be-abea-c1dbfe5d0374'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:17.664250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f80107395cb4053aeee3a3f99bc4695', 'request_id': 'req-9b19c56f-1920-48be-abea-c1dbfe5d0374'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:17.673651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f80107395cb4053aeee3a3f99bc4695', 'request_id': 'req-9b19c56f-1920-48be-abea-c1dbfe5d0374'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:17.686879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] The token cache is being invalidate because project 7f80107395cb4053aeee3a3f99bc4695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:17.687281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:17.688206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9b19c56f-1920-48be-abea-c1dbfe5d0374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:17.689959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2404/4779] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:17 2022] DELETE /identity/v3/projects/7f80107395cb4053aeee3a3f99bc4695 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:17.695184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:17.696251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:17.696647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:17.716883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:17.718098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:17.809122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2376/4780] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:17.821802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:17.821802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:17.821802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:17.839076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:17.840279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:17.859214 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2405/4781] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:17.859595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:17.867772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcee95-05c9-4663-82f1-59d75b95687a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:17.872467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:17.873355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:17.873639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:17.873918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:17.874653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:17.874952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:17.876764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:17.889618 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2377/4782] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:17.894143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:17.903846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110cb9c-2f13-4a9f-b3de-0c5d3c54d4c8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:17.910906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:17.912124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:17.912124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:17.912409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:17.913242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:17.915251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:17.948463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2406/4783] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:17 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:10:17.952011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:17.962960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565d1cd-803f-4ca5-be6e-0fb10e5f21ea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.030653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.031341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.031817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.032229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.033111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.035300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.048677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:18.069133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.072578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2378/4784] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:17 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:18.080718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16be8-1306-4601-852b-ddf0812b40bf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.085459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.086140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.086426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.086706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.087433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.090252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.104465 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2407/4785] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:18.107544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.120400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221cab-49b2-465c-8f85-1e164427d936 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.125560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.126319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.126610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.126890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.127622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.129480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2df1b2-01c9-4b84-84c3-6b15acc7e847 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.152500 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2379/4786] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:18.156812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.168954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a1b1d-3032-4d93-a663-dd56db052c6e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.175477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.176547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.177093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.177356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] PATH_INFO: `/v3/projects/769257435fad4372ad00ffd08c8b31a4/users/34624ed0ed214ba490df38478d51b756/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.207465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769257435fad4372ad00ffd08c8b31a4, user_id=34624ed0ed214ba490df38478d51b756, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.211615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.240780 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2408/4787] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:18 2022] PUT /identity/v3/projects/769257435fad4372ad00ffd08c8b31a4/users/34624ed0ed214ba490df38478d51b756/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:18.249381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.249674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.250085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.325641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] MFA Rules not processed for user `34624ed0ed214ba490df38478d51b756`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:18.327972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:18.416597 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2380/4788] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:18.416824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.428150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8afb4-b7b4-4d63-9162-d76f6ddf25c7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.434970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34624ed0ed214ba490df38478d51b756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769257435fad4372ad00ffd08c8b31a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.436111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.436617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.437079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] PATH_INFO: `/v3/domains/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.438676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.440401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61e572-6dcd-4a23-a774-7b4dad67c265 tempest-DefaultDomainTestJSON-2142079797 tempest-DefaultDomainTestJSON-2142079797-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.447605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.450160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2409/4789] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:18.532487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7645-208b-4cca-8944-8aa841b4ba16 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.538182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.539364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.539808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.540152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] PATH_INFO: `/v3/users/34624ed0ed214ba490df38478d51b756` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.541509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34624ed0ed214ba490df38478d51b756)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.544453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.606325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34624ed0ed214ba490df38478d51b756'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:18.615989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34624ed0ed214ba490df38478d51b756'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:18.633488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34624ed0ed214ba490df38478d51b756'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:18.634753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34624ed0ed214ba490df38478d51b756'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:18.635389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34624ed0ed214ba490df38478d51b756'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:18.644080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:18.655511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2381/4790] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:18 2022] DELETE /identity/v3/users/34624ed0ed214ba490df38478d51b756 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:18.660149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.660674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.660804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.685194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:18.686638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:18.768355 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2410/4791] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:18.783653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:18.787237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:18.857594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6fc1e-af9f-40f9-97a5-c91305979483 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:18.861597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:18.862260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:18.862559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:18.862863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:18.873337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:18.874944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d1d7c-29c7-43ce-b858-f6e331fff3b2 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:18.886488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2382/4792] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:19.980944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:19.982503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:20.009429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d2f8f-ee61-4077-ad2f-80f10baba4f7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.015199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.016408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.016855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.017306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] PATH_INFO: `/v3/projects/769257435fad4372ad00ffd08c8b31a4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.018663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769257435fad4372ad00ffd08c8b31a4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.021855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.031283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:20.154373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769257435fad4372ad00ffd08c8b31a4', 'request_id': 'req-2a2eb275-7199-412e-b4c1-77859501e285'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:20.182240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769257435fad4372ad00ffd08c8b31a4', 'request_id': 'req-2a2eb275-7199-412e-b4c1-77859501e285'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:20.197228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769257435fad4372ad00ffd08c8b31a4', 'request_id': 'req-2a2eb275-7199-412e-b4c1-77859501e285'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:20.230191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] The token cache is being invalidate because project 769257435fad4372ad00ffd08c8b31a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:20.230773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:20.232629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a2eb275-7199-412e-b4c1-77859501e285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:20.238531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2411/4793] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:19 2022] DELETE /identity/v3/projects/769257435fad4372ad00ffd08c8b31a4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:20.244937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.245975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.246480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.296276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:20.298179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:20.408195 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2383/4794] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:20.411092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.411427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.411695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.454553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:20.456319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:20.471641 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2412/4795] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:20.473126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.487887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0e137-e2fd-49f6-b0e7-a8283294281f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.501103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.501894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.502430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.502794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.503756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:20.503953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.510758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.542673 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2384/4796] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:20.544971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.559279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f4389-43ce-4d81-9eab-fdaeb1128613 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.570090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.572123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.573320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.574225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.577238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.583677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.647742 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2413/4797] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:20 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:20.647947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.661040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab15c59-4404-47a0-be03-2fd164ade0ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.736150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.737811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.738463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.738946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.740304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.742784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.788893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.800673 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2385/4798] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:20 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:10:20.807200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0c61-b0f9-41fc-a381-4881171f2352 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.813081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.814554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.814940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.815322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.816212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.818864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.835485 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2414/4799] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:20.836743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.848306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec452d-74b1-4063-a5d9-d86aafa476dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.853322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.854224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.854638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.854919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] PATH_INFO: `/v3/projects/408c72b813a24cd59135e2e434d667cf/users/9f0f2f3a5c52496d9249fa15aa04a0fc/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.868022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:20.873519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=408c72b813a24cd59135e2e434d667cf, user_id=9f0f2f3a5c52496d9249fa15aa04a0fc, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.878270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:20.897986 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2386/4800] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:20 2022] PUT /identity/v3/projects/408c72b813a24cd59135e2e434d667cf/users/9f0f2f3a5c52496d9249fa15aa04a0fc/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:20.902017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:20.914364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109338da-3aa1-469f-aef0-196e276750c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:20.982570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:20.983267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:20.983609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:20.983952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:20.984832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:20.986662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16835628-72dc-42c0-976a-33c87c606da5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.000463 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2415/4801] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:21.002741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.015039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23becb25-f12a-4018-acd7-40d6c562de2f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.019916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.020881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.021170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.021450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] PATH_INFO: `/v3/projects/408c72b813a24cd59135e2e434d667cf/users/9f0f2f3a5c52496d9249fa15aa04a0fc/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.023532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408c72b813a24cd59135e2e434d667cf, user_id=9f0f2f3a5c52496d9249fa15aa04a0fc, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.026402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.038219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2387/4802] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:21 2022] PUT /identity/v3/projects/408c72b813a24cd59135e2e434d667cf/users/9f0f2f3a5c52496d9249fa15aa04a0fc/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:21.051432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.051722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.052234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.087224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] MFA Rules not processed for user `9f0f2f3a5c52496d9249fa15aa04a0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:21.088908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:21.132778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.184193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2416/4803] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:21.189435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.315092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af85470-af80-4f04-b1bc-62cf7494b3e6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.320648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.321489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.321991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.322320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.323375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.325764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.370674 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2388/4804] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:21 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:21.375200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.390220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2e66-821c-4640-94a8-be7e982f861a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.468850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.470401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.470401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.470679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.471387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.473351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.494957 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2417/4805] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:21 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:21.499061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.511310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b7844-f6b5-4973-8e57-cfeade7567c3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.516570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.517282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.517603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.517964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.518644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.520501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.531370 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2389/4806] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:21.535819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.546705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377e16c-a586-45ee-acaa-dd4dafe69ff5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.551351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.552015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.552294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.552603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.553329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.554930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600c7b-96aa-4c93-8f65-8a0dcaf331ee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.565014 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2418/4807] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:21.569245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.580354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67954df-8672-4e8a-8328-a57da4fc29ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.586825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.588117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.588377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.588704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] PATH_INFO: `/v3/projects/009f9e7ed5fe472aa09d5c1b81a3292e/users/895eceed951a4ab1a5a605ceeac09e6f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.605695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f9e7ed5fe472aa09d5c1b81a3292e, user_id=895eceed951a4ab1a5a605ceeac09e6f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.608371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.624109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2390/4808] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:21 2022] PUT /identity/v3/projects/009f9e7ed5fe472aa09d5c1b81a3292e/users/895eceed951a4ab1a5a605ceeac09e6f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:21.638998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.639225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.639529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.671048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] MFA Rules not processed for user `895eceed951a4ab1a5a605ceeac09e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:21.672277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:21.743729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2419/4809] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:21.755807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:21.758599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:21.858725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba63f70-7d38-4738-9ff8-18a4b965e9d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:21.862596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:21.863391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:21.864461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:21.864461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:21.895909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.940070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:21.943350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c91f4a-6ce3-42fa-a858-752b054268f8 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:21.963165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2391/4810] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:22.786950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:22.864270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:22.908346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0f11c-22c0-483c-8ed7-f2d178138767 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:22.914214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:22.915359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:22.915815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:22.916265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] PATH_INFO: `/v3/users/9f0f2f3a5c52496d9249fa15aa04a0fc` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:22.917730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0f2f3a5c52496d9249fa15aa04a0fc)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:22.919972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:23.004957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0f2f3a5c52496d9249fa15aa04a0fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.005743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0f2f3a5c52496d9249fa15aa04a0fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.022454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0f2f3a5c52496d9249fa15aa04a0fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.044559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0f2f3a5c52496d9249fa15aa04a0fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.052057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0f2f3a5c52496d9249fa15aa04a0fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.059050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2420/4811] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:22 2022] DELETE /identity/v3/users/9f0f2f3a5c52496d9249fa15aa04a0fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:23.063600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:23.064069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:23.064222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:23.084001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:23.085299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:23.155835 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2392/4812] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:23.166957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:23.167744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:23.246771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a46c6-ca75-4993-9a3d-8fe92e181dec admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:23.253784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:23.254477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:23.254767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:23.255047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:23.266519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:23.268074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:23.278977 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2421/4813] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:23.670834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:23.673379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:23.693822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ec64-80d8-45ea-8ddb-6f14913bc44d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:23.699331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:23.700222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:23.700531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:23.700810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] PATH_INFO: `/v3/projects/408c72b813a24cd59135e2e434d667cf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:23.702106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408c72b813a24cd59135e2e434d667cf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:23.704063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:23.767044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408c72b813a24cd59135e2e434d667cf', 'request_id': 'req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.775868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408c72b813a24cd59135e2e434d667cf', 'request_id': 'req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.781946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408c72b813a24cd59135e2e434d667cf', 'request_id': 'req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.796797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] The token cache is being invalidate because project 408c72b813a24cd59135e2e434d667cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:23.797140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.798016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.800016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2393/4814] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:23 2022] DELETE /identity/v3/projects/408c72b813a24cd59135e2e434d667cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:23.806391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:23.818825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a34d5-a8c2-4264-ba87-efc1b5b4da5f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:23.893273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:23.894537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:23.894976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:23.895379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] PATH_INFO: `/v3/users/895eceed951a4ab1a5a605ceeac09e6f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:23.896643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895eceed951a4ab1a5a605ceeac09e6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:23.898591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:23.904360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:23.963173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895eceed951a4ab1a5a605ceeac09e6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.963877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895eceed951a4ab1a5a605ceeac09e6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.974522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895eceed951a4ab1a5a605ceeac09e6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:23.993877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895eceed951a4ab1a5a605ceeac09e6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.005493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0afb1b38-6dca-4b00-be5d-93daf83b4761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895eceed951a4ab1a5a605ceeac09e6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.016135 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2422/4815] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:23 2022] DELETE /identity/v3/users/895eceed951a4ab1a5a605ceeac09e6f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:24.450524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:24.451960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:24.465932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9ca9-a4b2-42f1-9f2f-889a6a0bdbe4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:24.526152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:24.544929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:24.546208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:24.546501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:24.546774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] PATH_INFO: `/v3/projects/009f9e7ed5fe472aa09d5c1b81a3292e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:24.548949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009f9e7ed5fe472aa09d5c1b81a3292e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:24.551280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:24.616009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009f9e7ed5fe472aa09d5c1b81a3292e', 'request_id': 'req-35a76115-3604-4898-9196-66040ecba993'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.631922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009f9e7ed5fe472aa09d5c1b81a3292e', 'request_id': 'req-35a76115-3604-4898-9196-66040ecba993'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.640544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009f9e7ed5fe472aa09d5c1b81a3292e', 'request_id': 'req-35a76115-3604-4898-9196-66040ecba993'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.659549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] The token cache is being invalidate because project 009f9e7ed5fe472aa09d5c1b81a3292e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:24.659961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.660736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35a76115-3604-4898-9196-66040ecba993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:24.669919 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2394/4816] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:24 2022] DELETE /identity/v3/projects/009f9e7ed5fe472aa09d5c1b81a3292e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:24.671478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:24.672563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:24.672563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:24.700792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:24.704240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:24.806546 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2423/4817] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:24.815432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:24.815856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:24.816237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:24.837224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:24.838874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:24.847295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2395/4818] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:24.851602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:24.862671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037455-e605-4fa4-ae01-ab1db5512a57 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:24.868073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:24.868789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:24.869086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:24.869360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:24.870094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:24.870403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:24.872013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:24.894348 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2424/4819] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:24.895527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:24.906189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b43f4-a4ed-4ec0-9c55-a97b5e12d14e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:24.911386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:24.912056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:24.912342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:24.912795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:24.913669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:24.915688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:24.948460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2396/4820] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:24.952644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:24.964575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2fe2-724b-4a14-936b-c9b23cdda6b0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:25.035778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:25.036498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.036807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.037084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.037781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:25.040179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:25.067249 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2425/4821] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:24 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:25.068467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:25.082501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9d91b-5890-4728-866b-7bd12b1fc714 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:25.087325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:25.088549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.088910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.089194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.089926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:25.091595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:25.106306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2397/4822] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:25.107176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:25.113381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:25.119603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4e1d6-5962-49b6-990c-3b39049e5398 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:25.125857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:25.127314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.128542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.128951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.130313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:25.132521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15c561-2943-44c1-8f37-3c8e29cd2bec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:25.145266 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2426/4823] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:25.149585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:25.161775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33283-d06c-42bb-be39-590c02010d79 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:25.167498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:25.168562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.168906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.169184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] PATH_INFO: `/v3/projects/892a5c1e67da4945913e2cb46801db4e/users/00976660a95c4381af80dd0566c06f09/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.190609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892a5c1e67da4945913e2cb46801db4e, user_id=00976660a95c4381af80dd0566c06f09, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:25.193750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:25.210688 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2398/4824] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:25 2022] PUT /identity/v3/projects/892a5c1e67da4945913e2cb46801db4e/users/00976660a95c4381af80dd0566c06f09/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:25.221670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.222083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.222435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.261587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] MFA Rules not processed for user `00976660a95c4381af80dd0566c06f09`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:25.266545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:25.365965 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2427/4825] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:25.378295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:25.381546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:25.524693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdaf52-9485-4b55-8c32-d8839a570e67 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:25.530089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:25.531277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:25.531392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:25.531856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:25.543526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:25.545390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:25.559334 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2399/4826] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:27.469315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:27.471017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:27.605221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e576ff-ccf0-456a-8645-ca2ff83cdecf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:27.615471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:27.616458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:27.616950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:27.617480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:27.622309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:27.652519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:27.663907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:27.703341 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2428/4827] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:28.386755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:28.405028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde501-4b53-4cef-8e72-c96a20d24bbc service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:28.414292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:28.417173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:28.417853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:28.418388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:28.422176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:28.443999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:28.446705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7450b-40f6-4328-8c31-5b5127856a53 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:28.462995 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2400/4828] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:29.649790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:29.652341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:29.722043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b525816-cdff-4f52-9380-ff483f59e2c9 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:29.727315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:29.728177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:29.728815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:29.729255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:29.731612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:29.781552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:29.869558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:29.872093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:29.896993 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2429/4829] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:31.413601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363a92-1cfe-4d1d-9383-1d2baa9f1130 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:31.414107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363a92-1cfe-4d1d-9383-1d2baa9f1130 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:31.414219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363a92-1cfe-4d1d-9383-1d2baa9f1130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:31.422535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:31.437885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-20363a92-1cfe-4d1d-9383-1d2baa9f1130 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:31.439479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-20363a92-1cfe-4d1d-9383-1d2baa9f1130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:31.505662 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2401/4830] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:31.571139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:31.573932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:31.703362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6ef97-668c-4092-bbb0-baebacdf8d94 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:31.710178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:31.711440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:31.711944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:31.712743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:31.723793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:31.726218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b9afa-e7e1-496b-b2cf-0d6707764bfc service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:31.737233 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2430/4831] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:33.594652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:33.595701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:33.596118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:33.598223 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2402/4832] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:10:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:10:33.605238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593a90-f712-46a3-82af-26005892b9d1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:33.605695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593a90-f712-46a3-82af-26005892b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:33.605801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56593a90-f712-46a3-82af-26005892b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:33.640239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-56593a90-f712-46a3-82af-26005892b9d1 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:33.641590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56593a90-f712-46a3-82af-26005892b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:33.675232 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2431/4833] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:33.699833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:33.702004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:33.742460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2056a67-4caf-4b02-b8de-e2bd56f80e40 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:33.750121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:33.751219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:33.751669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:33.752392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:33.767394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:33.770155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:33.786050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2403/4834] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:37.110218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:37.110816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:37.110816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:37.141064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:37.142726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:37.160279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2432/4835] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:37.170614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:37.184979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965afc-8fe0-4337-a0aa-dc91b3ec11dc service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:37.198891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:37.201048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:37.201459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:37.201933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:37.219903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:37.222575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c05bba-aba4-441b-b889-3c428ff8bee2 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:37.250233 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2404/4836] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:41.806407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:41.995817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ca7c-36af-4040-8478-14c71f49af1b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:42.007549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:42.008665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:42.009438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:42.009990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] PATH_INFO: `/v3/users/00976660a95c4381af80dd0566c06f09` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:42.013541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00976660a95c4381af80dd0566c06f09)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:42.018079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:42.166809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:42.184666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00976660a95c4381af80dd0566c06f09'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:42.185378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00976660a95c4381af80dd0566c06f09'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:42.204501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00976660a95c4381af80dd0566c06f09'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:42.269189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00976660a95c4381af80dd0566c06f09'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:42.299944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00976660a95c4381af80dd0566c06f09'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:42.311693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2433/4837] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:41 2022] DELETE /identity/v3/users/00976660a95c4381af80dd0566c06f09 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:42.316363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:42.317265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:42.317578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:42.338666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:42.340416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:42.481592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2405/4838] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:42.489233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:42.491210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:42.657756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd79b-510c-4373-a3bb-e16d56a496e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:42.667195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:42.677102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:42.677556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:42.677986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:42.705353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:42.707384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975862e0-9dd3-4614-aa5b-766edb01d504 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:42.730000 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2434/4839] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:10:43.634716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:43.637010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:43.663769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001b938-06ea-41dd-9bc1-44c7c8225f5a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:43.680694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:43.683634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:43.712636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:43.717306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] PATH_INFO: `/v3/projects/892a5c1e67da4945913e2cb46801db4e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:43.720085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=892a5c1e67da4945913e2cb46801db4e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:43.723757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:43.839475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892a5c1e67da4945913e2cb46801db4e', 'request_id': 'req-c4d25519-59d5-4e28-a591-f1c102481d20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:43.857316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892a5c1e67da4945913e2cb46801db4e', 'request_id': 'req-c4d25519-59d5-4e28-a591-f1c102481d20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:43.867784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892a5c1e67da4945913e2cb46801db4e', 'request_id': 'req-c4d25519-59d5-4e28-a591-f1c102481d20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:43.893480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] The token cache is being invalidate because project 892a5c1e67da4945913e2cb46801db4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:43.893978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:43.894929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c4d25519-59d5-4e28-a591-f1c102481d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:43.896780 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2406/4840] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:43 2022] DELETE /identity/v3/projects/892a5c1e67da4945913e2cb46801db4e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:43.902550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:43.903331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:43.903865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:43.954635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:43.957966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:44.132922 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2435/4841] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:44.137899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.138744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.138744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.160258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:44.178732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:44.180832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:44.204414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2407/4842] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:44.209344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.227379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb937b-62c3-45d6-a4bb-f9247144ca5d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.243237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.243942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.244228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.244572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.245529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:44.246824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.250421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.291497 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2436/4843] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:44.298587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.314122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f61c-675e-413c-abd1-62d8b9a529b2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.329430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.330870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.331158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.331485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.332180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.334490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.405250 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2408/4844] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:44 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:44.410344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.426608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a069523-8562-4699-a102-8d08878b2982 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.586378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:44.623302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.633450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.633450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.633450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.633450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.633756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.676543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2437/4845] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:44 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:44.682448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.692320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e2fb-5c91-4e01-ba4a-d3c05d02b19e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.700998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.701769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.702037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.702517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.703616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.705579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.718553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2409/4846] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:10:44.722331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.734532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1843d4-0adb-4a24-b79b-8c39d7915c0e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.740253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.741133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.741562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.742226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.742965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.744764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e675-a798-4c92-9183-c2d460453446 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.758450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2438/4847] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:44.762978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:44.776819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bff7d-4bb0-4495-93e7-15eb12f33579 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:44.782751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:44.784007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.784658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.785287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] PATH_INFO: `/v3/projects/f634a75738734bdf8eefdb035dd0dd79/users/c38368550bda4a8bb12800d281256c9e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.806603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f634a75738734bdf8eefdb035dd0dd79, user_id=c38368550bda4a8bb12800d281256c9e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:44.809999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:44.883281 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2410/4848] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:44 2022] PUT /identity/v3/projects/f634a75738734bdf8eefdb035dd0dd79/users/c38368550bda4a8bb12800d281256c9e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:44.895896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:44.895896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:44.896208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:44.933293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] MFA Rules not processed for user `c38368550bda4a8bb12800d281256c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:44.934454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:45.048978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2439/4849] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:45.059695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:45.061478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:45.150627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc791c-d8dd-4d1c-b9f0-3ca81674bcb6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:45.155078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:45.155862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:45.156214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:45.156594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:45.168693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:45.171641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:45.182717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2411/4850] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:52.942311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:52.976951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267637c-ce74-4166-9b97-ec1a2e36f010 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:52.983348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:52.984278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:52.984596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:52.984877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:52.988885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:53.133178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:53.135527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddea0ca-e391-4a38-85af-56e9883c00a9 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:53.151292 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2440/4851] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:53.517632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:53.533696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da3f9-1b23-4d66-8414-31a79828348b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:53.545612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:53.546522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:53.546806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:53.547088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] PATH_INFO: `/v3/users/c38368550bda4a8bb12800d281256c9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:53.549326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38368550bda4a8bb12800d281256c9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:53.553326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:53.636023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38368550bda4a8bb12800d281256c9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:53.653964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38368550bda4a8bb12800d281256c9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:53.683955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38368550bda4a8bb12800d281256c9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:53.685043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38368550bda4a8bb12800d281256c9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:53.685960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38368550bda4a8bb12800d281256c9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:53.704652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2412/4852] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:53 2022] DELETE /identity/v3/users/c38368550bda4a8bb12800d281256c9e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:53.709009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:53.709515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:53.709920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:53.743391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:53.744884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:53.857503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:53.898138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2441/4853] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:53.921303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:53.924735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:53.974856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:54.029751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c87f-1bcd-4017-8769-de46073c834f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:54.033583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:54.034335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:54.034562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:54.034840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:54.046453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:54.048956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:54.061903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2413/4854] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:54.485307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:54.487306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:54.508259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30023a-a685-4c40-8798-c2f422614b62 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:54.517716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:54.519644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:54.520159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:54.520950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] PATH_INFO: `/v3/projects/f634a75738734bdf8eefdb035dd0dd79` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:54.524127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f634a75738734bdf8eefdb035dd0dd79)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:54.526425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:54.549901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:54.552669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:54.577725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f5819-07fe-4862-a348-e50aefc539af service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:54.591882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:54.595644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:54.596290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:54.597560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] PATH_INFO: `/v3/users/3eb2928f8d734e61b71ae17ea712ac3d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:54.600358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb2928f8d734e61b71ae17ea712ac3d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:54.602932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:54.666696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f634a75738734bdf8eefdb035dd0dd79', 'request_id': 'req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.687829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f634a75738734bdf8eefdb035dd0dd79', 'request_id': 'req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.704759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f634a75738734bdf8eefdb035dd0dd79', 'request_id': 'req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.757202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb2928f8d734e61b71ae17ea712ac3d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.768406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] The token cache is being invalidate because project f634a75738734bdf8eefdb035dd0dd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:54.771162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb2928f8d734e61b71ae17ea712ac3d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.771647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.774294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8dfd06f3-f3ed-4dd2-b97f-2c86e5dc5f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.781787 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2442/4855] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:54 2022] DELETE /identity/v3/projects/f634a75738734bdf8eefdb035dd0dd79 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:54.792559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:54.794946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:54.795837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:54.800451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb2928f8d734e61b71ae17ea712ac3d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.801284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb2928f8d734e61b71ae17ea712ac3d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.801910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a6bd2c7-479c-4a42-a810-ea1330fbd90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb2928f8d734e61b71ae17ea712ac3d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:54.846859 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2414/4856] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:54 2022] DELETE /identity/v3/users/3eb2928f8d734e61b71ae17ea712ac3d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:54.880012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:54.882849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.032393 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2443/4857] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:55.034952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447282-36a9-423d-8501-055de178c646 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.034952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447282-36a9-423d-8501-055de178c646 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.035255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447282-36a9-423d-8501-055de178c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.057230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ad447282-36a9-423d-8501-055de178c646 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:55.059133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ad447282-36a9-423d-8501-055de178c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.074088 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2415/4858] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:55.075999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.089108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca1201-c9c6-4526-8a86-14ccaf83ad89 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.098443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.101147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.102132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.105464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.105464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:55.105801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.107893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.125594 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2444/4859] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:10:55.129852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad447282-36a9-423d-8501-055de178c646 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.138764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.145061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad447282-36a9-423d-8501-055de178c646 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.150834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.169027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.169936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3818d87-f85f-4b93-b750-c7e5809e7ea1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.170621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.172981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.173385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.174487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.176963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.177779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9fff-0c25-40dc-b6b9-518543f426fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.177901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.178168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.178996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] PATH_INFO: `/v3/projects/dc2d0a5c55aa4b37a53cb0fdf6c6ea45` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.180798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2d0a5c55aa4b37a53cb0fdf6c6ea45)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.183148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.216957 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2416/4860] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:55 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:55.220001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa258-f823-4844-a022-3eb525208523 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.220326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa258-f823-4844-a022-3eb525208523 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.220782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa258-f823-4844-a022-3eb525208523 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.222687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2417/4861] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:10:55.223346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa258-f823-4844-a022-3eb525208523 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.280813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'request_id': 'req-a7734761-78fd-48b1-b9c3-9be92f9d75b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.286932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:55.297328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'request_id': 'req-a7734761-78fd-48b1-b9c3-9be92f9d75b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.307287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'request_id': 'req-a7734761-78fd-48b1-b9c3-9be92f9d75b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.318302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa258-f823-4844-a022-3eb525208523 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.329020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] The token cache is being invalidate because project dc2d0a5c55aa4b37a53cb0fdf6c6ea45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:55.330113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.331102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a7734761-78fd-48b1-b9c3-9be92f9d75b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.333193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2445/4862] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:55 2022] DELETE /identity/v3/projects/dc2d0a5c55aa4b37a53cb0fdf6c6ea45 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:55.334334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.334744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.335073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.357374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:55.402537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:55.405069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.446169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.447446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.448542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.448717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.451865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.452786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.491817 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2418/4863] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:55 2022] POST /identity/v3/users => generated 278 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:55.492914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.496825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.515746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d9e1-cdc2-4505-a81a-caaf594de94e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.521917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.523739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.524089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.524402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] PATH_INFO: `/v3/users/d50e25fc50a14156bdfdcfd9cd65c268` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.526347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50e25fc50a14156bdfdcfd9cd65c268)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.529068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.530143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2446/4864] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:55.531293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.533013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.549626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab82f-a73d-400a-b281-9836216b326c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.555429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.556186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.556504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.559271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.560189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.562160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.584293 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2447/4865] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:55.585367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.587590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.606307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0812371-fa2c-44f4-8195-7c40da4b1aa9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.609929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50e25fc50a14156bdfdcfd9cd65c268'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.612648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.613474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.613762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.614044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.624566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.626182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50e25fc50a14156bdfdcfd9cd65c268'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.626875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.646386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2448/4866] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:55.650320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50e25fc50a14156bdfdcfd9cd65c268'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.651240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50e25fc50a14156bdfdcfd9cd65c268'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.652207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50e25fc50a14156bdfdcfd9cd65c268'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:55.658205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.679248 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2419/4867] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:55 2022] DELETE /identity/v3/users/d50e25fc50a14156bdfdcfd9cd65c268 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:55.681193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c7af4-1bc0-4c2c-b423-1ecc3ade2fdc service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.789385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.790902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.791257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.792200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.793071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.795255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eba59-14f8-415c-9595-5fe08848fb0a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.820750 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2449/4868] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:55.823160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:55.824829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:55.852786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683905a-a05c-449c-8707-7f828d0aada5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:55.863924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:55.867216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.868415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.868842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] PATH_INFO: `/v3/projects/dfec02ac6e554fd9a702d0919ae04c39/users/0f65cf4de88348568ed3ba7f1499b3b7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:55.910061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfec02ac6e554fd9a702d0919ae04c39, user_id=0f65cf4de88348568ed3ba7f1499b3b7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:55.914324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:55.961818 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2420/4869] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:55 2022] PUT /identity/v3/projects/dfec02ac6e554fd9a702d0919ae04c39/users/0f65cf4de88348568ed3ba7f1499b3b7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:55.963041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:55.963405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:55.963698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.038178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] MFA Rules not processed for user `0f65cf4de88348568ed3ba7f1499b3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:56.040761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:56.156823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:56.211075 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2450/4870] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:56.217853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.237112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.238668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:56.347815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:56.368602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5bfe2-d087-4c2f-a83b-2aeb6071863b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.375621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.376725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.377054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.377673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] PATH_INFO: `/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.379179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed5fa30ed2940638c504a7b2c3ace6d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.380995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fee32-5557-4da0-a8e2-3eb8d454615c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.381755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.399659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.400502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.405090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.405367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.411994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.414267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.471561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2421/4871] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/projects => generated 355 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:56.477609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.492316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed5fa30ed2940638c504a7b2c3ace6d', 'request_id': 'req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:56.505060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed5fa30ed2940638c504a7b2c3ace6d', 'request_id': 'req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:56.525559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed5fa30ed2940638c504a7b2c3ace6d', 'request_id': 'req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:56.549564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] The token cache is being invalidate because project 1ed5fa30ed2940638c504a7b2c3ace6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:56.550646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:56.551637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5ade9ba4-3eb3-4e51-8c1a-2407cfdf2cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:56.554115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2451/4872] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:56 2022] DELETE /identity/v3/projects/1ed5fa30ed2940638c504a7b2c3ace6d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:10:56.559596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd85a-38f9-4bea-94f1-3b9cbf362fcc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.559891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd85a-38f9-4bea-94f1-3b9cbf362fcc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.560220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd85a-38f9-4bea-94f1-3b9cbf362fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.588208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-843bd85a-38f9-4bea-94f1-3b9cbf362fcc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:56.589198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-843bd85a-38f9-4bea-94f1-3b9cbf362fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:56.599762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b59e6-1048-4419-8cb9-344a7df38ca0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.604610 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2452/4873] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:10:56.611310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.614077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.614715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.615330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.616309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.619358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.619751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.622365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.625697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.652708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:56.654874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:56.669062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2453/4874] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:56.674902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2422/4875] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:56.675178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.676874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.679606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:56.690576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b2b9c-8bad-4948-aee0-d657563924ba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.699469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743553-76e1-42d0-b21f-bb20228b909a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.702265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.704188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.704790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.704790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.706068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:10:56.706886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.708995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.709710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.711239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.711808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.712856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.713740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.716461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.731551 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2454/4876] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:10:56.733957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.759449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2423/4877] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:56.762512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.770782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc085a-fbef-4812-a292-51c748a7a6bd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.780904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.782020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.782626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.783162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.783628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120267f-40a0-4ed4-8cae-61201830adb9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:56.784462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.788798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.791215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:56.792246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:56.792583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:56.792910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] PATH_INFO: `/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa/users/5061c8e5e239475189a07bdabb105e8c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:56.845539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2cba89bdb84c0c9d0241ae1bec3bfa, user_id=5061c8e5e239475189a07bdabb105e8c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:56.855736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:56.862788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2455/4878] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:56.864503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.897748 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2424/4879] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:56 2022] PUT /identity/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa/users/5061c8e5e239475189a07bdabb105e8c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:56.900054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:56.939494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:57.012938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c456e-3da8-4696-a33e-78ff5c605a16 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.014903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0cde3-e750-4ab8-98d6-bbbf3b621b96 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.018834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.019522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.019911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.020202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.021336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.023396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.023875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.024505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.025114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.025802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.026706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.029476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.047408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2425/4880] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:57.052721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.068575 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2456/4881] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:10:56 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:10:57.068777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08842-ad7f-4158-8db4-60154f24cc01 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.070322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.076192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.077954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.078309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.079086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] PATH_INFO: `/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa/users/5061c8e5e239475189a07bdabb105e8c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.081910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2cba89bdb84c0c9d0241ae1bec3bfa, user_id=5061c8e5e239475189a07bdabb105e8c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.087742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5818b0-3f36-466e-b87c-59ad9507b952 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.090301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fe1c-28eb-4bfe-a83d-f9106588fad3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.101046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.102057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.102608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.105634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.108566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2426/4882] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:57 2022] PUT /identity/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa/users/5061c8e5e239475189a07bdabb105e8c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:57.111105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.114022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.117048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.117938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.118751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.145996 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2457/4883] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:57.148271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:57.148378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.157651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] MFA Rules not processed for user `5061c8e5e239475189a07bdabb105e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:57.160331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:57.165188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188160-cf40-460d-a3e2-5087e1044304 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.262069 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2427/4884] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:57.282724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.290709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:57.315058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.316446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.316758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.318502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.318777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.321987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.341748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2458/4885] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:10:57.349455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.375221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bcbb-7059-478a-a99c-406a96918d67 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.382938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.384076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.384553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.385280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] PATH_INFO: `/v3/projects/f42c224951d54938bcbff9ae004b1ab8/users/7aff0f40804b49e1b027368915e3a13a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.406008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42c224951d54938bcbff9ae004b1ab8, user_id=7aff0f40804b49e1b027368915e3a13a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.408591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e582bd8-db42-44bd-a20a-30090d31d0ab None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.409512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229c81-5f6b-456e-8e86-a6e27eb7564b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.414052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.414699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.415877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.416186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.429661 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2459/4886] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:10:57 2022] PUT /identity/v3/projects/f42c224951d54938bcbff9ae004b1ab8/users/7aff0f40804b49e1b027368915e3a13a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:57.432024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.434029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.440879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.441423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.441912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.450898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2428/4887] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:57.485101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] MFA Rules not processed for user `7aff0f40804b49e1b027368915e3a13a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:57.487416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:57.571995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.595856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85669d-6c19-4bbe-91cc-7c2cabf5b7fb service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.612946 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2460/4888] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:57.656193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:57.658082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:57.664823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:57.681218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.682130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.682545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.683354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.686521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:57.808584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:57.814836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.817806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.841843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3bc9-3d2a-4a8c-9e2b-f48381300d5e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:57.850126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2429/4889] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:10:57.869912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:57.870604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:57.870903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:57.871167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:57.899249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:57.901069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464efa9-d3a7-4b56-82c2-94a1b5a65ce4 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:57.921026 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2461/4890] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:10:57.949221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:58.068893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639004d-db9b-41c3-b201-117f77241dfe service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:58.079170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:58.080608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:58.081001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:58.081474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] PATH_INFO: `/v3/users/7aff0f40804b49e1b027368915e3a13a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:58.083872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aff0f40804b49e1b027368915e3a13a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:58.086940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:58.213084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aff0f40804b49e1b027368915e3a13a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.229703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aff0f40804b49e1b027368915e3a13a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.269064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aff0f40804b49e1b027368915e3a13a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.271568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aff0f40804b49e1b027368915e3a13a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.273263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aff0f40804b49e1b027368915e3a13a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.294832 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2430/4891] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:57 2022] DELETE /identity/v3/users/7aff0f40804b49e1b027368915e3a13a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:58.299640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:58.299939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:58.300222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:58.338543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:58.339957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:58.456365 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2462/4892] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:58.469553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:58.472200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:58.580855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04d74d-9cbf-45b9-96b2-4ef0526fce4c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:58.591134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:58.591944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:58.592301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:58.592651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:58.622160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:58.624221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:58.657820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2431/4893] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:10:58.838983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:58.840735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:58.868125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e82d9-d55f-40bb-954e-8a30c9f0ea68 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:58.874087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:58.875030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:58.875266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:58.875551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] PATH_INFO: `/v3/users/69effad76345477987af68f55c90e2e1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:58.877612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69effad76345477987af68f55c90e2e1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:58.880325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:58.953631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69effad76345477987af68f55c90e2e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.954437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69effad76345477987af68f55c90e2e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:58.981373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69effad76345477987af68f55c90e2e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.009315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69effad76345477987af68f55c90e2e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.020381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69effad76345477987af68f55c90e2e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.032035 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2463/4894] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:10:58 2022] DELETE /identity/v3/users/69effad76345477987af68f55c90e2e1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:59.302172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:59.303895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:59.331281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bcbe-8d81-4dff-be63-b24e5f8ae900 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:59.359727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:59.429309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:59.431094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:59.502509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:59.528218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:59.529980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:59.530601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:59.531258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] PATH_INFO: `/v3/projects/f42c224951d54938bcbff9ae004b1ab8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:59.539011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42c224951d54938bcbff9ae004b1ab8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:59.540974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:59.628006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42c224951d54938bcbff9ae004b1ab8', 'request_id': 'req-e392a355-3c72-42f3-86ea-d45b7cb80594'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.632558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4f2c-9fc4-4b75-b52b-5f0b1941b6b3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:10:59.641140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42c224951d54938bcbff9ae004b1ab8', 'request_id': 'req-e392a355-3c72-42f3-86ea-d45b7cb80594'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.669673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42c224951d54938bcbff9ae004b1ab8', 'request_id': 'req-e392a355-3c72-42f3-86ea-d45b7cb80594'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.722171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] The token cache is being invalidate because project f42c224951d54938bcbff9ae004b1ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:59.722476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.724456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e392a355-3c72-42f3-86ea-d45b7cb80594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.730401 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2432/4895] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:59 2022] DELETE /identity/v3/projects/f42c224951d54938bcbff9ae004b1ab8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:59.732231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc40bb-eb9c-46b9-8ee1-768b5478d17a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:59.732971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc40bb-eb9c-46b9-8ee1-768b5478d17a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:59.733733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc40bb-eb9c-46b9-8ee1-768b5478d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:59.767461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-56fc40bb-eb9c-46b9-8ee1-768b5478d17a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:59.768879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56fc40bb-eb9c-46b9-8ee1-768b5478d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:59.770315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:10:59.772393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:59.773410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:59.773939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] PATH_INFO: `/v3/projects/e11392205e814f46be92aa13f9e7dcfe` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:59.777059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11392205e814f46be92aa13f9e7dcfe)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:10:59.780676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:10:59.800129 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2433/4896] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:59.812366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332c55-713e-4bf2-9888-ffc5448f702f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:59.812760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332c55-713e-4bf2-9888-ffc5448f702f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:59.813115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332c55-713e-4bf2-9888-ffc5448f702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:59.853027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-49332c55-713e-4bf2-9888-ffc5448f702f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:59.857112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-49332c55-713e-4bf2-9888-ffc5448f702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:59.865964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11392205e814f46be92aa13f9e7dcfe', 'request_id': 'req-29eebef4-f946-427b-be7d-9b8104b03858'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.879747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11392205e814f46be92aa13f9e7dcfe', 'request_id': 'req-29eebef4-f946-427b-be7d-9b8104b03858'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.888631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11392205e814f46be92aa13f9e7dcfe', 'request_id': 'req-29eebef4-f946-427b-be7d-9b8104b03858'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.911039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] The token cache is being invalidate because project e11392205e814f46be92aa13f9e7dcfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:10:59.911316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.912171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:10:59.918111 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2464/4897] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:10:59 2022] DELETE /identity/v3/projects/e11392205e814f46be92aa13f9e7dcfe => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:10:59.919063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:10:59.921016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:10:59.959131 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2434/4898] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:10:59.961505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:10:59.961920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:10:59.962902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:10:59.996367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:10:59.997775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.001166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebef4-f946-427b-be7d-9b8104b03858 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.008014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.008819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.009175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.009525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.010540 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2435/4899] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:00.011435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.011887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.024081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.025319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15795793-4360-4f7e-a900-b16216ee54e5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.031410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.032274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.032410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.032724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.033642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:00.033982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.035637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019f19-57f4-40a4-8880-39b2a8e9ddee admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.051144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2436/4900] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:00.052606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.052993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.053366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.073780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:00.075145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.085378 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2437/4901] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:00.086257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.098259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c4caf-1c5f-4620-a255-39387ede7416 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.106134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.106899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.107571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.107677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.107851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.108123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.108941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.111015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.122107 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2465/4902] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:10:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:00.122310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.123246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.138162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c014a-f4e3-429e-bc8b-3138225e0284 service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.143516 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2438/4903] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:00.146039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.146926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.147354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.147770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.147926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.148804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:00.149267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.151242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.167603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2466/4904] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:00.173356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.184600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68132-9974-4115-9920-ff157ca694ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.226848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ba02-9c3e-4ee7-8885-f81c18411c9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.232259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.232982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.233269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.233602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.234452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.236587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.259143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2439/4905] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:00.259986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.261362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.261582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.262463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.262928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.263201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.263931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.265998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.297373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2467/4906] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:00.301382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.325754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8680c7d-db37-4460-acd0-a107cba02ed2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.369070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c5b72-a20b-425c-8d35-85f81d800fa5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.375558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.376364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.376679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.376961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.377855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.379492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.380277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.380973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.381257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.381561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.385566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.390391 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2468/4907] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:00.391268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.398209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.400940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.402502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.402624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7125c-9ec6-4bc8-8e78-f58a1b806456 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.409074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.409792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.410127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.410409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.411096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.413134 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2440/4908] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:00.413252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.413844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.430170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26cf-4614-48b3-bd7d-6d6b55c8ad74 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.435511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.436211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.436610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.436787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.437522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.439407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.443657 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2469/4909] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:00.447841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.457061 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2441/4910] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:00.465583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.478606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc02b0-1b1a-428b-99a7-e297027aae52 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.487063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.488386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.488677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.488955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] PATH_INFO: `/v3/projects/f90af973311a4475b9fc523b3ec4f4b5/users/7659a4ff473e46b0998b6aaf236f72b9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.490881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87800-ecfa-472d-a12b-c1734eada67a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.498175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.499423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.499772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.500118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.500964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.502892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.506569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90af973311a4475b9fc523b3ec4f4b5, user_id=7659a4ff473e46b0998b6aaf236f72b9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.509470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.516526 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2470/4911] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:11:00.518452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.521266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.527987 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2442/4912] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:00 2022] PUT /identity/v3/projects/f90af973311a4475b9fc523b3ec4f4b5/users/7659a4ff473e46b0998b6aaf236f72b9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:00.528983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.537504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.540285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c21bae-ec57-414f-8078-4e3f96439eab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.606719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.607399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.607682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.608029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.609098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8df64b-c9f6-4036-b184-f5d63a0b31ad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.610223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.613974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.614683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.614971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.615250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.615998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.617693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3e354-076f-470b-b930-396b0c6e59d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.628206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2443/4913] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:00.629471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.629732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.630044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.658101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] MFA Rules not processed for user `7659a4ff473e46b0998b6aaf236f72b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:00.659567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.686667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.688078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.700496 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2471/4914] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:00.701299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.711627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b54c-121d-4ff7-a43c-c8c22e0367c1 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.719878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.721534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.721968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.722253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] PATH_INFO: `/v3/projects/ffb625e087fa4ad498ff0cd6d864116a/users/2d06d8ec975744088a0a9d20025491b8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.730599 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2444/4915] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:00.734914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.738849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb625e087fa4ad498ff0cd6d864116a, user_id=2d06d8ec975744088a0a9d20025491b8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.742039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adda9e-5a95-42b1-957a-7f9f157caa41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.747292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa945a3-61bc-46a7-9fb2-ec379f76ba15 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.753277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.754251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.754539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.755162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.755509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.756913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2472/4916] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:00 2022] PUT /identity/v3/projects/ffb625e087fa4ad498ff0cd6d864116a/users/2d06d8ec975744088a0a9d20025491b8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:00.757477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.768785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bf5dd-cdb7-4730-97cc-1ceb13ac1b0b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.769488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bf5dd-cdb7-4730-97cc-1ceb13ac1b0b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.769799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bf5dd-cdb7-4730-97cc-1ceb13ac1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.794385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2445/4917] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:00.795427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.813062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-277bf5dd-cdb7-4730-97cc-1ceb13ac1b0b None None] MFA Rules not processed for user `2d06d8ec975744088a0a9d20025491b8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:00.813966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-277bf5dd-cdb7-4730-97cc-1ceb13ac1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:00.871664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906d072-e243-4268-9a92-ec80e087b3b8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.878951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.879811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.880095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.880373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.881119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.883867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.886790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.913447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:00.921220 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2446/4918] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:00.925227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:00.952632 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2473/4919] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:00.953378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4058f-3c8a-4167-842f-e3e5ad09de1b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:00.955245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.955884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.956174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.958584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:00.959387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:00.959794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:00.961088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:00.963363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:00.966588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:00.995774 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2447/4920] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:00.997552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] MFA Rules not processed for user `2d06d8ec975744088a0a9d20025491b8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:00.999125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:01.000112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.012235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2474/4921] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:01.018364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf076-47a0-489d-ab5c-a564da30f6d7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.024267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.025468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.025589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.025759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.026038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.026763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.027004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:01.028540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.048451 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2448/4922] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:01.052616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.096196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfcfcb-dbbb-460e-b215-db6ed77213b7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.108766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.110487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.112135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.113349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] PATH_INFO: `/v3/projects/0948e862fb2347a593cfe6ffd5cc2276/users/e0b068cbbc114108a434240450140459/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.145975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0948e862fb2347a593cfe6ffd5cc2276, user_id=e0b068cbbc114108a434240450140459, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.151111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86a4a3-9749-463d-90f0-bc1154f69c77 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.182454 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2449/4923] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:01 2022] PUT /identity/v3/projects/0948e862fb2347a593cfe6ffd5cc2276/users/e0b068cbbc114108a434240450140459/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:01.183750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23781d2-ecc6-4805-bec3-af72383a636f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.194396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.195178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.196246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.240630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] MFA Rules not processed for user `e0b068cbbc114108a434240450140459`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:01.245232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:01.344228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.345660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.346344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.346934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.417353 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2450/4924] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:01.418102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.449388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.451409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.478813 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2475/4925] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:11:01.561052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa457-a103-44f4-b4ee-82a136e4bee6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.574115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.574856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.575193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.575474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.576471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.578671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.611708 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2451/4926] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:01 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:01.615487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.628228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93883100-7415-49db-8d61-c0efba3446d9 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.644494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:01.743084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.751820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.753097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.754230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.754676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.755234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.768493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.800572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:01.844453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2476/4927] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:01 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:01.848541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.869925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5c6a-3f00-4449-8df0-41bb5eea5029 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.876298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.877103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.877397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.877676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.878531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.881104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.881854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243485ab-d91e-465c-9a73-7e1288051380 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.890572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.891449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.891881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.892909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.893549 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2477/4928] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:11:01.897544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:01.900265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.926155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29383a-2f21-4a63-a072-88c8996740e8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:01.931970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:01.933186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:01.933534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:01.933698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] PATH_INFO: `/v3/projects/22a2daaf7fc94427a8498381fedadf3c/users/2e8deb3f04e9480d983570d8dee71945/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:01.956332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a2daaf7fc94427a8498381fedadf3c, user_id=2e8deb3f04e9480d983570d8dee71945, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.960323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:01.984693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2478/4929] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:01 2022] PUT /identity/v3/projects/22a2daaf7fc94427a8498381fedadf3c/users/2e8deb3f04e9480d983570d8dee71945/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:01.988796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:01.997798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:01.999537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:02.017246 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2452/4930] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:11:02.112892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dacb9-7b04-4b1d-ae55-281ca41f7887 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:02.123551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:02.124471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:02.124708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:02.125037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:02.125776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:02.129072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b141dfb-17b5-4113-8398-009933ad7c3f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:02.143672 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2479/4931] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:02.145646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:02.160327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe526fc-9c03-4d77-9faa-2c3705ac5fd3 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:02.167972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:02.169053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:02.169336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:02.169612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] PATH_INFO: `/v3/projects/22a2daaf7fc94427a8498381fedadf3c/users/2e8deb3f04e9480d983570d8dee71945/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:02.172242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a2daaf7fc94427a8498381fedadf3c, user_id=2e8deb3f04e9480d983570d8dee71945, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:02.175280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:02.188470 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2453/4932] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:02 2022] PUT /identity/v3/projects/22a2daaf7fc94427a8498381fedadf3c/users/2e8deb3f04e9480d983570d8dee71945/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:02.199288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499caa8-a7bb-40db-9bb2-cce2a00e0367 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:02.199940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499caa8-a7bb-40db-9bb2-cce2a00e0367 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:02.200141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499caa8-a7bb-40db-9bb2-cce2a00e0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:02.232213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8499caa8-a7bb-40db-9bb2-cce2a00e0367 None None] MFA Rules not processed for user `2e8deb3f04e9480d983570d8dee71945`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:02.240861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8499caa8-a7bb-40db-9bb2-cce2a00e0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:02.320855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:02.352237 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2480/4933] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:02.363753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:02.367938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:02.441753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92ed0a-bcf4-4fec-9597-f7ec69b1509a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:02.446645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:02.447547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:02.447661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:02.448613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:02.534497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:02.536128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:02.551794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:02.560498 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2454/4934] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:11:02.931452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264104-2bcb-48d4-b214-af4f3ae8b790 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:02.931911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264104-2bcb-48d4-b214-af4f3ae8b790 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:02.932154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264104-2bcb-48d4-b214-af4f3ae8b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:02.984758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e9264104-2bcb-48d4-b214-af4f3ae8b790 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:02.984758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e9264104-2bcb-48d4-b214-af4f3ae8b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:03.135582 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2481/4935] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:03.156111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:03.157908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:03.252160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec089bb8-ee6f-4fc9-8369-ae2eaa18f584 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:03.259538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:03.260351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:03.260792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:03.261148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:03.272084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:03.273856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:03.284573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2455/4936] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:11:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:03.937280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:03.939370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:03.939370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:03.990759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] MFA Rules not processed for user `bee65f1c37764bdb9985b4e96a97ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:03.993635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:04.131500 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2482/4937] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:04.356515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:04.368936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668057cd-b044-4b5a-9298-18e6380dd23d service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:04.372941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:04.373628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:04.373906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:04.374377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:04.442520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:04.444660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:04.458898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2456/4938] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:05.105853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:05.119298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74634b-f5d7-4379-bddf-d30eb91d72eb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:05.123634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:05.124369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:05.124751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:05.125104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:05.137071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:05.138740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58adb-786d-485b-a83d-0b624217fb9f service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:05.151967 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2483/4939] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:10.614979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:10.728038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056aa76-48ec-4fcf-b70a-a8e4cda4949c service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:10.735053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:10.737210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:10.737707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:10.738451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] PATH_INFO: `/v3/users/7659a4ff473e46b0998b6aaf236f72b9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:10.740103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7659a4ff473e46b0998b6aaf236f72b9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:10.742540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:10.799898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:10.835721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7659a4ff473e46b0998b6aaf236f72b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:10.857228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7659a4ff473e46b0998b6aaf236f72b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:10.877053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7659a4ff473e46b0998b6aaf236f72b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:10.878715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7659a4ff473e46b0998b6aaf236f72b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:10.879434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7659a4ff473e46b0998b6aaf236f72b9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:10.911808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:10.912783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:10.913271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:10.914863 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2457/4940] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:10 2022] DELETE /identity/v3/users/7659a4ff473e46b0998b6aaf236f72b9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:10.977516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:10.978882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:11.162997 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2484/4941] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:11.170412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:11.174273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:11.341108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f93a-25b0-412e-8d08-5bf785303119 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:11.353299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:11.354494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:11.354792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:11.355108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:11.373196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:11.376110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:11.394746 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2458/4942] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:12.542064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:12.544320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:12.566892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669b54-229b-4698-98c7-f576d0a03bc4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:12.576818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:12.578345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:12.579299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:12.579299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] PATH_INFO: `/v3/projects/f90af973311a4475b9fc523b3ec4f4b5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:12.580864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90af973311a4475b9fc523b3ec4f4b5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:12.583286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:12.618492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:12.669779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90af973311a4475b9fc523b3ec4f4b5', 'request_id': 'req-057119d9-7ef4-4390-98a4-b41bd57d4e77'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.681578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90af973311a4475b9fc523b3ec4f4b5', 'request_id': 'req-057119d9-7ef4-4390-98a4-b41bd57d4e77'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.695728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90af973311a4475b9fc523b3ec4f4b5', 'request_id': 'req-057119d9-7ef4-4390-98a4-b41bd57d4e77'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.714003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] The token cache is being invalidate because project f90af973311a4475b9fc523b3ec4f4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:12.714452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.715714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.722600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:12.723136 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2485/4943] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:12 2022] DELETE /identity/v3/projects/f90af973311a4475b9fc523b3ec4f4b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:12.735849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bcdbb-1656-437a-a2ad-0fd76effc924 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:12.835499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:12.837339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:12.837894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:12.838591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] PATH_INFO: `/v3/users/e0b068cbbc114108a434240450140459` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:12.840172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b068cbbc114108a434240450140459)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:12.842461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:12.934746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b068cbbc114108a434240450140459'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.944937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:12.952012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b068cbbc114108a434240450140459'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.982395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b068cbbc114108a434240450140459'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.984041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b068cbbc114108a434240450140459'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:12.984953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b068cbbc114108a434240450140459'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:13.045632 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2459/4944] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:12 2022] DELETE /identity/v3/users/e0b068cbbc114108a434240450140459 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:13.806774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:13.808372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:13.824377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057119d9-7ef4-4390-98a4-b41bd57d4e77 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:13.918219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:13.919118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:13.920045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:13.920317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] PATH_INFO: `/v3/projects/0948e862fb2347a593cfe6ffd5cc2276` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:13.921993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0948e862fb2347a593cfe6ffd5cc2276)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:13.924647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:13.982088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0948e862fb2347a593cfe6ffd5cc2276', 'request_id': 'req-f7433702-d698-4ce1-abdd-94bc0554af2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:13.990534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0948e862fb2347a593cfe6ffd5cc2276', 'request_id': 'req-f7433702-d698-4ce1-abdd-94bc0554af2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:13.997111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0948e862fb2347a593cfe6ffd5cc2276', 'request_id': 'req-f7433702-d698-4ce1-abdd-94bc0554af2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.011044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] The token cache is being invalidate because project 0948e862fb2347a593cfe6ffd5cc2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:14.011397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.012057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.013767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2486/4945] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:13 2022] DELETE /identity/v3/projects/0948e862fb2347a593cfe6ffd5cc2276 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:14.018056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:14.019539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:14.033576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f2bb1-9186-45af-8906-48760d92b374 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:14.091729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:14.092575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:14.092861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:14.093139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] PATH_INFO: `/v3/users/2e8deb3f04e9480d983570d8dee71945` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:14.094354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8deb3f04e9480d983570d8dee71945)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:14.096305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:14.143783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8deb3f04e9480d983570d8dee71945'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.152091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8deb3f04e9480d983570d8dee71945'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.164802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8deb3f04e9480d983570d8dee71945'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.165470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8deb3f04e9480d983570d8dee71945'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.166527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e37cdecb-8a02-43d2-9cfd-5d1ba1ea660d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8deb3f04e9480d983570d8dee71945'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.179811 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2460/4946] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:14 2022] DELETE /identity/v3/users/2e8deb3f04e9480d983570d8dee71945 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:14.512718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:14.514976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:14.563385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7433702-d698-4ce1-abdd-94bc0554af2d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:14.620841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:14.663924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:14.664778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:14.665064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:14.665609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] PATH_INFO: `/v3/projects/22a2daaf7fc94427a8498381fedadf3c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:14.666834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a2daaf7fc94427a8498381fedadf3c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:14.668888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:14.760898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a2daaf7fc94427a8498381fedadf3c', 'request_id': 'req-79362589-8fd8-4a4d-8b99-18f2480d170b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.773553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a2daaf7fc94427a8498381fedadf3c', 'request_id': 'req-79362589-8fd8-4a4d-8b99-18f2480d170b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.782211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a2daaf7fc94427a8498381fedadf3c', 'request_id': 'req-79362589-8fd8-4a4d-8b99-18f2480d170b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.799740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] The token cache is being invalidate because project 22a2daaf7fc94427a8498381fedadf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:14.801354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.803622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79362589-8fd8-4a4d-8b99-18f2480d170b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:14.805541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2487/4947] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:14 2022] DELETE /identity/v3/projects/22a2daaf7fc94427a8498381fedadf3c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:14.815035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:14.822370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:14.822902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:14.856273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:14.862487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:14.978221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:15.033786 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2461/4948] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:15.043448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.043913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.044337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.111023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:15.112290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:15.133880 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2488/4949] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:15.136673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.148062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67ed75-7ac9-48cc-9a0b-6d077c189c45 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.180416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.180416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.180416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.180416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.180819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:15.180819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.180819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.201445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2462/4950] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:15.203744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.213965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9145e1-c16e-478a-94f6-35443c764396 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.237895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.238906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.239565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.240091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.241108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.244355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.304721 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2489/4951] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:15 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:15.306282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.324194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6ce76-da44-4cf2-8457-40c191eb0902 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.578371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.579149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.579441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.579817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.581187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.583552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.628568 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2463/4952] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:15 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:15.633760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.652521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e6f64-8422-4d5f-83e4-437d2b42385d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.664544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.667000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.667513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.667800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.669264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.676101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.697046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2490/4953] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:15.702055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.734607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e10a6-75cf-45a3-b85f-777a912ef6ac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.742973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.744010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.744307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.744633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.745387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.747011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadd3e0-d6a0-476d-b44e-856eaed671d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.768710 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2464/4954] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:15.772328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:15.789265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87c07-5bca-4350-a2e1-5e27810920b8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:15.806906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:15.808146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.811439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.811439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] PATH_INFO: `/v3/projects/eb400da5a98a4db5b56a37371e4a50a6/users/d287cd428abe49778f5172794db2ea49/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:15.872345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb400da5a98a4db5b56a37371e4a50a6, user_id=d287cd428abe49778f5172794db2ea49, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:15.882094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:15.954271 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2491/4955] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:15 2022] PUT /identity/v3/projects/eb400da5a98a4db5b56a37371e4a50a6/users/d287cd428abe49778f5172794db2ea49/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:15.957327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:15.957327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:15.957327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:16.054497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] MFA Rules not processed for user `d287cd428abe49778f5172794db2ea49`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:16.054497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:16.260682 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2465/4956] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:16.275102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:16.276916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:16.377486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062277-ca66-4c81-a1ea-5e96b0a8aad3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:16.383792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:16.385117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:16.385406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:16.385817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:16.400569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:16.405096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b82f-d3fc-454e-8b6d-627750e1887d service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:16.424503 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2492/4957] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:18.150857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:18.152588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:18.202163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:18.222779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da10d61-a887-409b-aa37-ea60c6a20f44 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:18.228365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:18.229358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:18.229643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:18.229922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] PATH_INFO: `/v3/users/0f65cf4de88348568ed3ba7f1499b3b7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:18.231482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f65cf4de88348568ed3ba7f1499b3b7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:18.233496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:18.287823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f65cf4de88348568ed3ba7f1499b3b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.298787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f65cf4de88348568ed3ba7f1499b3b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.312587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f65cf4de88348568ed3ba7f1499b3b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.313259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f65cf4de88348568ed3ba7f1499b3b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.313904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f65cf4de88348568ed3ba7f1499b3b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.329175 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2466/4958] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:18 2022] DELETE /identity/v3/users/0f65cf4de88348568ed3ba7f1499b3b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:18.333760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:18.334311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:18.334311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:18.347850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:18.355438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:18.358574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:18.427817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2493/4959] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:18.440391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:18.443026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:18.529340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ec3e4-bbbc-41c8-b9f7-9afa79b3a841 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:18.535949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:18.536703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:18.537040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:18.537325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:18.548161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:18.550170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:18.562094 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2467/4960] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:18.861551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:18.863003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:18.876181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfe483-f70f-4d09-bccf-3f9aa4941920 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:18.881720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:18.882643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:18.882919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:18.883195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] PATH_INFO: `/v3/projects/dfec02ac6e554fd9a702d0919ae04c39` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:18.884873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfec02ac6e554fd9a702d0919ae04c39)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:18.886867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:18.936776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfec02ac6e554fd9a702d0919ae04c39', 'request_id': 'req-d2ce3238-0b5c-40b8-842c-7254b6fac169'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.946042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfec02ac6e554fd9a702d0919ae04c39', 'request_id': 'req-d2ce3238-0b5c-40b8-842c-7254b6fac169'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.953184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfec02ac6e554fd9a702d0919ae04c39', 'request_id': 'req-d2ce3238-0b5c-40b8-842c-7254b6fac169'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.970077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] The token cache is being invalidate because project dfec02ac6e554fd9a702d0919ae04c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:18.970437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.971118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:18.972819 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2494/4961] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:18 2022] DELETE /identity/v3/projects/dfec02ac6e554fd9a702d0919ae04c39 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:18.977343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:18.993963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03191e51-da0f-4952-8314-47366a35faf9 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:19.068248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:19.069183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.069469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.069745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] PATH_INFO: `/v3/users/5061c8e5e239475189a07bdabb105e8c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.071006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5061c8e5e239475189a07bdabb105e8c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:19.072980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:19.081465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:19.136584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5061c8e5e239475189a07bdabb105e8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.150574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5061c8e5e239475189a07bdabb105e8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.167675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5061c8e5e239475189a07bdabb105e8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.168473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5061c8e5e239475189a07bdabb105e8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.169361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78379ede-8216-4adf-a06f-d9c0123e03cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5061c8e5e239475189a07bdabb105e8c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.184207 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2468/4962] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:18 2022] DELETE /identity/v3/users/5061c8e5e239475189a07bdabb105e8c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:19.521650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:19.523312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:19.541416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce3238-0b5c-40b8-842c-7254b6fac169 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:19.640306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:19.641640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.641924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.642334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] PATH_INFO: `/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.648770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2cba89bdb84c0c9d0241ae1bec3bfa)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:19.652592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:19.721964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:19.736404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2cba89bdb84c0c9d0241ae1bec3bfa', 'request_id': 'req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.745056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2cba89bdb84c0c9d0241ae1bec3bfa', 'request_id': 'req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.754772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2cba89bdb84c0c9d0241ae1bec3bfa', 'request_id': 'req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.767985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] The token cache is being invalidate because project 2f2cba89bdb84c0c9d0241ae1bec3bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:19.768456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.769230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d55d29f1-dea0-4c10-b84d-1bcc92120fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:19.770865 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2495/4963] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:19 2022] DELETE /identity/v3/projects/2f2cba89bdb84c0c9d0241ae1bec3bfa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:19.777931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.778291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.778556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.811107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:19.812630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:19.893593 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2469/4964] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:19.900001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.900295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.900604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.925947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:19.927214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:19.937316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2496/4965] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:19.943202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:19.953253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a054a-cb54-4f61-b44b-fa5e6f8a7ccc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:19.958334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:19.958996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.959283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.959559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.960309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:19.960655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:19.962661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:19.974564 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2470/4966] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:19.978902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:19.988820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a320a-6936-439e-93b6-cc423e83f425 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:19.993975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:19.994678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:19.995064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:19.995340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:19.996040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:19.997991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.027786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2497/4967] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:19 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:20.029112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.042233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60128e-00ac-4c16-adc8-26fe63758e4c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.100234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.100949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.101234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.101515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.102201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.104125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.125581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2471/4968] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:20 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:20.129624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.143131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5137b6f-f2ec-4682-9b2f-e51c3711698b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.150388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.151325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.151705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.152135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.152923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.154553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.165937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2498/4969] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:20.170072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.176340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:20.182418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db1ea0-179e-422e-9aa1-63de9c09b7ba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.189262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.190025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.190577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.190910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.191854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.194270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1148f-de63-4d9b-ba9b-b4a154191007 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.205137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2472/4970] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:20.209429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.221412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8815465-3dc6-4f80-b94e-0745cd6e933c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.227085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.228258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.228578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.228858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] PATH_INFO: `/v3/projects/068165e4a2894e02a78027afd2cb306d/users/2d15986dabe249e6932792b8988233e2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.251476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068165e4a2894e02a78027afd2cb306d, user_id=2d15986dabe249e6932792b8988233e2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.255106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.273838 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2499/4971] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:20 2022] PUT /identity/v3/projects/068165e4a2894e02a78027afd2cb306d/users/2d15986dabe249e6932792b8988233e2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:20.286025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.286420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.286634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.318980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] MFA Rules not processed for user `2d15986dabe249e6932792b8988233e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:20.320194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:20.390810 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2473/4972] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:20.395728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.479546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784f2a-8552-442d-be54-adc5d228b087 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.488373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.489400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.489817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.490358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.491300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.493883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.525650 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2500/4973] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:20 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:20.530896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.544406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017ebcd-2527-4152-8203-8b73b2d59bb3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.604684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.605296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.605674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.605979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.606797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.609235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.631037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2474/4974] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:20 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:20.635233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.646263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fccdb1-5bed-4c22-8043-dadf1405feb7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.651348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.652015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.652290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.652611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.653348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.654955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.667515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2501/4975] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:20.671972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.683736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaeabe-ad67-431f-b24e-c69becd8214c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.689561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.690925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.691158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.691502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] PATH_INFO: `/v3/projects/ebd5f213bf0249daa7372257d6686260/users/1824a4e8b2a7422b8b9fa8e840fec30a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.723486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd5f213bf0249daa7372257d6686260, user_id=1824a4e8b2a7422b8b9fa8e840fec30a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.732392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.757948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2475/4976] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:20 2022] PUT /identity/v3/projects/ebd5f213bf0249daa7372257d6686260/users/1824a4e8b2a7422b8b9fa8e840fec30a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:20.761731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.784238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9233-72ee-44f6-b12f-47a6f4a443a2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.860051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:20.915079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.916051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.916339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.916663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.917819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.919517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83e31a-f2e3-453c-9461-4c11133762c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:20.932462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2502/4977] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:20.936127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:20.963995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198282b-09fb-45e2-ace8-dbb69882ef34 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:20.978386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:20.980459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:20.981123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:20.981391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] PATH_INFO: `/v3/projects/ebd5f213bf0249daa7372257d6686260/users/1824a4e8b2a7422b8b9fa8e840fec30a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:20.987527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd5f213bf0249daa7372257d6686260, user_id=1824a4e8b2a7422b8b9fa8e840fec30a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:20.998140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:21.021286 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2476/4978] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:20 2022] PUT /identity/v3/projects/ebd5f213bf0249daa7372257d6686260/users/1824a4e8b2a7422b8b9fa8e840fec30a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:21.032415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:21.032801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:21.033334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:21.065034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] MFA Rules not processed for user `1824a4e8b2a7422b8b9fa8e840fec30a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:21.067187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:21.160509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2503/4979] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:21.173668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:21.176071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:21.217847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:21.247973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd42e-3b30-4e83-ac44-09b6d3cbaca8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:21.254533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:21.255257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:21.255517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:21.255899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:21.346324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:21.347892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8240-0382-4cc2-95c9-ade9ce305387 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:21.358603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2477/4980] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:21.921366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:21.923034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:22.016521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212e8c-a080-4dcf-a7f8-049694d5a2fa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:22.022026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:22.023125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:22.023418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:22.023690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] PATH_INFO: `/v3/users/2d06d8ec975744088a0a9d20025491b8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:22.025169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d06d8ec975744088a0a9d20025491b8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:22.027492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:22.102252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d06d8ec975744088a0a9d20025491b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.103323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d06d8ec975744088a0a9d20025491b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.114999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d06d8ec975744088a0a9d20025491b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.116802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:22.134063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d06d8ec975744088a0a9d20025491b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.141609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d06d8ec975744088a0a9d20025491b8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.149710 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2504/4981] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:21 2022] DELETE /identity/v3/users/2d06d8ec975744088a0a9d20025491b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:22.155021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:22.155318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:22.155514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:22.191084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:22.194094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:22.285859 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2478/4982] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:22.300779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:22.302443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:22.388273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf900-2637-427a-a10a-becfe6175a04 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:22.392028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:22.392752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:22.393040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:22.393317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:22.403152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:22.404629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047263-41c2-4b39-afd9-c61d7869ef63 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:22.414214 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2505/4983] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:22.735235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:22.737842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:22.761498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b014-b573-433e-80ad-76a406909ca8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:22.768048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:22.769192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:22.769472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:22.769874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] PATH_INFO: `/v3/projects/ffb625e087fa4ad498ff0cd6d864116a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:22.771134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb625e087fa4ad498ff0cd6d864116a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:22.773591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:22.837405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb625e087fa4ad498ff0cd6d864116a', 'request_id': 'req-f9665d86-f26a-42bb-952d-b25d9966ab33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.847555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb625e087fa4ad498ff0cd6d864116a', 'request_id': 'req-f9665d86-f26a-42bb-952d-b25d9966ab33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.856090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb625e087fa4ad498ff0cd6d864116a', 'request_id': 'req-f9665d86-f26a-42bb-952d-b25d9966ab33'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.868664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] The token cache is being invalidate because project ffb625e087fa4ad498ff0cd6d864116a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:22.869033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.869766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9665d86-f26a-42bb-952d-b25d9966ab33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:22.878022 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2479/4984] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:22 2022] DELETE /identity/v3/projects/ffb625e087fa4ad498ff0cd6d864116a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:22.880211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:22.880767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:22.881112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:22.925196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:22.925196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:22.992378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2506/4985] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:23.002334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.002678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.002913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.024698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:23.026064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:23.036920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2480/4986] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:23.041372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.052156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb42953-d605-48f8-a901-6eb9acd183ef None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.057664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.058363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.058793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.059218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.060582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:23.060959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.062600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.077456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2507/4987] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:11:23.081891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.088501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:23.094329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399134-c4ec-494a-86b0-0a4b0a4ef68f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.100734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.102300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.102975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.103661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.105399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.109417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.142036 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2481/4988] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:23.147838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.161165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edca2d-7e02-4f6e-b07a-542e7cd5f5b0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.241564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.242251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.242535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.242813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.243689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.245631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.254371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:23.271793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2508/4989] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:23 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:23.275947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.287768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf3ebd-7ba8-4f9d-878e-b08917e928ba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.293622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.294307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.294758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.295203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.295934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.297901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.310098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2482/4990] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:23.314281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.326281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d0bc3-3969-4360-b478-7c20d8707bd9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.332995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.333915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.334196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.342469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.342469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.346262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a98e-2a03-446f-bcdc-078d6c5b7ee1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.358628 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2509/4991] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:23.362847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.374744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568db8-393a-4e87-bcda-aa8804d86f8a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.380354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.381906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.382397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.382868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] PATH_INFO: `/v3/projects/ba3c632ea72243429aedaf10e5af8ec2/users/a045ffc3ca714026846fa943dc735596/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.434957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c632ea72243429aedaf10e5af8ec2, user_id=a045ffc3ca714026846fa943dc735596, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.438203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.473879 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2483/4992] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:23 2022] PUT /identity/v3/projects/ba3c632ea72243429aedaf10e5af8ec2/users/a045ffc3ca714026846fa943dc735596/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:23.478858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.479216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.479591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.519566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] MFA Rules not processed for user `a045ffc3ca714026846fa943dc735596`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:23.533313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:23.662968 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2510/4993] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:23.674463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:23.676399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:23.780329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc5b-0d61-4bdd-8cc5-5daf05a18327 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:23.786885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:23.787619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:23.787967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:23.788339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:23.797801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:23.799540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85447dfd-95cc-47b9-bb3e-bc671e12f0d3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:23.809751 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2484/4994] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:25.905655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:25.907256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:26.003484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5c30b-d12a-4aa3-b86e-2a9904b5134c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:26.008771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:26.009721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:26.010011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:26.010297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:26.012355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:26.103903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:26.105624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:26.118004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2511/4995] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:29.031188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:29.031705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:29.031790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:29.059002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:29.061072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:29.144829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2485/4996] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:29.169603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:29.172187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:29.207805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:29.284774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008d898-e11f-48e1-8748-f8af002a1b26 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:29.292674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:29.293511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:29.293680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:29.293996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:29.305461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:29.309335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ec285-e66d-48c3-b709-cf2bbaff3dc0 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:29.332468 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2512/4997] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:29.554759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:29.621745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:29.664813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307999-0c2f-4c6e-8e0e-2f915897728d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:29.672670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:29.673664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:29.674298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:29.674647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] PATH_INFO: `/v3/users/a045ffc3ca714026846fa943dc735596` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:29.675905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a045ffc3ca714026846fa943dc735596)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:29.689896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:29.832541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a045ffc3ca714026846fa943dc735596'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:29.855398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a045ffc3ca714026846fa943dc735596'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:29.885074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a045ffc3ca714026846fa943dc735596'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:29.885912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a045ffc3ca714026846fa943dc735596'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:29.886612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a045ffc3ca714026846fa943dc735596'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:29.913909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2486/4998] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:29 2022] DELETE /identity/v3/users/a045ffc3ca714026846fa943dc735596 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:29.918957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:29.919323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:29.919689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:29.964020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:29.965504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:30.146108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2513/4999] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:30.163061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:30.164757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:30.377141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cd1a3-05f3-4845-ae34-b2cd56228658 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:30.384235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:30.385916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:30.386400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:30.386930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:30.413745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:30.428143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a79c-f3af-4eae-8a6d-348e576d8c86 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:30.458937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2487/5000] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:31.156903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:31.159866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:31.187895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877150be-12e6-4076-9f35-c85c6d8f62cc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:31.200803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:31.202183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:31.202998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:31.205785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] PATH_INFO: `/v3/projects/ba3c632ea72243429aedaf10e5af8ec2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:31.209058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3c632ea72243429aedaf10e5af8ec2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:31.232257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:31.370939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3c632ea72243429aedaf10e5af8ec2', 'request_id': 'req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:31.399016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3c632ea72243429aedaf10e5af8ec2', 'request_id': 'req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:31.421358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3c632ea72243429aedaf10e5af8ec2', 'request_id': 'req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:31.444956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] The token cache is being invalidate because project ba3c632ea72243429aedaf10e5af8ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:31.445701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:31.448865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53a8eeb9-93d8-4b8f-a9b5-3896e6574c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:31.453603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2514/5001] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:31 2022] DELETE /identity/v3/projects/ba3c632ea72243429aedaf10e5af8ec2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:31.458752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:31.459187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:31.459315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:31.497177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:31.501597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:31.659222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:31.676586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2488/5002] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:31.683803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:31.684469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:31.685020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:31.719329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:31.721431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:31.736679 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2515/5003] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:31.742801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:31.759462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a1b4-3f07-488e-b2dc-fb1bc79134c7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:31.772110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:31.773666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:31.774132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:31.774370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:31.776816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:31.778177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:31.782852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:31.839409 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2489/5004] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:31.843896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:31.856916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8497b-e851-43e0-a2a8-2418be42e746 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:31.889031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:31.890469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:31.890711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:31.892148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:31.894226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:31.897042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:31.948564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2516/5005] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:31 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:31.953679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:31.968770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4d210-1d59-49d0-9a6d-e393f42bc1aa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.065360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.065817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.066141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.066458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.067447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.069670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.100166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2490/5006] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:31 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:32.104770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:32.115098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:32.124540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2aa3-897e-4c49-8512-850ab3098731 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.134435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.136542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.137170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.137655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.138481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.141540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.159180 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2517/5007] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:32.163757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:32.177848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460dca8-e5c2-4114-b9e4-3baaedddab1a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.210709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.210709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.211112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.211597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.220511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.220511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9427e7-3066-4a0e-8572-4482f0896c02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.236942 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2491/5008] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:32.241479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:32.260350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32760b-ec77-45c9-8a8c-d0d741a4f586 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.267268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.269501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.271795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.272159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] PATH_INFO: `/v3/projects/3ffa25d25ce240dea2a04a03beed71a8/users/781dbfd151054dd5ba3bd91cff9e1642/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.296928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffa25d25ce240dea2a04a03beed71a8, user_id=781dbfd151054dd5ba3bd91cff9e1642, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.302901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.336287 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2518/5009] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:32 2022] PUT /identity/v3/projects/3ffa25d25ce240dea2a04a03beed71a8/users/781dbfd151054dd5ba3bd91cff9e1642/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:32.351779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.352089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.352783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.435878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] MFA Rules not processed for user `781dbfd151054dd5ba3bd91cff9e1642`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:32.439764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:32.595436 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2492/5010] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:32.610063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:32.613261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:32.642570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:32.646085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:32.807525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:32.818561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bfade-4c9f-4ab0-be62-559e639e5e10 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.828033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d583834-793f-4d33-87a9-31de19053f23 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:32.829639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.832096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.833363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.834029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] PATH_INFO: `/v3/users/2d15986dabe249e6932792b8988233e2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.836676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:32.837687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d15986dabe249e6932792b8988233e2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.838251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.838730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.839167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:32.840371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.863356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:32.863356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9ce5-9f3b-4820-851f-222ffeae50f2 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:32.883511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2519/5011] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:32.929028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d15986dabe249e6932792b8988233e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:32.935729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d15986dabe249e6932792b8988233e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:32.953137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d15986dabe249e6932792b8988233e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:32.954146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d15986dabe249e6932792b8988233e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:32.955301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d15986dabe249e6932792b8988233e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:32.983658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2493/5012] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:32 2022] DELETE /identity/v3/users/2d15986dabe249e6932792b8988233e2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:32.989164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:32.989943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:32.990475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:33.027549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:33.041568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:33.140039 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2520/5013] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:33.151055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:33.153110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:33.200264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:33.200264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:33.212152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a9ef0-a105-420b-8680-4892d2dc8741 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:33.220249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:33.221962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:33.222246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:33.224230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] PATH_INFO: `/v3/users/781dbfd151054dd5ba3bd91cff9e1642` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:33.227265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] RBAC: Authorizing `identity:delete_user(user_id=781dbfd151054dd5ba3bd91cff9e1642)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:33.231479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:33.268536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d765-c8a5-45e6-b8d8-774af4265e7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:33.274103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:33.274775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:33.275060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:33.275340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:33.292517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:33.294858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d7e-c8f0-43df-a119-ee806b0c93c0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:33.308016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2494/5014] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:33.323296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781dbfd151054dd5ba3bd91cff9e1642'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:33.324447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781dbfd151054dd5ba3bd91cff9e1642'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:33.327869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:33.355287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781dbfd151054dd5ba3bd91cff9e1642'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:33.373844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781dbfd151054dd5ba3bd91cff9e1642'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:33.382408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781dbfd151054dd5ba3bd91cff9e1642'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:33.390086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2521/5015] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:33 2022] DELETE /identity/v3/users/781dbfd151054dd5ba3bd91cff9e1642 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:33.395425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:33.395738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:33.396195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:33.418038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:33.419612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:33.508191 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2495/5016] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:33.516146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:33.518178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:33.597313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dafc71-002f-4042-83ab-daca4437846e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:33.601323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:33.602180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:33.602469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:33.602747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:33.617855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:33.619415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:33.633022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2522/5017] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:34.278452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:34.280503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.295423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5416-366e-44c7-9a44-2e0d8a2ec1ef None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:34.301268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:34.302259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.302556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.303106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] PATH_INFO: `/v3/projects/068165e4a2894e02a78027afd2cb306d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.304612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068165e4a2894e02a78027afd2cb306d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:34.306708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:34.324846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:34.386653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068165e4a2894e02a78027afd2cb306d', 'request_id': 'req-361c11d7-ec67-4413-abfc-8ff8303392f4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.400316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068165e4a2894e02a78027afd2cb306d', 'request_id': 'req-361c11d7-ec67-4413-abfc-8ff8303392f4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.409514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068165e4a2894e02a78027afd2cb306d', 'request_id': 'req-361c11d7-ec67-4413-abfc-8ff8303392f4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.419124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:34.420622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.426520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] The token cache is being invalidate because project 068165e4a2894e02a78027afd2cb306d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:34.427033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.427674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.429383 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2496/5018] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:34 2022] DELETE /identity/v3/projects/068165e4a2894e02a78027afd2cb306d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:34.434074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:34.436951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.442417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f6f42-05bb-43c4-a1bc-5910babf6b71 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:34.546463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c11d7-ec67-4413-abfc-8ff8303392f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:34.551110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:34.552457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.552963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.553289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:34.553740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] PATH_INFO: `/v3/projects/3ffa25d25ce240dea2a04a03beed71a8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.555200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.555339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffa25d25ce240dea2a04a03beed71a8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:34.555634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.556108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] PATH_INFO: `/v3/users/1824a4e8b2a7422b8b9fa8e840fec30a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.557511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1824a4e8b2a7422b8b9fa8e840fec30a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:34.558597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:34.559729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:34.652736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1824a4e8b2a7422b8b9fa8e840fec30a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.653315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffa25d25ce240dea2a04a03beed71a8', 'request_id': 'req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.662817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1824a4e8b2a7422b8b9fa8e840fec30a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.670369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffa25d25ce240dea2a04a03beed71a8', 'request_id': 'req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.685598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffa25d25ce240dea2a04a03beed71a8', 'request_id': 'req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.691630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1824a4e8b2a7422b8b9fa8e840fec30a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.692748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1824a4e8b2a7422b8b9fa8e840fec30a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.693612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1824a4e8b2a7422b8b9fa8e840fec30a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.699591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:34.705493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] The token cache is being invalidate because project 3ffa25d25ce240dea2a04a03beed71a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:34.706119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.707540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd5c6403-6ccf-4b0f-a8f6-fe5b826a9574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:34.713316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2523/5019] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:34 2022] DELETE /identity/v3/projects/3ffa25d25ce240dea2a04a03beed71a8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:34.718653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80005-e1c8-44aa-a62a-314e990f57f5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.718969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80005-e1c8-44aa-a62a-314e990f57f5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.719325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80005-e1c8-44aa-a62a-314e990f57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.724725 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2497/5020] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:34 2022] DELETE /identity/v3/users/1824a4e8b2a7422b8b9fa8e840fec30a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:34.748074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-27a80005-e1c8-44aa-a62a-314e990f57f5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:34.750009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-27a80005-e1c8-44aa-a62a-314e990f57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.801039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:34.802588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.876631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2524/5021] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:34.878072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:34.882975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.885020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.885650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.932478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:34.934946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:34.960191 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2525/5022] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:34.964729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:34.984975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f931810-02f8-49cc-8c77-21a7edf9ff49 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:34.985471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77130-87a9-4b6e-a259-380c460e8905 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:34.991704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:34.992892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:34.993184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:34.993569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] PATH_INFO: `/v3/users/d287cd428abe49778f5172794db2ea49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:34.994993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d287cd428abe49778f5172794db2ea49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:34.997322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:34.999345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.000045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.000329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.000664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.001460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:35.001779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.003605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.029402 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2526/5023] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:11:35.033399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.063499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98a9e5-eacf-414c-a86f-e252d69c0275 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.078472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.083413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.083413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.084044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.084749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd287cd428abe49778f5172794db2ea49'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.085189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.092459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.101128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd287cd428abe49778f5172794db2ea49'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.132990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd287cd428abe49778f5172794db2ea49'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.134360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd287cd428abe49778f5172794db2ea49'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.135271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7025b480-87de-4aae-bc1d-4508684bd828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd287cd428abe49778f5172794db2ea49'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.162632 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2498/5024] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:34 2022] DELETE /identity/v3/users/d287cd428abe49778f5172794db2ea49 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:35.163944 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2527/5025] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:35.169130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.169714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.170266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.170908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.173649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.195576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:35.197494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.319428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2499/5026] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:35.321251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.326924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e898-145e-449e-800b-e69c190f3b68 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.331268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.335387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.336633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.337349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.337700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.339173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.341584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.348039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1b33-bf8b-41a7-8694-bfb7c6dae455 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.357309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.358517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.359046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.359674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] PATH_INFO: `/v3/projects/ebd5f213bf0249daa7372257d6686260` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.363639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd5f213bf0249daa7372257d6686260)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.365100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.377418 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2528/5027] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:35.378765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.382189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.438055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:35.452338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd5f213bf0249daa7372257d6686260', 'request_id': 'req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.464480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd5f213bf0249daa7372257d6686260', 'request_id': 'req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.472821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd5f213bf0249daa7372257d6686260', 'request_id': 'req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.486460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:35.503210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] The token cache is being invalidate because project ebd5f213bf0249daa7372257d6686260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:35.503839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.505013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:35.506387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887376-50d1-45f3-8833-f1f3e679acd2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.507779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2500/5028] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:35 2022] DELETE /identity/v3/projects/ebd5f213bf0249daa7372257d6686260 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:35.508792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.511041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.605320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.606520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.606857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.607272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.608672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c4d9-2d3f-41dd-902b-3cc9ca0cbb76 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.610767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.626872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.628181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.628468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.629365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.630112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.636397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.643155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.645763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45114-897e-4095-875d-78342717ce75 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.660123 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2529/5029] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:35.661561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d69-204c-4c27-b8cb-38c61f573d75 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.661856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d69-204c-4c27-b8cb-38c61f573d75 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.662139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183d69-204c-4c27-b8cb-38c61f573d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.666109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2501/5030] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:35.670660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.698489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772a7b-8f15-46a8-a960-8a25cc03159b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.700416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b0183d69-204c-4c27-b8cb-38c61f573d75 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:35.703059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0183d69-204c-4c27-b8cb-38c61f573d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.709219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.710246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.710566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.710848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.711583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.714901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.733177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2530/5031] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:35.735641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.736023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.736309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.746404 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2502/5032] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:35.754217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.779028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4dca9-3807-4089-a0bc-d1e404b29658 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.784325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:35.787927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:35.793717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.794543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.794831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.795111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] PATH_INFO: `/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/4143bfb3999f4f8983f0b412c22b1756/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.817342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2531/5033] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:35.821737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.839770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5926ca9a1bf417892c6e23f505aeb7d, user_id=4143bfb3999f4f8983f0b412c22b1756, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.844097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526483b3-336a-4ac0-9d4d-86aea64ea606 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.845535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e92d-bfc5-4e26-beef-e28638f2e70e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.852392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:35.854102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.854748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.854748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.856945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:35.857691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:35.860004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:35.870478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2503/5034] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:35 2022] PUT /identity/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/4143bfb3999f4f8983f0b412c22b1756/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:35.882174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:35.882631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:35.883225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:35.893129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2532/5035] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:35.896253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:35.926840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2084f6d-c163-46e5-bcf1-bf9e10232fe2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:35.934483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] MFA Rules not processed for user `4143bfb3999f4f8983f0b412c22b1756`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:35.936022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:36.061526 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2504/5036] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:36.066463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.100117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:36.120582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.121722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.122840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.123282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.124240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.130325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.207873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2533/5037] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:35 2022] POST /identity/v3/projects => generated 361 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:36.214700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.242520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7bae5-2388-4026-a0eb-87771bdb6c25 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.392383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.393330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.393420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.393990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.395767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.398413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.408865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42115a-0f2b-48c7-9bf1-05300b9bcbab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.419548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.420917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.421197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.421474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.422149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.424236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.449375 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2505/5038] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:36 2022] POST /identity/v3/projects => generated 369 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:36.450562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:36.454217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.479111 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2534/5039] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:36 2022] POST /identity/v3/users => generated 281 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:36.480112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.503831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a8d7f-7c1b-4351-8f1e-1955ee0c6687 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.577087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1981cf-26b0-4c61-a33e-9829fbb36e9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.583144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.583996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.584280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.584596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.585600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.588070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.623166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2506/5040] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:36 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:36.631775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.633075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.634021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.634766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.635333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.636349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.640492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.670891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2535/5041] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:36.677064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.680993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee177-cc2f-4261-8142-12bc40888194 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.691720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8702fb-a2eb-4f95-9dca-727ae2ac6579 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.700000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.701804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.702119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.703266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.704979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.706104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.706828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.707297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.707753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.708749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.709356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.712372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.732686 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2507/5042] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:36.732939 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2536/5043] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:36.736651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.738059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.750296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512f4bb-0f80-4c1d-935d-2543600f5458 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.751898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543cfdb-f0e4-4e93-a309-f85eae987850 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.758777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.760487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.761251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.761449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.761989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] PATH_INFO: `/v3/projects/35bb0d6427c84f18830b60ae1cdb1198/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.762862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.763896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.764253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] PATH_INFO: `/v3/projects/a90f0c193af847c29066b3d9ff65b8b5/users/50fe142220f4467abf69374646c5220f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.789217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90f0c193af847c29066b3d9ff65b8b5, user_id=50fe142220f4467abf69374646c5220f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.792342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b246a6-dc84-4385-aa5e-167eb61bf965 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.798928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bb0d6427c84f18830b60ae1cdb1198, user_id=99d98e776bae4344aff64467b0690fbd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.808878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.822261 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2537/5044] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:36 2022] PUT /identity/v3/projects/a90f0c193af847c29066b3d9ff65b8b5/users/50fe142220f4467abf69374646c5220f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:36.840723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.840723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.841172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:36.841556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.849543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2508/5045] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:36 2022] PUT /identity/v3/projects/35bb0d6427c84f18830b60ae1cdb1198/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:36.854200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.878505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] MFA Rules not processed for user `50fe142220f4467abf69374646c5220f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:36.880105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:36.957907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c2c9-5eea-4437-9b52-0107aa8be5ba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:36.965141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:36.969497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:36.969859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:36.971472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:36.972520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:36.974377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:36.991077 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2509/5046] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:36.993176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:36.997914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.007993 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2538/5047] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:37.009257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:37.031268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7b1e-3e96-4be0-be98-6047cbb911e8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:37.044836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263b04-0b02-4144-b068-ce54b6450ca9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:37.047762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:37.048754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.049036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.049343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] PATH_INFO: `/v3/projects/eb400da5a98a4db5b56a37371e4a50a6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.051005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb400da5a98a4db5b56a37371e4a50a6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:37.054278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:37.059232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:37.060152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.060450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.060803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] PATH_INFO: `/v3/projects/35bb0d6427c84f18830b60ae1cdb1198/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.067037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bb0d6427c84f18830b60ae1cdb1198, user_id=99d98e776bae4344aff64467b0690fbd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:37.075105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:37.110119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2539/5048] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:37 2022] PUT /identity/v3/projects/35bb0d6427c84f18830b60ae1cdb1198/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:37.122452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:37.128637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.153184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb400da5a98a4db5b56a37371e4a50a6', 'request_id': 'req-b05350b8-a126-4c13-ae77-010a4961da06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.166605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb400da5a98a4db5b56a37371e4a50a6', 'request_id': 'req-b05350b8-a126-4c13-ae77-010a4961da06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.177625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb400da5a98a4db5b56a37371e4a50a6', 'request_id': 'req-b05350b8-a126-4c13-ae77-010a4961da06'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.198749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:37.203177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] The token cache is being invalidate because project eb400da5a98a4db5b56a37371e4a50a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:37.203772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.205278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b05350b8-a126-4c13-ae77-010a4961da06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.207127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2510/5049] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:36 2022] DELETE /identity/v3/projects/eb400da5a98a4db5b56a37371e4a50a6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:37.240324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6631-53d8-445d-91de-00af97cfc3aa None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.241015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6631-53d8-445d-91de-00af97cfc3aa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.242396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e6631-53d8-445d-91de-00af97cfc3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.260162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb0834-37f6-4195-82bb-53414a45cb06 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:37.359473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b66e6631-53d8-445d-91de-00af97cfc3aa None None] MFA Rules not processed for user `99d98e776bae4344aff64467b0690fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:37.375492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b66e6631-53d8-445d-91de-00af97cfc3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.394218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:37.395160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.395987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.396624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.398715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.502038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2511/5050] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:37.510818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.511152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.511847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.528415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:37.531034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:37.532676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:37.553871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:37.555794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.568390 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2540/5051] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:37.574557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:37.576118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.669518 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2512/5052] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:37.671696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:37.673453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.693869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee617cd-ce7c-443c-9b85-474b4b8f6d39 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:37.694211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14637bde-ea38-43b8-8564-7f098561e063 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:37.702358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:37.703677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.704174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.704609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.705426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:37.707863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f95d-7e4e-439b-9f1c-c03b0f547566 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:37.708001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:37.709963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.711082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.711603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] PATH_INFO: `/v3/users/50fe142220f4467abf69374646c5220f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.714149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fe142220f4467abf69374646c5220f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:37.716532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:37.790835 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2541/5053] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:37.798974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db643a-34e3-4bd1-9cae-13c50af8d584 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.799328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db643a-34e3-4bd1-9cae-13c50af8d584 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.799577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db643a-34e3-4bd1-9cae-13c50af8d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:37.841729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fe142220f4467abf69374646c5220f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.853787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-90db643a-34e3-4bd1-9cae-13c50af8d584 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:37.855023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fe142220f4467abf69374646c5220f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.857803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-90db643a-34e3-4bd1-9cae-13c50af8d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.882764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fe142220f4467abf69374646c5220f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.883841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fe142220f4467abf69374646c5220f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.884790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fe142220f4467abf69374646c5220f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:37.890347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:37.909460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2513/5054] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:37 2022] DELETE /identity/v3/users/50fe142220f4467abf69374646c5220f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:37.911327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:37.914018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:37.964305 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2542/5055] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:37.966155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:37.966649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:37.967037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.001770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:38.003382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:38.034345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871279cd-b0dd-4098-9f98-7cb782422351 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.041065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.041773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.042062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.042342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.043834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.046457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.087174 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2514/5056] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:38.088151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.101071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a4ae-bea1-46ca-9936-a2a813acc0ed admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.107544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.108212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.108590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.109182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.110722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:38.111037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.113142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.115119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2543/5057] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:38.116572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.118637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:38.130119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7695e-0e03-4d16-befa-52b1397689e7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.138973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.139982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.140410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.140763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.142019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.145109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.146414 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2515/5058] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:38.148821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.151520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:38.171639 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2544/5059] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:38.172803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.187893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc60a-d129-4b91-8dbf-54d5eb9abcb6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.195679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.197002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.197523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.200000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.200881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.203945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.243205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a0804-d13c-4278-8046-1396a2683b00 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.249305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.250425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.251038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.251603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.265821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.269023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.283465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2516/5060] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:38.284854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.295106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2545/5061] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:38 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:38.299105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.318253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690451c-97d3-4802-bc14-e64ed6001f2e service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.448495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.450456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.450967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.451535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.453112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.453407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1346ae-8b1d-4fef-a94d-e565568da7e6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.457266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.460085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.461313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.461640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.462791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.463505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.465694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.473875 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2517/5062] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:38.479191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.493550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ed4f-a49a-4482-9e97-666625d1e448 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.500722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.502438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.507701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2546/5063] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:38 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:38.512283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.512735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.513279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] PATH_INFO: `/v3/projects/b26ead37a58141ac93fdc2da7f36326a/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.532679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26ead37a58141ac93fdc2da7f36326a, user_id=4fe1593cfa7946e2b98e6f06891a30ea, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.535879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212254-0c6b-4eb2-adc2-49a93a1db934 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.536991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aecad5-f65e-4837-9ea4-33b688e00da0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.547612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.549055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.549750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.550061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.551271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.553821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.569243 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2518/5064] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:38 2022] PUT /identity/v3/projects/b26ead37a58141ac93fdc2da7f36326a/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:38.571835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.572524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.573019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.598129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2547/5065] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:38.602657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.616337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e775-92c9-42c5-b744-c9a589385ea9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.628795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] MFA Rules not processed for user `4fe1593cfa7946e2b98e6f06891a30ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:38.630738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:38.633554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:38.739336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.740645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.741213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.741669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.742888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.745279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.763630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2548/5066] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:38.769795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.789525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:38.797237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5cd2-5a19-47a5-b990-39296bb50d43 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.805815 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2519/5067] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:38.807260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:38.809296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:38.811065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:38.812716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.813076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.813492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] PATH_INFO: `/v3/projects/ad6090a9a7c9488ba44277ab6fbf40aa/users/9d87994650a141c1b3dcefbaa3a2954f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.845500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6090a9a7c9488ba44277ab6fbf40aa, user_id=9d87994650a141c1b3dcefbaa3a2954f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:38.850383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb15ff-4311-4095-bc4d-ee62ef0ace8b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:38.876809 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2549/5068] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:38 2022] PUT /identity/v3/projects/ad6090a9a7c9488ba44277ab6fbf40aa/users/9d87994650a141c1b3dcefbaa3a2954f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:38.879442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:38.879737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:38.880033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:38.912397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7027-96a4-4e50-ac27-9e46602d5df1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:38.930336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:38.931846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.008978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.009689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.010028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.010314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.011541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.013476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.040305 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2520/5069] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:11:38 2022] POST /identity/v3/domains => generated 277 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:39.041200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.047022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.059776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2550/5070] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:39.061193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.079043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f2fa-666d-4115-ab0a-3c5b4c0b4bb0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.160845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204bb0-c3ed-4df1-8c07-76de906a1b71 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.169594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.171295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.171614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.171988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.172500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] PATH_INFO: `/v3/projects/a90f0c193af847c29066b3d9ff65b8b5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.172695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.173163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.174517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90f0c193af847c29066b3d9ff65b8b5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.174722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.176553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.177868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.179255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.204385 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2551/5071] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/roles => generated 240 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:39.205306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.211541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.263693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:39.264887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:39.279576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90f0c193af847c29066b3d9ff65b8b5', 'request_id': 'req-6d429c7f-e730-4c9e-833a-f6e685a44ec1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:39.296997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90f0c193af847c29066b3d9ff65b8b5', 'request_id': 'req-6d429c7f-e730-4c9e-833a-f6e685a44ec1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:39.307973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90f0c193af847c29066b3d9ff65b8b5', 'request_id': 'req-6d429c7f-e730-4c9e-833a-f6e685a44ec1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:39.317406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e468f-65d8-4710-b095-ecb2d64c8829 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.324523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] The token cache is being invalidate because project a90f0c193af847c29066b3d9ff65b8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:39.324963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:39.325825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:39.328400 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2521/5072] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:39 2022] DELETE /identity/v3/projects/a90f0c193af847c29066b3d9ff65b8b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:39.329611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.332982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.390321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.390545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.390657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.391131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.393406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.458163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429c7f-e730-4c9e-833a-f6e685a44ec1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.465677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.467080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.467413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.468332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/24c537335d944ce9be6eddd023faf4c3/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/e09ae2fc27b14d31ad67f29f86ab2d37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.492407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=24c537335d944ce9be6eddd023faf4c3, user_id=4fe1593cfa7946e2b98e6f06891a30ea, role_id=e09ae2fc27b14d31ad67f29f86ab2d37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.495649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d92f1-7a74-4736-9b0c-3ddd50b125ba tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.521287 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2522/5073] 10.222.0.39 () {60 vars in 1479 bytes} [Sat Jun 25 21:11:39 2022] PUT /identity/v3/domains/24c537335d944ce9be6eddd023faf4c3/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/e09ae2fc27b14d31ad67f29f86ab2d37 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:39.523209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403349-e533-423b-94f8-010e4827cad8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.523631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403349-e533-423b-94f8-010e4827cad8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.523794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.524331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae403349-e533-423b-94f8-010e4827cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.525953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.541564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2552/5074] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:39.542490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.548165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ae403349-e533-423b-94f8-010e4827cad8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:39.549835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae403349-e533-423b-94f8-010e4827cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.558760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c1ae-2a74-466a-8912-d0d11ed9bc2b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.665966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.674817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.675190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.675592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.677092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.679024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.685992 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2523/5075] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:39.695693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.696696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.696696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.724868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:39.726112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2553/5076] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/domains => generated 277 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:39.730165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:39.731322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.784855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:39.855062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:39.875072 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2524/5077] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:39.882442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.885580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa38fa6-a645-4c67-938d-4af10ed3f46e tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.895829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7e5f3-45ff-41f0-8a1d-2fa0a01b9715 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.899858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.900727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.901141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.902099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.902895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.903265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.903686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.904167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.904567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.905051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.905546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:39.906270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.908510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.929637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2525/5078] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:39.935080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.939157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2554/5079] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/roles => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:39.940130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:39.952344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b334-57bf-4c28-bb01-98e2704a05ff tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.953283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492ee27-ca2f-40ea-a83d-c884d445ee7c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:39.959184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.959895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.960151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:39.960397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.960540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.961203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.961392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:39.962379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:39.962619 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:39.962619 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:11:39.962619 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:11:39.963404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:39.964207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:39.964361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:39.967754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.017443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2526/5080] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:40.019459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.024882 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2555/5081] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:11:39 2022] POST /identity/v3/groups => generated 327 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:40.026906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.052660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfaeb-daa3-42c5-ae7e-c7169d36b82d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.153950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d350f0-4e33-4458-8721-0ed04eb22a42 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.160874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.162040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.162470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.162946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.163941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.166472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.203903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2527/5082] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:40 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:40.205747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.224516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3e81-85f7-48e9-a1b6-894414820693 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.231170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.232135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.232862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.232862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.233611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.235768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.242786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.243748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.244043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.244329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5/users/4fe1593cfa7946e2b98e6f06891a30ea` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.249998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2528/5083] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:40 2022] GET /identity/v3/roles => generated 1882 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:40.254913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.261274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6b7c464308aa4c8e8d868b7c14e37af5, user_id=4fe1593cfa7946e2b98e6f06891a30ea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.261274 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:40.261274 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:11:40.261274 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:11:40.262335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.269107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78827-f6a2-4d4a-b769-24f253b1dba4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.274904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.276628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.278052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.278342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.279242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.282004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.303390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2529/5084] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:40 2022] GET /identity/v3/roles => generated 1882 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:40.305305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.318508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c83ca-75c0-4d3a-8e38-80db2a4b7bb7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.332037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2556/5085] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:11:40 2022] PUT /identity/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5/users/4fe1593cfa7946e2b98e6f06891a30ea => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:40.336495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.393095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.394605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.395175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.395456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] PATH_INFO: `/v3/projects/0f5181b01bbc4eb8b3a64d503bc5fa9d/users/9a1c6426288240e7b3d9a44f49b74e19/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.429974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5181b01bbc4eb8b3a64d503bc5fa9d, user_id=9a1c6426288240e7b3d9a44f49b74e19, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.435764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c78470-beb7-46b0-86e1-6180baa6a3aa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.450327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facddea8-8bc8-470d-9aaa-964ab637078c tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.469175 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2530/5086] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:40 2022] PUT /identity/v3/projects/0f5181b01bbc4eb8b3a64d503bc5fa9d/users/9a1c6426288240e7b3d9a44f49b74e19/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:40.476374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.476797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.477629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.490729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:40.523023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:40.554000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] MFA Rules not processed for user `9a1c6426288240e7b3d9a44f49b74e19`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:40.556994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:40.571594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.573603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.573989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.574376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e/groups/6b7c464308aa4c8e8d868b7c14e37af5/roles/9a696d6d10fe480f884b03ab9b4e1244` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.577913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=aea75ef5fdfe4726a4357b1ea01e472e, group_id=6b7c464308aa4c8e8d868b7c14e37af5, role_id=9a696d6d10fe480f884b03ab9b4e1244)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.582478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.615789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2557/5087] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:40 2022] PUT /identity/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e/groups/6b7c464308aa4c8e8d868b7c14e37af5/roles/9a696d6d10fe480f884b03ab9b4e1244 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:40.621986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.766057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2531/5088] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:40.773118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.775031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:40.795071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec330-f89d-471a-b1a5-9ab22d93e260 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.814412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.815149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.815459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.815741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.816563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.818264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.851739 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2558/5089] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:11:40 2022] POST /identity/v3/domains => generated 276 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:40.857203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:40.937220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e56ed-937b-461d-b181-f574efb60f57 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.949050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b233d-aba6-4dcf-95a5-abaf04d1f967 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:40.956086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:40.957269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:40.958057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:40.958583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:40.959835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:40.962802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:40.988064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2559/5090] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:11:40 2022] POST /identity/v3/roles => generated 238 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:40.993724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.010226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.010951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.011243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.011559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.011930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f6fc-608f-44e0-83a0-26f4e44c63a6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.019778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.021819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.022241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.022613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/bba8d210c3dd4c10b1bd668824211b92/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/5a58afa9943f40cebcb792d1bce57a7b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.046997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bba8d210c3dd4c10b1bd668824211b92, user_id=4fe1593cfa7946e2b98e6f06891a30ea, role_id=5a58afa9943f40cebcb792d1bce57a7b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.053053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.082340 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2560/5091] 10.222.0.39 () {60 vars in 1479 bytes} [Sat Jun 25 21:11:40 2022] PUT /identity/v3/domains/bba8d210c3dd4c10b1bd668824211b92/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/5a58afa9943f40cebcb792d1bce57a7b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:41.087905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.107512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.109831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.123122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2532/5092] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:11:41.131932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:41.195563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a887f3f-a284-4700-80ae-5ec26ad470ee tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.204678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.205502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.205873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.206150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.207110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.209240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.244157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.253050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2561/5093] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:11:41 2022] POST /identity/v3/domains => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:11:41.258447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ca329-b108-42cb-b628-440b6d207e44 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.272318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:41.418576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.419282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.422650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.422969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.427389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.435074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.482143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.486371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2533/5094] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:11:41 2022] POST /identity/v3/roles => generated 239 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:41.531218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d94f-4d3e-49a0-b4e9-0af338671e33 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.554277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.560759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.562047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.563823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.565876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.573763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.669948 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2562/5095] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:11:41 2022] POST /identity/v3/groups => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:41.675830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.688920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658ab7-5852-41f7-8ef2-fb7d20ec3453 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.721278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.722269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.722559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.722833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/8dfaaa7086324681bb583c1fd608ea52/users/4fe1593cfa7946e2b98e6f06891a30ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.735448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8dfaaa7086324681bb583c1fd608ea52, user_id=4fe1593cfa7946e2b98e6f06891a30ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.738264 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:41.738264 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:11:41.738264 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:11:41.742701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:41.823454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:41.824039 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2534/5096] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:11:41 2022] PUT /identity/v3/groups/8dfaaa7086324681bb583c1fd608ea52/users/4fe1593cfa7946e2b98e6f06891a30ea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:41.839120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c88d30-998e-4af9-ae46-b36d13265c4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:41.984177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:41.985921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:41.986495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:41.986847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/6cc87c94be6a45bdbcd6d76633040889/groups/8dfaaa7086324681bb583c1fd608ea52/roles/4d797e0df5f3456e949d4948a823692d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:41.991184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6cc87c94be6a45bdbcd6d76633040889, group_id=8dfaaa7086324681bb583c1fd608ea52, role_id=4d797e0df5f3456e949d4948a823692d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:41.994552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:42.054964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2563/5097] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:41 2022] PUT /identity/v3/domains/6cc87c94be6a45bdbcd6d76633040889/groups/8dfaaa7086324681bb583c1fd608ea52/roles/4d797e0df5f3456e949d4948a823692d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:42.059440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:42.062198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:42.319178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d784e8-fdb7-4796-b87b-b40bb4702746 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:42.464625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:42.524825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe1593cfa7946e2b98e6f06891a30ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b26ead37a58141ac93fdc2da7f36326a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:42.525921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:42.526359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:42.526665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] PATH_INFO: `/v3/auth/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:42.527543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:42.528818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:42.659610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2535/5098] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 21:11:42 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 601 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:11:42.664046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:42.807264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24fde-597d-4662-9599-815e52987535 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:42.821561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:42.824200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:42.824793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:42.826893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/6cc87c94be6a45bdbcd6d76633040889/groups/8dfaaa7086324681bb583c1fd608ea52/roles/4d797e0df5f3456e949d4948a823692d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:42.836515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6cc87c94be6a45bdbcd6d76633040889, group_id=8dfaaa7086324681bb583c1fd608ea52, role_id=4d797e0df5f3456e949d4948a823692d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:42.838353 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:42.838353 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:11:42.838353 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:11:42.841593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:42.853487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 4d797e0df5f3456e949d4948a823692d was removed from group 8dfaaa7086324681bb583c1fd608ea52 on domain 6cc87c94be6a45bdbcd6d76633040889. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:42.853817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:42.854789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:42.880965 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2564/5099] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:11:42 2022] DELETE /identity/v3/domains/6cc87c94be6a45bdbcd6d76633040889/groups/8dfaaa7086324681bb583c1fd608ea52/roles/4d797e0df5f3456e949d4948a823692d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:42.884755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:42.889625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:42.916778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954450c-d18b-417a-bdda-cb89c218f13d tempest-TokensV3TestJSON-608063519 tempest-TokensV3TestJSON-608063519-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:43.056847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:43.059416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:43.059715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:43.060004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/8dfaaa7086324681bb583c1fd608ea52/users/4fe1593cfa7946e2b98e6f06891a30ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:43.062144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8dfaaa7086324681bb583c1fd608ea52, user_id=4fe1593cfa7946e2b98e6f06891a30ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:43.065003 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:43.065003 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:11:43.065003 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:11:43.067720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:43.085392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:43.110115 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2536/5100] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:11:42 2022] DELETE /identity/v3/groups/8dfaaa7086324681bb583c1fd608ea52/users/4fe1593cfa7946e2b98e6f06891a30ea => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:43.114835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:43.128223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85525-cd3d-4a8c-b709-ae296cf8ac02 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:43.162789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:43.251355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:43.252655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:43.253656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:43.254154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/8dfaaa7086324681bb583c1fd608ea52` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:43.258314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8dfaaa7086324681bb583c1fd608ea52)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:43.259562 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:43.259562 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:11:43.259562 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:11:43.261432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:43.413514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2565/5101] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:11:43 2022] DELETE /identity/v3/groups/8dfaaa7086324681bb583c1fd608ea52 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:43.414427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:43.427160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bfa97-77b0-4cb3-b38a-fa8a83d546cf tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:43.524730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:43.526253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:43.546527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:43.547495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles/4d797e0df5f3456e949d4948a823692d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:43.553479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d797e0df5f3456e949d4948a823692d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:43.559087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:43.577043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:43.674031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 4d797e0df5f3456e949d4948a823692d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:43.674263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:43.674980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:43.682112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:43.683550 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2537/5102] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:43 2022] DELETE /identity/v3/roles/4d797e0df5f3456e949d4948a823692d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:43.684819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:43.711101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d557be-615c-4815-821d-e7568b54ee10 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:43.868910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:43.869852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:43.870305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:43.870746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/6cc87c94be6a45bdbcd6d76633040889` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:43.872688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6cc87c94be6a45bdbcd6d76633040889)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:43.874707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:43.929558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:43.931224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.019405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.021114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.030016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:44.032528 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2566/5103] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:43 2022] PATCH /identity/v3/domains/6cc87c94be6a45bdbcd6d76633040889 => generated 276 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:44.049048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb7d66-a02c-464c-a851-7b0a457b2125 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:44.213767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:44.217032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:44.224778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:44.224991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/6cc87c94be6a45bdbcd6d76633040889` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:44.255463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6cc87c94be6a45bdbcd6d76633040889)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:44.260567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:44.329322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.334069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.427160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.446598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.473693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.506017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project 6cc87c94be6a45bdbcd6d76633040889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:44.506560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.507529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.523336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.528683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.530284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6cc87c94be6a45bdbcd6d76633040889', 'request_id': 'req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.544403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2538/5104] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:11:44 2022] DELETE /identity/v3/domains/6cc87c94be6a45bdbcd6d76633040889 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:44.548870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:44.550915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:44.643291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe2e5-cd36-4aee-a6be-f0b93b231f83 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:44.653115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:44.807971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:44.809002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:44.809248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:44.809529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/bba8d210c3dd4c10b1bd668824211b92/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/5a58afa9943f40cebcb792d1bce57a7b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:44.817027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bba8d210c3dd4c10b1bd668824211b92, user_id=4fe1593cfa7946e2b98e6f06891a30ea, role_id=5a58afa9943f40cebcb792d1bce57a7b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:44.824590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:44.837730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 5a58afa9943f40cebcb792d1bce57a7b was removed from user 4fe1593cfa7946e2b98e6f06891a30ea on domain bba8d210c3dd4c10b1bd668824211b92. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:44.838032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.838971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:44.862353 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2567/5105] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Jun 25 21:11:44 2022] DELETE /identity/v3/domains/bba8d210c3dd4c10b1bd668824211b92/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/5a58afa9943f40cebcb792d1bce57a7b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:44.866394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:44.868362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:44.876762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:44.915821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:44.917360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:44.924699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e828-91ec-464f-8dd0-84e9e5a7ecb9 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.098157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.100022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.102418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.102680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles/5a58afa9943f40cebcb792d1bce57a7b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.106902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a58afa9943f40cebcb792d1bce57a7b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.109691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.118231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e54-a16c-467b-8930-3a7293bd86d6 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.126611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.127777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.128237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.128707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] PATH_INFO: `/v3/users/9a1c6426288240e7b3d9a44f49b74e19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.130287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1c6426288240e7b3d9a44f49b74e19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.133730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.158721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 5a58afa9943f40cebcb792d1bce57a7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:45.159222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.160345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.166203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2539/5106] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:44 2022] DELETE /identity/v3/roles/5a58afa9943f40cebcb792d1bce57a7b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:45.167982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:45.170008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:45.212253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1c6426288240e7b3d9a44f49b74e19'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.213357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1c6426288240e7b3d9a44f49b74e19'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.225706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1c6426288240e7b3d9a44f49b74e19'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.265713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1c6426288240e7b3d9a44f49b74e19'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.281327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba7f7-e187-4c7a-87f7-c19aaa2923d1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.300194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a99b70c-603a-4ee7-b433-a092a496177d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1c6426288240e7b3d9a44f49b74e19'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.300338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.301108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.301582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.301928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/bba8d210c3dd4c10b1bd668824211b92` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.303868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bba8d210c3dd4c10b1bd668824211b92)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.306331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.315585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:45.331766 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2568/5107] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:44 2022] DELETE /identity/v3/users/9a1c6426288240e7b3d9a44f49b74e19 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:45.338583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.340113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.341075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.366480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.367626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.388267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:45.389746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:45.425495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.426131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.429939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2540/5108] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:45 2022] PATCH /identity/v3/domains/bba8d210c3dd4c10b1bd668824211b92 => generated 277 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:45.444879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:45.446982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:45.476764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:45.559778 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2569/5109] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:11:45.570253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:45.572776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:45.602654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69688-77c0-42b6-a327-0cc8fec8a8df tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.608673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.609672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.610095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.610784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/bba8d210c3dd4c10b1bd668824211b92` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.625298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bba8d210c3dd4c10b1bd668824211b92)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.628761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.664847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.675366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.689181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6f538-bf83-4d4b-88c6-f7189b5c5d94 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.693860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.694853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.695228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.695600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.721022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.723017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.738302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2570/5110] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:45.751763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.764341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.776995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.797566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project bba8d210c3dd4c10b1bd668824211b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:45.797835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.798889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.837954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.842534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.843342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bba8d210c3dd4c10b1bd668824211b92', 'request_id': 'req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.852271 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2541/5111] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:11:45 2022] DELETE /identity/v3/domains/bba8d210c3dd4c10b1bd668824211b92 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:45.857543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:45.872214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c46d7f-8ac5-4efe-b2ab-5a1472ce4d2b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:45.963988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:45.965656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:45.966461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:45.966878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e/groups/6b7c464308aa4c8e8d868b7c14e37af5/roles/9a696d6d10fe480f884b03ab9b4e1244` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:45.970914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=aea75ef5fdfe4726a4357b1ea01e472e, group_id=6b7c464308aa4c8e8d868b7c14e37af5, role_id=9a696d6d10fe480f884b03ab9b4e1244)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:45.975513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:45.984513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 9a696d6d10fe480f884b03ab9b4e1244 was removed from group 6b7c464308aa4c8e8d868b7c14e37af5 on domain aea75ef5fdfe4726a4357b1ea01e472e. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:45.985004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:45.985957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.009031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2571/5112] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:11:45 2022] DELETE /identity/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e/groups/6b7c464308aa4c8e8d868b7c14e37af5/roles/9a696d6d10fe480f884b03ab9b4e1244 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:46.015237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.017395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:46.038873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1540f-5eb9-4fce-a4ee-bd4edf010f46 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:46.199172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:46.238349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:46.239940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:46.239940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:46.240943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5/users/4fe1593cfa7946e2b98e6f06891a30ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:46.244854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6b7c464308aa4c8e8d868b7c14e37af5, user_id=4fe1593cfa7946e2b98e6f06891a30ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:46.248227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:46.259509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.287281 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2542/5113] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:11:46 2022] DELETE /identity/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5/users/4fe1593cfa7946e2b98e6f06891a30ea => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:46.291601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.294662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:46.315283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256d38c-8e6d-4a4f-8ec1-d5949afe8aec tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:46.360562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:46.418957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:46.419851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:46.420251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:46.420586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:46.422133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6b7c464308aa4c8e8d868b7c14e37af5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:46.424930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:46.502617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2572/5114] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:11:46 2022] DELETE /identity/v3/groups/6b7c464308aa4c8e8d868b7c14e37af5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:46.508904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.523859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e004ae-79e0-4ac6-b4b9-57823c54dd0f tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:46.607490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:46.608737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:46.609086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:46.609440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles/9a696d6d10fe480f884b03ab9b4e1244` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:46.611885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9a696d6d10fe480f884b03ab9b4e1244)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:46.614104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:46.666235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 9a696d6d10fe480f884b03ab9b4e1244 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:46.666824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.667514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.669518 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2543/5115] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:46 2022] DELETE /identity/v3/roles/9a696d6d10fe480f884b03ab9b4e1244 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:46.674333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.676602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:46.698295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29782-6569-4281-b363-2b0571313632 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:46.763949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:46.765064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.767564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:46.768816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:46.770689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:46.771618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:46.777111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aea75ef5fdfe4726a4357b1ea01e472e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:46.783586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:46.865702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.866661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.917844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.918561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:46.938579 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2573/5116] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:46 2022] PATCH /identity/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e => generated 278 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:11:46.939664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:46.942619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:46.976303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a92e31-2347-476c-bfb9-8dc5bd14ee6d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:47.035429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:47.044184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b29b9-c5bc-41da-9631-ccfb0e74d0bb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:47.063914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:47.065594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.067989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.068558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] PATH_INFO: `/v3/projects/0f5181b01bbc4eb8b3a64d503bc5fa9d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.070115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5181b01bbc4eb8b3a64d503bc5fa9d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:47.070829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:47.078310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:47.090062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:47.091488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.091825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.092183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] PATH_INFO: `/v3/users/bee65f1c37764bdb9985b4e96a97ce9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.094476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee65f1c37764bdb9985b4e96a97ce9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:47.098614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:47.180018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5181b01bbc4eb8b3a64d503bc5fa9d', 'request_id': 'req-d8238853-d5f7-449c-99e9-1ce3bf13519c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.193162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5181b01bbc4eb8b3a64d503bc5fa9d', 'request_id': 'req-d8238853-d5f7-449c-99e9-1ce3bf13519c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.199669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee65f1c37764bdb9985b4e96a97ce9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.210975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5181b01bbc4eb8b3a64d503bc5fa9d', 'request_id': 'req-d8238853-d5f7-449c-99e9-1ce3bf13519c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.216786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee65f1c37764bdb9985b4e96a97ce9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.229403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] The token cache is being invalidate because project 0f5181b01bbc4eb8b3a64d503bc5fa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:47.229720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.230735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.233339 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2574/5117] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:46 2022] DELETE /identity/v3/projects/0f5181b01bbc4eb8b3a64d503bc5fa9d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:47.233992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:47.236020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.257049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee65f1c37764bdb9985b4e96a97ce9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.258581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee65f1c37764bdb9985b4e96a97ce9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.260718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5474dd45-0351-42d8-a596-6de15e26011d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee65f1c37764bdb9985b4e96a97ce9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.285585 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2544/5118] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:46 2022] DELETE /identity/v3/users/bee65f1c37764bdb9985b4e96a97ce9e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:47.285585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eccba3-b699-4d05-ba0b-1e1176e2311e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.297504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eccba3-b699-4d05-ba0b-1e1176e2311e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.297832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eccba3-b699-4d05-ba0b-1e1176e2311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.347550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a1eccba3-b699-4d05-ba0b-1e1176e2311e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:47.350838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1eccba3-b699-4d05-ba0b-1e1176e2311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.395848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8238853-d5f7-449c-99e9-1ce3bf13519c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:47.526084 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2545/5119] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:47.534345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.534671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.535072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.578580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:47.582063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.596917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2546/5120] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:47.601111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:47.602622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.617152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f712c-c794-47a5-a14f-67a43b89f92c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:47.624232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:47.625882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.626274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.627194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] PATH_INFO: `/v3/projects/7cc291ebc8c64e32a229e9a993f517a9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.629625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc291ebc8c64e32a229e9a993f517a9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:47.631498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:47.632301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:47.633624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:47.634006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:47.634392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:47.653045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aea75ef5fdfe4726a4357b1ea01e472e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:47.655069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:47.691019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.694813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.696322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:47.721154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc291ebc8c64e32a229e9a993f517a9', 'request_id': 'req-2d81c1ae-007e-4010-b786-b69d48129a08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.730153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:47.738794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc291ebc8c64e32a229e9a993f517a9', 'request_id': 'req-2d81c1ae-007e-4010-b786-b69d48129a08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.752027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc291ebc8c64e32a229e9a993f517a9', 'request_id': 'req-2d81c1ae-007e-4010-b786-b69d48129a08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.772455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.786958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.789423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] The token cache is being invalidate because project 7cc291ebc8c64e32a229e9a993f517a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:47.789872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.790713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.792702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2547/5121] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:47 2022] DELETE /identity/v3/projects/7cc291ebc8c64e32a229e9a993f517a9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:47.797503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:47.799504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.804653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.822534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project aea75ef5fdfe4726a4357b1ea01e472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:47.822828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.823531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.834562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.841097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.842062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aea75ef5fdfe4726a4357b1ea01e472e', 'request_id': 'req-406d4eb1-2665-4a8e-a925-e47c3fc64793'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:47.856331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2575/5122] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:11:47 2022] DELETE /identity/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:47.859674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:47.862801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:47.930769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81c1ae-007e-4010-b786-b69d48129a08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:47.988335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d4eb1-2665-4a8e-a925-e47c3fc64793 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.000488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.001740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.002036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.003837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] PATH_INFO: `/v3/users/6412ea72fc614168a6498d20e6a26f3c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.007916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6412ea72fc614168a6498d20e6a26f3c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.009861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.030628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.031322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.031612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.032061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.032773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:48.033141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.034712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.058510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2548/5123] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:48.060372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.062572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.102128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6412ea72fc614168a6498d20e6a26f3c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.104133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6412ea72fc614168a6498d20e6a26f3c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.120984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6412ea72fc614168a6498d20e6a26f3c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.150550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79f21c-36ff-48ba-9ed8-3bf19bfd8a2e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.152249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6412ea72fc614168a6498d20e6a26f3c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.153953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:48.157488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.158481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.160129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.160514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/24c537335d944ce9be6eddd023faf4c3/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/e09ae2fc27b14d31ad67f29f86ab2d37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.162994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=24c537335d944ce9be6eddd023faf4c3, user_id=4fe1593cfa7946e2b98e6f06891a30ea, role_id=e09ae2fc27b14d31ad67f29f86ab2d37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.165009 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:11:48.165009 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:11:48.165009 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:11:48.168751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.171754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6412ea72fc614168a6498d20e6a26f3c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.180957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role e09ae2fc27b14d31ad67f29f86ab2d37 was removed from user 4fe1593cfa7946e2b98e6f06891a30ea on domain 24c537335d944ce9be6eddd023faf4c3. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:48.182021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.182786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.187709 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2576/5124] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:47 2022] DELETE /identity/v3/users/6412ea72fc614168a6498d20e6a26f3c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:48.194704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.201282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.208408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2549/5125] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Jun 25 21:11:48 2022] DELETE /identity/v3/domains/24c537335d944ce9be6eddd023faf4c3/users/4fe1593cfa7946e2b98e6f06891a30ea/roles/e09ae2fc27b14d31ad67f29f86ab2d37 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:48.213622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.218047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.246627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:48.333592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756200-8d82-4830-88d6-51662297edfd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.339304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.340601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.341414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.341414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles/e09ae2fc27b14d31ad67f29f86ab2d37` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.342711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e09ae2fc27b14d31ad67f29f86ab2d37)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.344751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.371930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2be14-21da-4de4-9660-5276f9d52157 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.400682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role e09ae2fc27b14d31ad67f29f86ab2d37 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:48.401407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.402252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.405938 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2550/5126] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:48 2022] DELETE /identity/v3/roles/e09ae2fc27b14d31ad67f29f86ab2d37 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:48.411146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.413741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.500000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.501043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.501604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.502050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.503852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.506718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.515182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b9340-cf3f-489e-9582-aee6548521e2 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.521541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.523338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.523731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.524127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/24c537335d944ce9be6eddd023faf4c3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.526214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=24c537335d944ce9be6eddd023faf4c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.529537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.564991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.566469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.570133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2577/5127] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:48 2022] POST /identity/v3/projects => generated 373 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:48.571512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.575338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.621593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.624225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.629954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2551/5128] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:48 2022] PATCH /identity/v3/domains/24c537335d944ce9be6eddd023faf4c3 => generated 278 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:48.634163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.637679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.741440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bbd49-c77b-4aa0-bc36-b1f10fadfafa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.753067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:48.786256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34964ab3-2af4-4f25-be50-bd66d5101b67 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.794481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.795087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:48.797190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.797754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.798371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/24c537335d944ce9be6eddd023faf4c3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.828082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=24c537335d944ce9be6eddd023faf4c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.830051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.862999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.863844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.864397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.864946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.865555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.865672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.868959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.870251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '24c537335d944ce9be6eddd023faf4c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.917427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2578/5129] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:48 2022] POST /identity/v3/users => generated 287 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:48.920792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:48.925201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:48.949759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba13a-422c-40f3-8ba0-6298af8ed835 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:48.956172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:48.957113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:48.957400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:48.957673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] PATH_INFO: `/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:48.959100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932c8bf8a22a43cab5d091b6dfa13ba4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:48.961436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:48.974304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.987619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:48.999708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.020258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project 24c537335d944ce9be6eddd023faf4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:49.021459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.023385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.039164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.042857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932c8bf8a22a43cab5d091b6dfa13ba4', 'request_id': 'req-669561c2-cc56-438c-998f-e98df62c8440'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.045439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.047390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '24c537335d944ce9be6eddd023faf4c3', 'request_id': 'req-8248fe73-c60e-4a70-80f7-64a186d9d3cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.053952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932c8bf8a22a43cab5d091b6dfa13ba4', 'request_id': 'req-669561c2-cc56-438c-998f-e98df62c8440'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.065403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932c8bf8a22a43cab5d091b6dfa13ba4', 'request_id': 'req-669561c2-cc56-438c-998f-e98df62c8440'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.068659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2552/5130] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:11:48 2022] DELETE /identity/v3/domains/24c537335d944ce9be6eddd023faf4c3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:49.069903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.071644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.087771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] The token cache is being invalidate because project 932c8bf8a22a43cab5d091b6dfa13ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:49.088135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.088969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.091086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2579/5131] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:48 2022] DELETE /identity/v3/projects/932c8bf8a22a43cab5d091b6dfa13ba4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:49.092103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.098528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.207888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248fe73-c60e-4a70-80f7-64a186d9d3cb tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.262590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:49.266872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669561c2-cc56-438c-998f-e98df62c8440 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.278101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.279744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.280035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.280314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.281096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.284850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952403-ce39-459a-8628-386f49b6b672 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.314381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2580/5132] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:49.314381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.314381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.314381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.339400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:49.339717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.340999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.341250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.341638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.342557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.342908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.345934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.358875 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2553/5133] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:49.359853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.374913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2581/5134] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:49.375244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc560-c8b0-4cc9-982d-6028955dd595 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.382258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.383910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.386723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.388252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.388656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.389189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.391688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b5926ca9a1bf417892c6e23f505aeb7d, user_id=99d98e776bae4344aff64467b0690fbd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.395094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8bcf-80e2-4abf-8a0e-035b9d655303 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.401446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd819-8f91-469c-9433-8ab3419ba4c1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.410290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.410990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.411273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.411551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.412513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.413751 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2554/5135] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:49 2022] PUT /identity/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:49.415166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.415629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.415978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.418426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.434367 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2582/5136] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:49.435224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.440187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:49.441753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.454680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20167276-c28a-4c02-8408-bd73e462e7be admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.505103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:49.542837 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2555/5137] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:49.547019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.558161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef7de-e541-4cf5-9c63-11cac3a7b8de None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.571470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.573428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.573826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.573940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.574137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] PATH_INFO: `/v3/projects/b05e14f0b76a41f88c1b7de024102aed/users/d84cb991e49d4b15909b91d8d37843ea/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.575137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.575639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.576093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.577654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.579225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c26ba7-5139-4f59-b3b7-395be588cc0a tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.598863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05e14f0b76a41f88c1b7de024102aed, user_id=d84cb991e49d4b15909b91d8d37843ea, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.601672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.625943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2556/5138] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:49 2022] PUT /identity/v3/projects/b05e14f0b76a41f88c1b7de024102aed/users/d84cb991e49d4b15909b91d8d37843ea/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:49.627783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.669664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2583/5139] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/auth/projects => generated 826 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:49.674927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ae16-fe2b-4a12-816e-bf55b0398975 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.674927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ae16-fe2b-4a12-816e-bf55b0398975 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.684179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ae16-fe2b-4a12-816e-bf55b0398975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.728060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b8d5-a89d-4023-958f-0144fa25f6b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.735410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-57d1ae16-fe2b-4a12-816e-bf55b0398975 None None] MFA Rules not processed for user `d84cb991e49d4b15909b91d8d37843ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:49.737157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-57d1ae16-fe2b-4a12-816e-bf55b0398975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.750651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.750651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.750651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.750651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.751218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:11:49.751218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.755722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.775006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2557/5140] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:11:49.776607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.848650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:49.852281 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2584/5141] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:49.854077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.856283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.856783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.890904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] MFA Rules not processed for user `9d87994650a141c1b3dcefbaa3a2954f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:49.892805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.920647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153148-fe96-4e99-9528-cfa426bdaf3f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:49.934327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:49.935665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:49.936016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:49.936372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:49.938564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b5926ca9a1bf417892c6e23f505aeb7d, user_id=99d98e776bae4344aff64467b0690fbd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:49.941591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:49.948486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 54803232909643ca80ca0cfb291c7f49 was removed from user 99d98e776bae4344aff64467b0690fbd on project b5926ca9a1bf417892c6e23f505aeb7d. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:49.949151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.949710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:49.969077 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2558/5142] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:11:49 2022] DELETE /identity/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d/users/99d98e776bae4344aff64467b0690fbd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:49.970538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.972154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:49.975451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:49.981570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2585/5143] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:49.982447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:49.983749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.071206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ec88f-f491-4c66-bfbf-69c399498da5 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.087035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.088159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.088555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.088990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.089194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22bc3e-114d-4130-bc69-cdf7df093437 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.089950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.092811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.136727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2559/5144] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:49 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.138201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.140247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.169786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.170427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.170762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.171039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.173672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.252669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a8780-ab51-43aa-9a7e-2fa25d02c3df admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.258340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.259031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.259356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.259622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.260499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.263044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.271009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.273596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.288393 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2586/5145] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:50.289814 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2560/5146] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/users => generated 321 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.289961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.290828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.291290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.307482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83a3f2-4a1c-4dfa-90b2-861cacf0c9d9 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.327120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:50.371075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be7a7-11cc-430a-a3de-b5a9a3305903 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.378477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.379220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.379510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.380166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.380762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.382610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:50.382762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.393191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.394068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.394419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.394706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.395742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.397943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.407623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2561/5147] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.408351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.411392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.444139 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2587/5148] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.445157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.498480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253ae38-f8bf-44be-bb1c-edaa42d117a6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.551285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b5a9-f29d-49d5-b1c9-bddc82a100da admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.559687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.561286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.561494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.561797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.562497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.564766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.585071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.585890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.586194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.586507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.588884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:50.597438 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2588/5149] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/projects => generated 362 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.598332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.669505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04485684-fa18-4266-b254-6b13ba5a6f61 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.674412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.675112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.675401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.675692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.676509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.678203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.683527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.685332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.690731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2589/5150] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:50.691181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.704952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd245d-e6c8-4af8-bccb-13cf9c3e4223 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.705542 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2562/5151] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:50.706625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.709883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.710571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.710912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.711202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.712267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.714582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.720448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b758d5-c760-48a7-91c0-d7e3ced9dfc1 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.732748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:50.747848 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2590/5152] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.747848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.762513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528879b6-ee3a-41b1-9c42-ec911a0d1c1f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.773037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.774084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.774531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.774915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.776189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.778553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.812867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2591/5153] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:50.817756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.845811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.846298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666192-df53-4752-854d-6ef2ae44f752 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.846748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.847044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.847327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.848040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.853608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.859254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.860215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.862487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.862902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.864750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.866621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.880464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2592/5154] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:50.884382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.901950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4887a6-2457-4b09-b443-a53ed9c5c4ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:50.908203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:50.909562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:50.910077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:50.910516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] PATH_INFO: `/v3/projects/c32fe49f7bcc41e3977a7773bef15000/users/cfb795b2d1394fa7bf02c107989731e7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:50.918465 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2563/5155] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/projects => generated 364 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:50.918465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:50.929146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32fe49f7bcc41e3977a7773bef15000, user_id=cfb795b2d1394fa7bf02c107989731e7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:50.932942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:50.944158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:50.951550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2593/5156] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:50 2022] PUT /identity/v3/projects/c32fe49f7bcc41e3977a7773bef15000/users/cfb795b2d1394fa7bf02c107989731e7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:50.952303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.002840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c511e-54dc-491b-8fd7-a4f1c8f02e1d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.047648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fdf66-0ec3-4091-b0cc-180e29e23d12 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.053996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.054692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.055223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.055599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.056365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.058982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2740f6-c678-42fb-a665-0a5cd35a38ed tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.078240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.079158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.079158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.079361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] PATH_INFO: `/v3/projects/631b547c310b480385b87ef9e3ecbc54/users/22786e5abe474005ad857fd96d64b067/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.087392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2594/5157] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:11:50 2022] POST /identity/v3/roles => generated 239 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:11:51.093393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.094109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.094109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.103465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631b547c310b480385b87ef9e3ecbc54, user_id=22786e5abe474005ad857fd96d64b067, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.107018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.115504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:51.116903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:51.125805 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2564/5158] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:50 2022] PUT /identity/v3/projects/631b547c310b480385b87ef9e3ecbc54/users/22786e5abe474005ad857fd96d64b067/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:51.126728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.165561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:51.205298 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2595/5159] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:51.206436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.210833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42883b7-260f-4c80-8e29-f2cc34cccea0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.217032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.217968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.218252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.218535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/e0fa27358f164ebea6666bfa8d52e549/users/fce1082927824e99a4e37abd89f1b23c/roles/5303bd787e0b48ef875574aff7be1fa8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.228026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ae977-e181-49d6-99ee-1b6ce79236f3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.232996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.233670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.233968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.234241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.235037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.236732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.237401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e0fa27358f164ebea6666bfa8d52e549, user_id=fce1082927824e99a4e37abd89f1b23c, role_id=5303bd787e0b48ef875574aff7be1fa8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.240206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.248569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2596/5160] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:11:51 2022] GET /identity/v3/roles => generated 1650 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:11:51.249635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.253377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:51.257798 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2565/5161] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:51 2022] PUT /identity/v3/projects/e0fa27358f164ebea6666bfa8d52e549/users/fce1082927824e99a4e37abd89f1b23c/roles/5303bd787e0b48ef875574aff7be1fa8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:51.258744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.319694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874461-8dd3-4e4f-8a68-be86ffd07294 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.337232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9384-0261-45a6-9d49-ed35279201e8 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.343541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.344409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.344719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.345112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] PATH_INFO: `/v3/projects/631b547c310b480385b87ef9e3ecbc54/users/22786e5abe474005ad857fd96d64b067/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.347392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=631b547c310b480385b87ef9e3ecbc54, user_id=22786e5abe474005ad857fd96d64b067, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.350890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.362457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:51.364282 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2566/5162] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:51 2022] PUT /identity/v3/projects/631b547c310b480385b87ef9e3ecbc54/users/22786e5abe474005ad857fd96d64b067/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:51.365196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.387784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.388482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.388786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.389047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.401767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.403407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4a7f-55b8-44ba-a3aa-74af753dfce3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.416316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2597/5163] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:51.456721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954283ef-16b1-48b2-bc7e-a779124cbfda admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.462940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.463869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.464173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.464472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/4c366dd472cd40dda1530a57e3c0a151/users/fce1082927824e99a4e37abd89f1b23c/roles/5303bd787e0b48ef875574aff7be1fa8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.467052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4c366dd472cd40dda1530a57e3c0a151, user_id=fce1082927824e99a4e37abd89f1b23c, role_id=5303bd787e0b48ef875574aff7be1fa8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.469937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3d899-ad27-4c3e-8ae5-a64b6ed5a343 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.492634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2567/5164] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:11:51 2022] PUT /identity/v3/projects/4c366dd472cd40dda1530a57e3c0a151/users/fce1082927824e99a4e37abd89f1b23c/roles/5303bd787e0b48ef875574aff7be1fa8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:51.500402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.502285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.503373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.548990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] MFA Rules not processed for user `fce1082927824e99a4e37abd89f1b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:51.551325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:51.556605 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2598/5165] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:51 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:11:51.561260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ff9b-28fd-4a88-818d-dab408da9e30 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.561556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ff9b-28fd-4a88-818d-dab408da9e30 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.561956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767ff9b-28fd-4a88-818d-dab408da9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.577297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0767ff9b-28fd-4a88-818d-dab408da9e30 None None] MFA Rules not processed for user `fce1082927824e99a4e37abd89f1b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:51.578646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0767ff9b-28fd-4a88-818d-dab408da9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:51.636730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:51.675754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2568/5166] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 25 21:11:51.676162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.765360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a8af-6013-4e4c-bcb0-c248dcdda45d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.773532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:51.774461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.774957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.775689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.787485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:51.789752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:51.813617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2599/5167] 10.222.0.39 () {56 vars in 1307 bytes} [Sat Jun 25 21:11:51 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:51.819635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:51.820334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:51.820918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:51.842499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] MFA Rules not processed for user `fce1082927824e99a4e37abd89f1b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:51.844699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:51.968588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2569/5168] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 25 21:11:51.970625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:51.982071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90aaf-5759-4617-b44d-0e56bf2d26bd tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:51.997783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:52.029147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:52.031900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:52.035965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:52.037486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/roles/5303bd787e0b48ef875574aff7be1fa8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:52.044666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5303bd787e0b48ef875574aff7be1fa8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:52.052907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:52.151599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c0089-de06-4394-b5b1-027caf2ca295 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:52.160261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:52.161307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:52.161886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:52.162422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:52.165727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:52.169618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invalidating the token cache because role 5303bd787e0b48ef875574aff7be1fa8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:52.170090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.171551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.177975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2600/5169] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:51 2022] DELETE /identity/v3/roles/5303bd787e0b48ef875574aff7be1fa8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:52.182475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:52.185027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:52.366218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c52b2-74e5-40fe-b6b1-a2e9410731e4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:52.379516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:52.381407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:52.381761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:52.381999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/4c366dd472cd40dda1530a57e3c0a151` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:52.387776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:52.396257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:52.401982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c366dd472cd40dda1530a57e3c0a151)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:52.430971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:52.440503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2570/5170] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:11:52.475893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:52.542090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c366dd472cd40dda1530a57e3c0a151', 'request_id': 'req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.563720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c366dd472cd40dda1530a57e3c0a151', 'request_id': 'req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.577201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c366dd472cd40dda1530a57e3c0a151', 'request_id': 'req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.601686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project 4c366dd472cd40dda1530a57e3c0a151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:52.602280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.603481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:52.608725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2601/5171] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:52 2022] DELETE /identity/v3/projects/4c366dd472cd40dda1530a57e3c0a151 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:52.610842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:52.626926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23268d1c-b846-4cb8-8f64-9915dfd032b8 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:52.706132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:52.793836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:52.794792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:52.795086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:52.795469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/4c366dd472cd40dda1530a57e3c0a151` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:52.810379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c366dd472cd40dda1530a57e3c0a151)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:52.810379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Could not find project: 4c366dd472cd40dda1530a57e3c0a151.: keystone.exception.ProjectNotFound: Could not find project: 4c366dd472cd40dda1530a57e3c0a151. Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 25 21:11:52.839382 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4c366dd472cd40dda1530a57e3c0a151. Jun 25 21:11:52.840622 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:52.844572 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2571/5172] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:52 2022] DELETE /identity/v3/projects/4c366dd472cd40dda1530a57e3c0a151 => generated 113 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:11:52.846181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:52.848169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:52.880452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472a4fa-a7aa-4cb8-887e-fb1e4571fa31 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:52.890557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:52.891857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:52.892231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:52.892622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/projects/e0fa27358f164ebea6666bfa8d52e549` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:52.897107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0fa27358f164ebea6666bfa8d52e549)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:52.899542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:53.045438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fa27358f164ebea6666bfa8d52e549', 'request_id': 'req-2568e131-24ad-441c-bfe0-ad85295346a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.068282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fa27358f164ebea6666bfa8d52e549', 'request_id': 'req-2568e131-24ad-441c-bfe0-ad85295346a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.079459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fa27358f164ebea6666bfa8d52e549', 'request_id': 'req-2568e131-24ad-441c-bfe0-ad85295346a7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.108717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] The token cache is being invalidate because project e0fa27358f164ebea6666bfa8d52e549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:53.109070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.111431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.119948 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2602/5173] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:52 2022] DELETE /identity/v3/projects/e0fa27358f164ebea6666bfa8d52e549 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:53.124651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:53.126632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:53.148690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06268d7-8d58-4f44-bcff-b09a8fc17720 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:53.285194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:53.286138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:53.286452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:53.286742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/users/fce1082927824e99a4e37abd89f1b23c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:53.291091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fce1082927824e99a4e37abd89f1b23c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:53.299858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:53.425917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce1082927824e99a4e37abd89f1b23c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.449719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce1082927824e99a4e37abd89f1b23c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.472533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce1082927824e99a4e37abd89f1b23c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.474567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce1082927824e99a4e37abd89f1b23c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.475271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce1082927824e99a4e37abd89f1b23c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:53.524166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2572/5174] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:53 2022] DELETE /identity/v3/users/fce1082927824e99a4e37abd89f1b23c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:53.530191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:53.550742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e131-24ad-441c-bfe0-ad85295346a7 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:53.768653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:53.769405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:53.769725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:53.769992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/6cc87c94be6a45bdbcd6d76633040889` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:53.799423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Could not find domain: 6cc87c94be6a45bdbcd6d76633040889.: keystone.exception.DomainNotFound: Could not find domain: 6cc87c94be6a45bdbcd6d76633040889. Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6cc87c94be6a45bdbcd6d76633040889. Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:11:53.828143 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:11:53.829467 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6cc87c94be6a45bdbcd6d76633040889. Jun 25 21:11:53.830414 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:53.831413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2603/5175] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:53 2022] PATCH /identity/v3/domains/6cc87c94be6a45bdbcd6d76633040889 => generated 112 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:11:53.835980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:53.836280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:53.866569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369b0f-ae8c-4926-81b3-2ee49a93fbf4 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:53.900745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:53.902418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:53.902737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:53.903106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/bba8d210c3dd4c10b1bd668824211b92` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:53.924944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Could not find domain: bba8d210c3dd4c10b1bd668824211b92.: keystone.exception.DomainNotFound: Could not find domain: bba8d210c3dd4c10b1bd668824211b92. Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bba8d210c3dd4c10b1bd668824211b92. Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:11:53.956909 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:11:53.958452 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bba8d210c3dd4c10b1bd668824211b92. Jun 25 21:11:53.959640 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:53.966455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2573/5176] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:53 2022] PATCH /identity/v3/domains/bba8d210c3dd4c10b1bd668824211b92 => generated 112 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:11:53.968036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:54.002368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca395a-4de2-42ef-93a8-c432276b8b4d tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:54.022581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:54.026034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:54.033305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:54.033603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:54.085964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Could not find domain: aea75ef5fdfe4726a4357b1ea01e472e.: keystone.exception.DomainNotFound: Could not find domain: aea75ef5fdfe4726a4357b1ea01e472e. Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aea75ef5fdfe4726a4357b1ea01e472e. Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:11:54.120686 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:11:54.122760 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aea75ef5fdfe4726a4357b1ea01e472e. Jun 25 21:11:54.124890 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:11:54.126398 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2604/5177] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:53 2022] PATCH /identity/v3/domains/aea75ef5fdfe4726a4357b1ea01e472e => generated 112 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:11:54.133860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:54.192263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2b40-1bca-4411-aa87-08946087ffc0 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:54.210582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d98e776bae4344aff64467b0690fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35bb0d6427c84f18830b60ae1cdb1198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:54.215306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:54.215833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:54.216268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] PATH_INFO: `/v3/domains/24c537335d944ce9be6eddd023faf4c3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:54.243715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-036e5b4b-8d1f-4a8c-8d48-d67e328cd3c1 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Could not find domain: 24c537335d944ce9be6eddd023faf4c3.: keystone.exception.DomainNotFound: Could not find domain: 24c537335d944ce9be6eddd023faf4c3. Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 24c537335d944ce9be6eddd023faf4c3. Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:11:54.301657 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:11:54.302814 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 24c537335d944ce9be6eddd023faf4c3. Jun 25 21:11:54.303832 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:11:54.312389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:54.314267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:54.316222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2574/5178] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:11:54 2022] PATCH /identity/v3/domains/24c537335d944ce9be6eddd023faf4c3 => generated 112 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:11:54.345895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:54.501943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc137d-ff35-43a7-bbaf-84bee234df38 tempest-TokensV3TestJSON-1882009919 tempest-TokensV3TestJSON-1882009919-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:54.525124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:54.528260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:54.529437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:54.529555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] PATH_INFO: `/v3/users/4143bfb3999f4f8983f0b412c22b1756` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:54.533138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4143bfb3999f4f8983f0b412c22b1756)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:54.537535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:54.679817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4143bfb3999f4f8983f0b412c22b1756'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:54.680950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4143bfb3999f4f8983f0b412c22b1756'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:54.697395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4143bfb3999f4f8983f0b412c22b1756'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:54.722273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4143bfb3999f4f8983f0b412c22b1756'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:54.734786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4143bfb3999f4f8983f0b412c22b1756'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:54.744792 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2605/5179] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:54 2022] DELETE /identity/v3/users/4143bfb3999f4f8983f0b412c22b1756 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:54.751065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:54.752989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:54.753472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:54.825152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:11:54.827375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:54.853054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:55.005838 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2575/5180] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:11:55.023829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:55.026773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:55.175592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d10f-9226-4568-85a9-c7df2c5b59fc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:55.180968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:55.182141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:55.182443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:55.182772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:55.199409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:55.205727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:55.232747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2606/5181] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:11:56.154359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:56.155895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:56.193468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf9e30-6308-4257-9edd-48a86ceddd28 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:56.205273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:56.206451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:56.206916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:56.207340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] PATH_INFO: `/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:56.209104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5926ca9a1bf417892c6e23f505aeb7d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:56.211246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:56.365873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5926ca9a1bf417892c6e23f505aeb7d', 'request_id': 'req-a2f67386-276c-446c-92cd-aa3de8df0777'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.382094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5926ca9a1bf417892c6e23f505aeb7d', 'request_id': 'req-a2f67386-276c-446c-92cd-aa3de8df0777'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.393842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5926ca9a1bf417892c6e23f505aeb7d', 'request_id': 'req-a2f67386-276c-446c-92cd-aa3de8df0777'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.426525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] The token cache is being invalidate because project b5926ca9a1bf417892c6e23f505aeb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:11:56.427355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.428726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.431588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2576/5182] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:56 2022] DELETE /identity/v3/projects/b5926ca9a1bf417892c6e23f505aeb7d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:11:56.438224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:56.450041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fcf84-16c7-4af6-8bcd-8bf02368dd68 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:11:56.516515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:56.615760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:11:56.617059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:11:56.619122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:11:56.619664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] PATH_INFO: `/v3/users/99d98e776bae4344aff64467b0690fbd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:11:56.624003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d98e776bae4344aff64467b0690fbd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:11:56.630712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:11:56.814909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d98e776bae4344aff64467b0690fbd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.816699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d98e776bae4344aff64467b0690fbd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.840326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d98e776bae4344aff64467b0690fbd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.873449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d98e776bae4344aff64467b0690fbd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.889189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d98e776bae4344aff64467b0690fbd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:11:56.931516 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2607/5183] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:11:56 2022] DELETE /identity/v3/users/99d98e776bae4344aff64467b0690fbd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:11:59.830172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:11:59.833514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:11:59.858452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f67386-276c-446c-92cd-aa3de8df0777 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:00.069944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:00.071255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:00.075084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:00.075669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] PATH_INFO: `/v3/projects/35bb0d6427c84f18830b60ae1cdb1198` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:00.079622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bb0d6427c84f18830b60ae1cdb1198)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:00.083898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:00.252607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:00.270037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bb0d6427c84f18830b60ae1cdb1198', 'request_id': 'req-4eed50a6-522a-4781-9284-6d65e55f0c7d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.296982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bb0d6427c84f18830b60ae1cdb1198', 'request_id': 'req-4eed50a6-522a-4781-9284-6d65e55f0c7d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.307564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bb0d6427c84f18830b60ae1cdb1198', 'request_id': 'req-4eed50a6-522a-4781-9284-6d65e55f0c7d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.338438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] The token cache is being invalidate because project 35bb0d6427c84f18830b60ae1cdb1198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:00.339062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.340055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4eed50a6-522a-4781-9284-6d65e55f0c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.343277 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2577/5184] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:11:59 2022] DELETE /identity/v3/projects/35bb0d6427c84f18830b60ae1cdb1198 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:00.348923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:00.351595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:00.402486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f2f0-795e-4aba-9afe-c4dc3c2c21bc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:00.696296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:00.697514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:00.697631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:00.697825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] PATH_INFO: `/v3/users/4fe1593cfa7946e2b98e6f06891a30ea` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:00.702949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe1593cfa7946e2b98e6f06891a30ea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:00.705554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:00.826789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.831660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.838220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:00.847267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.878019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.889129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-232cd502-71e9-4379-bb44-22b1dda19400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe1593cfa7946e2b98e6f06891a30ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:00.928461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2608/5185] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:00 2022] DELETE /identity/v3/users/4fe1593cfa7946e2b98e6f06891a30ea => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:01.030520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:01.031088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:01.031269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:01.035433 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2578/5186] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:12:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:12:01.046272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f704-c947-483c-b7dd-ee64a37221ed None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:01.046895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f704-c947-483c-b7dd-ee64a37221ed None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:01.047438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f704-c947-483c-b7dd-ee64a37221ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:01.078231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c356f704-c947-483c-b7dd-ee64a37221ed None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:01.083349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c356f704-c947-483c-b7dd-ee64a37221ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:01.228392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2609/5187] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:01.363173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:01.366522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:01.399689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22278-6f68-4059-be15-3fbfd106a754 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:01.439700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:01.442822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:01.445056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:01.445352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:01.472838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:01.474600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:01.495404 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2579/5188] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:01.719471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757263af-06b1-45e7-b938-4037574806fd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:01.720639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757263af-06b1-45e7-b938-4037574806fd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:01.721747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757263af-06b1-45e7-b938-4037574806fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:01.773053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-757263af-06b1-45e7-b938-4037574806fd None None] MFA Rules not processed for user `22786e5abe474005ad857fd96d64b067`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:01.777222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-757263af-06b1-45e7-b938-4037574806fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:01.989159 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2610/5189] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:02.012935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:02.014916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.044543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757263af-06b1-45e7-b938-4037574806fd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:02.048774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-757263af-06b1-45e7-b938-4037574806fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.232531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a28c7-829a-4e57-8bff-f98efe6ae9ac service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:02.246519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:02.247904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:02.248412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:02.250760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:02.277560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:02.282217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975017-641a-434c-81fc-2c187ebc6334 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:02.297239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757263af-06b1-45e7-b938-4037574806fd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:02.311801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2580/5190] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:02.313128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:02.314079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:02.314375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:02.314642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] PATH_INFO: `/v3/projects/b26ead37a58141ac93fdc2da7f36326a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:02.317004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26ead37a58141ac93fdc2da7f36326a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:02.319271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:02.326524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:02.484765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26ead37a58141ac93fdc2da7f36326a', 'request_id': 'req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:02.508179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26ead37a58141ac93fdc2da7f36326a', 'request_id': 'req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:02.524409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26ead37a58141ac93fdc2da7f36326a', 'request_id': 'req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:02.550854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] The token cache is being invalidate because project b26ead37a58141ac93fdc2da7f36326a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:02.551141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:02.552359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:02.554480 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2611/5191] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:02 2022] DELETE /identity/v3/projects/b26ead37a58141ac93fdc2da7f36326a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:02.560382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dca48-b261-49a6-9c51-c7bb32fd6611 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:02.560771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dca48-b261-49a6-9c51-c7bb32fd6611 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:02.561524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dca48-b261-49a6-9c51-c7bb32fd6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:02.683212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-975dca48-b261-49a6-9c51-c7bb32fd6611 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:02.684733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-975dca48-b261-49a6-9c51-c7bb32fd6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.691992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:02.693624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.860822 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2581/5192] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:02.866813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:02.867262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcce80-b222-4a71-a4f9-c7bd438b3dc8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:02.869315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:02.871247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:02.891179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:02.891920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:02.892202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:02.892516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:02.900068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.918140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:02.919422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:02.929276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:02.930920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:02.947214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2582/5193] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:02.951447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:02.967491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2612/5194] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:03.002336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee83d0-9222-45d8-b0d4-0911bb9c336a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.028054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.029585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.029585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.030025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.032625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:03.033235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.040983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.074310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2583/5195] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:03.080961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.099590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21c59-e102-459f-bde6-3be412301536 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.106473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.107158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.107435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.107711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.108819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.112955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.208491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2613/5196] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:03.216848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.237470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180222f-2904-4937-9533-c7929e486168 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.255697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:03.460651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.461371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.464060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.466011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.467255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.482456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.527005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2584/5197] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:03 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:03.531973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.549410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c440dd-7c48-4fc8-9ac1-314b5556db6c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.563622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.567550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.568234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.568234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.568840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.576049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.630034 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2614/5198] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:03.631313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.647203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf9df-9396-4969-82f3-a76a5abb9d42 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.658641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.659343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.659708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.660018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.660865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.662718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.685209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2585/5199] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:03.687550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.738995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b593-57c4-42d1-802f-4ea11b56d138 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:03.748570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:03.752666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.753169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.753934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] PATH_INFO: `/v3/projects/f82c5b46749f4cd2addc5eca6fbd45ad/users/2f85317d32d34eae904b96922ded6e6c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.842626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82c5b46749f4cd2addc5eca6fbd45ad, user_id=2f85317d32d34eae904b96922ded6e6c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:03.853724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016f54-f55c-424a-b18c-f8fda1a384c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:03.883137 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2615/5200] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:03 2022] PUT /identity/v3/projects/f82c5b46749f4cd2addc5eca6fbd45ad/users/2f85317d32d34eae904b96922ded6e6c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:03.889019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:03.891104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:03.897327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:03.897627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:03.897911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:03.959018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] MFA Rules not processed for user `2f85317d32d34eae904b96922ded6e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:03.974643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:04.034439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:04.084106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c42cb-d6b4-4589-94f1-226a0ca167b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:04.244491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2616/5201] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:04.249021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:04.304776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:04.306134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:04.310196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:04.310296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:04.321403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:04.367971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:04.369658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:04.400849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2586/5202] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:04.440353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd647c68-21cf-4ff5-a86a-1d7da44f2657 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:04.465315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:04.467514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:04.467864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:04.468147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:04.471879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:04.481679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:04.582333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:04.590325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:04.624380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff91b-f9a7-4274-a7b1-da7ed19a745d service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:04.640188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:04.655569 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2617/5203] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:04 2022] POST /identity/v3/projects => generated 367 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:04.661398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:04.662522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:04.662949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:04.663242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] PATH_INFO: `/v3/users/d84cb991e49d4b15909b91d8d37843ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:04.664844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84cb991e49d4b15909b91d8d37843ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:04.692567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:04.721894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:04.788882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84cb991e49d4b15909b91d8d37843ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:04.810831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84cb991e49d4b15909b91d8d37843ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:04.851671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84cb991e49d4b15909b91d8d37843ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:04.852607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84cb991e49d4b15909b91d8d37843ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:04.853261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0df1873c-a835-469a-9cc0-d7a56c18ce2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84cb991e49d4b15909b91d8d37843ea'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:04.862927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732632d-5adf-44cc-ac34-c4939a8d935d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:04.873137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2587/5204] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:04 2022] DELETE /identity/v3/users/d84cb991e49d4b15909b91d8d37843ea => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:04.877432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:04.878140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:04.880649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba1bb-174a-44e9-97f1-446da97763d7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:04.881327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:04.881596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:04.883602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba1bb-174a-44e9-97f1-446da97763d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:04.883732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba1bb-174a-44e9-97f1-446da97763d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:04.885130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:04.890009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:04.923875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-df8ba1bb-174a-44e9-97f1-446da97763d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:04.925695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df8ba1bb-174a-44e9-97f1-446da97763d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:04.942706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2618/5205] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:04 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:04.946221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:04.951915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:04.976854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257e8bc-61cf-4b09-bbe9-e0c30ba3efe2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.071904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:05.113633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2588/5206] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:05.115498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.115998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.116530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.140088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.141087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.141351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.141858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.142786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:05.144766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:05.150722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] MFA Rules not processed for user `cfb795b2d1394fa7bf02c107989731e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:05.153034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:05.160713 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2619/5207] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:05.160713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:05.163252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:05.248321 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2589/5208] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:05.254162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:05.268196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ce9a-0d85-4b01-ba25-d8218ac79838 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.270183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f771b71-be28-4763-9784-c8cea3338b51 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.277939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.279043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.279204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.279577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.280005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] PATH_INFO: `/v3/projects/66d5852d1c504b0485ff0d4a982b7c52/users/f2154360134646e2a7fba91500a8fe04/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.280770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.281582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.282227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.295480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:05.298734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:05.303604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d5852d1c504b0485ff0d4a982b7c52, user_id=f2154360134646e2a7fba91500a8fe04, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:05.307894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:05.313480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:05.365994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2620/5209] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:05.369698 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2590/5210] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:05 2022] PUT /identity/v3/projects/66d5852d1c504b0485ff0d4a982b7c52/users/f2154360134646e2a7fba91500a8fe04/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:05.370154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:05.375595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:05.379205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:05.577579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163f76-c2b3-4ce7-931d-688ce5408056 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.592380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.594746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.594956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.595869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.596771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:05.608550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:05.693130 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2591/5211] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:05.697244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:05.709222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6989-b101-4599-b788-1d9e6f75fe07 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.736472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5859eab-f783-43b0-8837-c126f7fd6b49 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:05.756361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.759369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.761556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.761556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] PATH_INFO: `/v3/projects/66d5852d1c504b0485ff0d4a982b7c52/users/f2154360134646e2a7fba91500a8fe04/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.776694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d5852d1c504b0485ff0d4a982b7c52, user_id=f2154360134646e2a7fba91500a8fe04, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:05.792303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68916e3d-8a44-4647-b86c-dd1e13d77c91 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:05.814101 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2592/5212] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:05 2022] PUT /identity/v3/projects/66d5852d1c504b0485ff0d4a982b7c52/users/f2154360134646e2a7fba91500a8fe04/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:05.920302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.920895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.921368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:05.930525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:05.940727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:05.941507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:05.942204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:05.942204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:06.043373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] MFA Rules not processed for user `f2154360134646e2a7fba91500a8fe04`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:06.044888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:06.107157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:06.109704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:06.144913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2621/5213] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:06.158173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:06.160301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:06.258020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9f8c-5f84-433e-9664-54e00fc7c71f service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:06.355807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2593/5214] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:06.366630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:06.414825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b733c2b-0f74-40e6-8f44-f8ff56a7d009 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:06.434787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:06.435996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:06.436729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:06.437270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:06.438705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:06.457297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:06.473323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:06.474286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:06.474572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:06.474854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] PATH_INFO: `/v3/projects/b05e14f0b76a41f88c1b7de024102aed` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:06.476455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05e14f0b76a41f88c1b7de024102aed)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:06.480726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:06.579805 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2594/5215] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:06 2022] POST /identity/v3/projects => generated 360 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:06.584750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:06.590079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:06.629993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05e14f0b76a41f88c1b7de024102aed', 'request_id': 'req-85bc2341-da41-4064-b290-84e382a22b8c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:06.646083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05e14f0b76a41f88c1b7de024102aed', 'request_id': 'req-85bc2341-da41-4064-b290-84e382a22b8c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:06.661910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05e14f0b76a41f88c1b7de024102aed', 'request_id': 'req-85bc2341-da41-4064-b290-84e382a22b8c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:06.691647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] The token cache is being invalidate because project b05e14f0b76a41f88c1b7de024102aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:06.692031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:06.694627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:06.701544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2622/5216] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:06 2022] DELETE /identity/v3/projects/b05e14f0b76a41f88c1b7de024102aed => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:06.702524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:06.705214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:06.731657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:06.798416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd601-2489-4d0d-bb01-0c16154069f3 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:06.815481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:06.908763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2341-da41-4064-b290-84e382a22b8c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:06.923656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:06.926360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:06.926360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:06.926360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:06.927526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:06.931094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8c1e-c30e-4c13-bf8c-83371a4421ea tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:06.996224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:06.996816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2623/5217] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:06 2022] POST /identity/v3/users => generated 371 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:06.999812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.002013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.002319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.004027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.005025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.005212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] PATH_INFO: `/v3/users/10c0287a5f02499cb26cc144cd7588cf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.006903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c0287a5f02499cb26cc144cd7588cf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.010437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.051036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:07.053403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:07.085513 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2624/5218] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:07.087219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.135253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491b10-b1ac-435c-953f-bddcc8c93648 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:07.137938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c0287a5f02499cb26cc144cd7588cf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.149559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:07.150515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.150874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.151166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/714f6ebfada0477094a4746ddd60213a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.159505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c0287a5f02499cb26cc144cd7588cf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.201721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c0287a5f02499cb26cc144cd7588cf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.203763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c0287a5f02499cb26cc144cd7588cf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.204767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-674d2abf-5867-4849-82ff-d8ed5915c786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c0287a5f02499cb26cc144cd7588cf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.214184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_user(user_id=714f6ebfada0477094a4746ddd60213a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.223755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.226258 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2595/5219] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:06 2022] DELETE /identity/v3/users/10c0287a5f02499cb26cc144cd7588cf => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:07.227462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2625/5220] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:12:07 2022] GET /identity/v3/users/714f6ebfada0477094a4746ddd60213a => generated 371 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:07.232834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.235729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:07.243310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.243642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.245556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.268532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5a02-bd34-4b20-9ec5-ce158d650c96 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:07.306139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:07.307397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:07.409099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:07.410319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.411221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.411652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/714f6ebfada0477094a4746ddd60213a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.413794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_user(user_id=714f6ebfada0477094a4746ddd60213a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.416374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.477397 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2596/5221] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:07.481125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.505713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6846b-8943-4e1d-a5f3-ea9d368c86c6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:07.512226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:07.515597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.515884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.516168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.516960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:07.517274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.521537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714f6ebfada0477094a4746ddd60213a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.522137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.522692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714f6ebfada0477094a4746ddd60213a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.527220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:07.545070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714f6ebfada0477094a4746ddd60213a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.572315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714f6ebfada0477094a4746ddd60213a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.584857 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2597/5222] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:07.593378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.595305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714f6ebfada0477094a4746ddd60213a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:07.596651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:07.606893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2626/5223] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:07 2022] DELETE /identity/v3/users/714f6ebfada0477094a4746ddd60213a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:07.608594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.612693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:07.635945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0f91-e0cb-4e0e-8c0e-2903961520fe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:07.690523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:07.826724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beac63-e577-43d0-bfea-e9bb08c370f7 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:07.834477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:07.839989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.839989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.840249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/1dba1a434b494b3c9943aab4c4234f78` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.843142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1dba1a434b494b3c9943aab4c4234f78)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.846719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.861520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:07.862227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:07.862668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:07.863112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:07.864047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:07.867092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:07.912704 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2598/5224] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:07 2022] POST /identity/v3/projects => generated 391 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:07.917816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:07.990702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dba1a434b494b3c9943aab4c4234f78', 'request_id': 'req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.009251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dba1a434b494b3c9943aab4c4234f78', 'request_id': 'req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.028591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dba1a434b494b3c9943aab4c4234f78', 'request_id': 'req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.066625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] The token cache is being invalidate because project 1dba1a434b494b3c9943aab4c4234f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:08.068817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.070091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.074297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2627/5225] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:07 2022] DELETE /identity/v3/projects/1dba1a434b494b3c9943aab4c4234f78 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:08.084186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.091150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:08.137099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2a98b-453f-47ad-88cb-265adf9c9c39 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.256022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80de7-2adc-466e-bd75-b6d6f2e556bc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.269521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.270342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.270636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.270930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.275088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.282962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.325851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.331068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.332142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.333088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.334154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.336824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.366093 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2628/5226] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:08 2022] POST /identity/v3/projects => generated 358 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:08.373013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.411685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2599/5227] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:07 2022] POST /identity/v3/users => generated 296 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:08.417469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.420366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:08.460541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d721746-5244-4ec8-a83e-cdc8074630ea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.482941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:08.522913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:08.557745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af819d-bf05-47ac-88ed-e8748a9b8fd4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.574044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.579199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.580661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.581262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.582755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.584311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.585173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.585581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.585923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.587292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.589132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.591141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.604469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2600/5228] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:12:08.617390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.631210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440efba-5ab9-412e-9ef3-54240c9f2bb3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.636353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.639563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.640103 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2629/5229] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:08 2022] POST /identity/v3/users => generated 414 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:08.644417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.645180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.647252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.650654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.658177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca3da-bdb5-42be-8916-30541a37bcf1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.659221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.663995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.664908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.665312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.665682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.666537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.668473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.672052 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2601/5230] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:08.676956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.689514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f0e1-da2d-44f4-b3f3-88c3fa87d623 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.696359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.697386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.697714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.698277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] PATH_INFO: `/v3/projects/ac8403c64a48460ea9cbf383240fa2a9/users/aa2aaa29e0dd479283202bd6575b4c25/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.702516 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2630/5231] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:12:08 2022] POST /identity/v3/roles => generated 239 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:08.705797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.708515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:08.727890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171a9f-bfcb-4af9-af68-30e64a544880 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:08.728710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8403c64a48460ea9cbf383240fa2a9, user_id=aa2aaa29e0dd479283202bd6575b4c25, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.732004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.733390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:08.734508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.734890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.735264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] PATH_INFO: `/v3/projects/8983a71e4a2142fc9fa3460969b2f425` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.737068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8983a71e4a2142fc9fa3460969b2f425)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:08.739153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:08.759426 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2602/5232] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:08 2022] PUT /identity/v3/projects/ac8403c64a48460ea9cbf383240fa2a9/users/aa2aaa29e0dd479283202bd6575b4c25/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:08.762159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:08.855021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8983a71e4a2142fc9fa3460969b2f425', 'request_id': 'req-dc57909b-9e17-478c-a640-79c0e2cc1e73'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.872388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8983a71e4a2142fc9fa3460969b2f425', 'request_id': 'req-dc57909b-9e17-478c-a640-79c0e2cc1e73'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.884205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8983a71e4a2142fc9fa3460969b2f425', 'request_id': 'req-dc57909b-9e17-478c-a640-79c0e2cc1e73'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.913689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] The token cache is being invalidate because project 8983a71e4a2142fc9fa3460969b2f425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:08.913689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.916372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-dc57909b-9e17-478c-a640-79c0e2cc1e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:08.921285 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2631/5233] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:08 2022] DELETE /identity/v3/projects/8983a71e4a2142fc9fa3460969b2f425 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:08.923916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:08.924202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:08.924629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:08.954271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc58a-c4f0-4c42-8c13-cb2ec85f8908 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.048516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] MFA Rules not processed for user `aa2aaa29e0dd479283202bd6575b4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:09.050719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:09.170957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.173249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.173249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.173545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/b6713150dceb43b6b53e99c64c9010c6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.217215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_user(user_id=b6713150dceb43b6b53e99c64c9010c6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.223539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a651895-069c-4136-abbd-50ed7003264c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.230143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2603/5234] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:12:08 2022] GET /identity/v3/users/b6713150dceb43b6b53e99c64c9010c6 => generated 414 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:09.234058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.234434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.238994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.253761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2632/5235] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:09.261300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.270197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:09.294810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:09.296611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:09.298706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e1522-175a-4c9e-beb0-7db5a58cba61 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.320550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.322006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.323209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:09.324063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.324335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/roles/7bbad087a0624a2da20687d5ae91bc4a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.326296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_role(role_id=7bbad087a0624a2da20687d5ae91bc4a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.328082 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:09.328082 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:12:09.328082 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:12:09.329643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.332700 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2633/5236] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:12:09 2022] GET /identity/v3/roles/7bbad087a0624a2da20687d5ae91bc4a => generated 239 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:09.334241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.336927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:09.402750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:09.452155 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2604/5237] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:09.453210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.481219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bfe9-d8f1-4237-960f-da4aaae1069a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.496133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.496882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.497171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.498550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.499247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.505137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d28e2-8520-411b-a15e-e6039e5bb410 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.537733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4717b3-3f17-4feb-b093-e13d210da5f1 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.553620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.557776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.558220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.558669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.559485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.563666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.601657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2605/5238] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:09 2022] POST /identity/v3/projects => generated 359 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:09.604206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.604767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.605281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.634481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:09.636257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:09.637764 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2634/5239] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:09 2022] POST /identity/v3/projects => generated 391 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:09.638857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.828073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c728451-1f26-4bca-9e6a-5ff0bae98a1f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.850619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.851724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.852239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.852614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/bbafc0d85ecc4fd397180100a65180e2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.861060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbafc0d85ecc4fd397180100a65180e2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.863264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.865607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2635/5240] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:09 2022] GET /identity/v3/projects/bbafc0d85ecc4fd397180100a65180e2 => generated 359 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:09.866629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.892397 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2606/5241] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:09.893322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:09.923517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb9bc-7502-45de-ab99-2f3cf95183ec None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:09.938993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:09.939914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:09.940240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:09.940556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/bbafc0d85ecc4fd397180100a65180e2/users/b6713150dceb43b6b53e99c64c9010c6/roles/7bbad087a0624a2da20687d5ae91bc4a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:09.945596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bbafc0d85ecc4fd397180100a65180e2, user_id=b6713150dceb43b6b53e99c64c9010c6, role_id=7bbad087a0624a2da20687d5ae91bc4a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:09.952575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:09.984683 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2607/5242] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:09 2022] PUT /identity/v3/projects/bbafc0d85ecc4fd397180100a65180e2/users/b6713150dceb43b6b53e99c64c9010c6/roles/7bbad087a0624a2da20687d5ae91bc4a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:09.988936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.025230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0980f-e4c6-4062-8321-fbf7243cc76f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.208113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2763-fb66-453c-8660-3dca152ef146 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.214294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:10.224288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.225949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.226319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.227667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.229530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:10.230186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.232408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.239732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.240839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.241306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.241740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.242633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.245138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.276109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2608/5243] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:10.276109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.296541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2636/5244] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:09 2022] POST /identity/v3/users => generated 302 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:10.298251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.321411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad1c11-964b-4dca-b6d4-b33520606b1d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.339153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.342932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.343403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.344020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.344992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.348735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.402036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:10.403869 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2637/5245] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:10 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:10.410924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.586816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabf4d8-d498-42db-bdd2-72a39dbd881d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.609708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b97b-f2c4-4841-a3ec-a5ee8b976d23 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.629350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.640601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.641233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.644545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.646615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.650313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.687248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2638/5246] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:10 2022] GET /identity/v3/roles => generated 1650 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:10.688713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.717172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63322e-aa75-4c1d-b111-50f563cbf089 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:10.734953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.735844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:10.736619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.737226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.737691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.738572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.739430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:10.740769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:10.744537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.744914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:10.745835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:10.751307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:10.821395 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2609/5247] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:10 2022] POST /identity/v3/projects => generated 359 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:10.830473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.844332 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2639/5248] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:10 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:10.848829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:10.890659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719d9d0-8107-457c-82e1-3dcbba2619d6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.040683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f03a7d-bd35-4e54-b685-362b37e4062b tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.047704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.048754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.048892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.049164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.049464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] PATH_INFO: `/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f/users/cbb3982e7c3445209fea090c37590c63/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.049588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.049776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.050056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/363f5e91a35545d4936dff976e5530c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.055158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_project(project_id=363f5e91a35545d4936dff976e5530c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.060579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.070745 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2640/5249] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:10 2022] GET /identity/v3/projects/363f5e91a35545d4936dff976e5530c8 => generated 359 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:11.070745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.071541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba60c9d2e9f84e6f98b1681f72b9e35f, user_id=cbb3982e7c3445209fea090c37590c63, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.076075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.100886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15cac-14c3-4383-9393-49593e73055e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.102911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2610/5250] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:10 2022] PUT /identity/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f/users/cbb3982e7c3445209fea090c37590c63/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:11.105732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.162882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:11.193215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.194188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.194574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.195810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:11.196491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.198552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.200875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.216959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2641/5251] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:11 2022] GET /identity/v3/roles => generated 1650 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:11.217691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.230775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585c7-bde4-44b9-8436-a71e32167cd1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.241580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.242285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.242567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.242876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.243640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.251182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.265792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9a62-effb-437e-9c8c-bb750e17ea75 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.273859 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2642/5252] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:11 2022] GET /identity/v3/roles => generated 1650 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:11.275116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.291841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a8fd-9d42-4ca8-9528-cc5ceb3ef6b4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.295986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.297696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.298109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.298578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.298701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.298898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.299177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.299448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/363f5e91a35545d4936dff976e5530c8/users/b6713150dceb43b6b53e99c64c9010c6/roles/7bbad087a0624a2da20687d5ae91bc4a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.299908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.301853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.304615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_grant(project_id=363f5e91a35545d4936dff976e5530c8, user_id=b6713150dceb43b6b53e99c64c9010c6, role_id=7bbad087a0624a2da20687d5ae91bc4a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.307579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.326852 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2643/5253] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:11 2022] GET /identity/v3/roles => generated 1650 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:11.326852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.344667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a831ab-9e49-486a-ab95-5b24bb520d9d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.345065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2611/5254] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:11 2022] PUT /identity/v3/projects/363f5e91a35545d4936dff976e5530c8/users/b6713150dceb43b6b53e99c64c9010c6/roles/7bbad087a0624a2da20687d5ae91bc4a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:11.347469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.536558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e167cd-e50f-4dc8-bd1f-c5ca3378c358 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.550274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.551624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.552179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.552678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] PATH_INFO: `/v3/projects/eebc7e08874e49a2bd3f4c2025abca38/users/1853a6e59c4040e198f63c3a2ee6474e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.553409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.554673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.554960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.555238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] PATH_INFO: `/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f/users/cbb3982e7c3445209fea090c37590c63/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.558730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba60c9d2e9f84e6f98b1681f72b9e35f, user_id=cbb3982e7c3445209fea090c37590c63, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.561632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.577136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebc7e08874e49a2bd3f4c2025abca38, user_id=1853a6e59c4040e198f63c3a2ee6474e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.581079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa81350-57b0-4ade-b7d7-352f00e1cb16 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.591618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2644/5255] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:11 2022] PUT /identity/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f/users/cbb3982e7c3445209fea090c37590c63/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:11.600134 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2612/5256] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:11 2022] PUT /identity/v3/projects/eebc7e08874e49a2bd3f4c2025abca38/users/1853a6e59c4040e198f63c3a2ee6474e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:11.602537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:11.613832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aced3-4055-4600-85b3-5c92e6d68fed None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.614116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aced3-4055-4600-85b3-5c92e6d68fed None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.614603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aced3-4055-4600-85b3-5c92e6d68fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.705213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a80aced3-4055-4600-85b3-5c92e6d68fed None None] MFA Rules not processed for user `cbb3982e7c3445209fea090c37590c63`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:11.707336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a80aced3-4055-4600-85b3-5c92e6d68fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:11.814262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bd8-97e9-482b-b1e4-7fd98e1e3f2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:11.877181 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2613/5257] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:11.880398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.880856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.881400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.917731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] MFA Rules not processed for user `1853a6e59c4040e198f63c3a2ee6474e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:11.923387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:11.928566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:11.937394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:11.939589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:11.940313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:11.941082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/b6713150dceb43b6b53e99c64c9010c6/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:11.943087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=b6713150dceb43b6b53e99c64c9010c6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:11.946458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:11.985967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:12.020251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2645/5258] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:12:11 2022] GET /identity/v3/users/b6713150dceb43b6b53e99c64c9010c6/projects => generated 842 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:12.021157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:12.034662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:12.173918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2614/5259] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:12.177389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:12.210730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c59bae-134a-4f03-a24a-40222dd127d8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:12.224828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:12.229378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:12.229932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:12.231679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55679667-fa61-44a9-8e0c-d2ca9880524d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:12.232186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/363f5e91a35545d4936dff976e5530c8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:12.235400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=363f5e91a35545d4936dff976e5530c8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:12.239808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:12.240686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:12.240785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:12.240877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:12.241059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:12.372537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363f5e91a35545d4936dff976e5530c8', 'request_id': 'req-8d163de3-4408-44a5-8927-6cd8afd4b834'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.395338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363f5e91a35545d4936dff976e5530c8', 'request_id': 'req-8d163de3-4408-44a5-8927-6cd8afd4b834'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.404403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363f5e91a35545d4936dff976e5530c8', 'request_id': 'req-8d163de3-4408-44a5-8927-6cd8afd4b834'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.447777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] The token cache is being invalidate because project 363f5e91a35545d4936dff976e5530c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:12.448353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.449466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.457090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2615/5260] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:12 2022] DELETE /identity/v3/projects/363f5e91a35545d4936dff976e5530c8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:12.458825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:12.463795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:12.470007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:12.477130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:12.503009 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2646/5261] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:12.503992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:12.533943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430413b4-9632-48c8-b9a6-c26dd093c015 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:12.758800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:12.761791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:12.763242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:12.763691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/bbafc0d85ecc4fd397180100a65180e2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:12.765098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163de3-4408-44a5-8927-6cd8afd4b834 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:12.766603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbafc0d85ecc4fd397180100a65180e2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:12.773134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:12.796347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:12.800591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:12.805428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:12.807549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:12.808933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:12.813244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:12.815895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:12.887799 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2616/5262] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:12 2022] POST /identity/v3/projects => generated 383 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:12.896874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:12.949160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbafc0d85ecc4fd397180100a65180e2', 'request_id': 'req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.973413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbafc0d85ecc4fd397180100a65180e2', 'request_id': 'req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.991140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbafc0d85ecc4fd397180100a65180e2', 'request_id': 'req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:12.998110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:13.019310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] The token cache is being invalidate because project bbafc0d85ecc4fd397180100a65180e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:13.019564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.021694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.026429 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2647/5263] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:12 2022] DELETE /identity/v3/projects/bbafc0d85ecc4fd397180100a65180e2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:13.037888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.041472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.056331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e3cb0-0176-4d41-be68-7f631e1b4bea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.215669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17cc15-c5d3-4925-af0c-ff5ac99a49cd tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.217749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.218484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.218863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.219136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.220181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.223508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.246433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.247337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.247620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.247902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/roles/7bbad087a0624a2da20687d5ae91bc4a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.251124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7bbad087a0624a2da20687d5ae91bc4a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.252917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.298444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2617/5264] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:12 2022] POST /identity/v3/users => generated 298 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:13.302371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.310273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.317034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invalidating the token cache because role 7bbad087a0624a2da20687d5ae91bc4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:13.317333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.318027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.320123 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2648/5265] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:13 2022] DELETE /identity/v3/roles/7bbad087a0624a2da20687d5ae91bc4a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:13.324603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.326418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.337104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137007a-c7a4-4139-a0da-8f504d0451e1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.445810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.446987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.447270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.447572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.448349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.449285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf76495-5097-46fb-9c31-799f11991a58 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.450135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.456861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.458662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.459337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.460131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/b6713150dceb43b6b53e99c64c9010c6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.462994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b6713150dceb43b6b53e99c64c9010c6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.465565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.467951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:13.483198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2618/5266] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:13.487424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.490952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.521088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f8c54-d624-46e8-bc53-f91cd6e7dc90 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.532826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.538537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.538537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.539428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] PATH_INFO: `/v3/projects/9555e4342285417e966c6df10d5928af/users/6af5921514914b8d9c73a7029734e13f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.582357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6713150dceb43b6b53e99c64c9010c6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.585941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6713150dceb43b6b53e99c64c9010c6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.607078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6713150dceb43b6b53e99c64c9010c6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.614848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9555e4342285417e966c6df10d5928af, user_id=6af5921514914b8d9c73a7029734e13f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.623391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.627231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6713150dceb43b6b53e99c64c9010c6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.638258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6713150dceb43b6b53e99c64c9010c6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.655762 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2649/5267] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:13 2022] DELETE /identity/v3/users/b6713150dceb43b6b53e99c64c9010c6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:13.660005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.663264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.665612 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2619/5268] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:13 2022] PUT /identity/v3/projects/9555e4342285417e966c6df10d5928af/users/6af5921514914b8d9c73a7029734e13f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:13.666301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.671352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:13.779659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b44b-83c5-44bf-b2ac-23663a8a1cfb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.788745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:13.789895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:13.790289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:13.790700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/cc2704579a644363b061eeaf8a400233` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:13.793091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc2704579a644363b061eeaf8a400233)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:13.796067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:13.842239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:13.892881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1621b8e-2cc6-410b-8d63-448d88de30a2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:13.897645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2704579a644363b061eeaf8a400233', 'request_id': 'req-696dffcb-3c93-438b-b348-87cc7aa0d739'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.912613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2704579a644363b061eeaf8a400233', 'request_id': 'req-696dffcb-3c93-438b-b348-87cc7aa0d739'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.923666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2704579a644363b061eeaf8a400233', 'request_id': 'req-696dffcb-3c93-438b-b348-87cc7aa0d739'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.953324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] The token cache is being invalidate because project cc2704579a644363b061eeaf8a400233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:13.954067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.955222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:13.957711 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2650/5269] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:13 2022] DELETE /identity/v3/projects/cc2704579a644363b061eeaf8a400233 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:13.963908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:13.984938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.014828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:14.049962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.050663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.050950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.051387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.052130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.053802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.065403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2620/5270] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:14.069889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.075349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.117217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcb547-9918-4d71-b0da-00a6a492c2e0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.137232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.139021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.144011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.144564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] PATH_INFO: `/v3/projects/9555e4342285417e966c6df10d5928af/users/6af5921514914b8d9c73a7029734e13f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.153427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9555e4342285417e966c6df10d5928af, user_id=6af5921514914b8d9c73a7029734e13f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.156253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a567f-a5aa-4965-8238-50d27cb33a6c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.172155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffcb-3c93-438b-b348-87cc7aa0d739 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.193217 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2621/5271] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:14 2022] PUT /identity/v3/projects/9555e4342285417e966c6df10d5928af/users/6af5921514914b8d9c73a7029734e13f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:14.199221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.199514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.200034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.285840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.287129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.287334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] MFA Rules not processed for user `6af5921514914b8d9c73a7029734e13f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:14.287606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.288713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/2f85317d32d34eae904b96922ded6e6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.289021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.291538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f85317d32d34eae904b96922ded6e6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.292918 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:14.292918 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:12:14.292918 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:12:14.294737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.345786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.362379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invalidating the token cache because user 2f85317d32d34eae904b96922ded6e6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:14.362819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.363495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-96fe8b2a-adb3-4831-82ed-3c3ae57d48d4 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.369494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2651/5272] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 21:12:13 2022] PATCH /identity/v3/users/2f85317d32d34eae904b96922ded6e6c => generated 297 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:14.370913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.371569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.371569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.405405 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2622/5273] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:14.410300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.424633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d1db6-d6c5-4f92-a808-905ecc983cc3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.430778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.432098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.432683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.433362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects/eebc7e08874e49a2bd3f4c2025abca38` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.435050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:get_project(project_id=eebc7e08874e49a2bd3f4c2025abca38)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.437505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.441893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2623/5274] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:14 2022] GET /identity/v3/projects/eebc7e08874e49a2bd3f4c2025abca38 => generated 387 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:14.447123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] MFA Rules not processed for user `2f85317d32d34eae904b96922ded6e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:14.448364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.448991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.463432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2652/5275] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:14 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:14.468137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.470939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.478724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689473-f839-4444-a178-73be4b7392c4 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.487747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.489337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.490434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.490956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.492001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.495522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.501861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eaf7d-17f8-47ce-96d9-13c40540d6a1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.518509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.519430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.519715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.520134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/2f85317d32d34eae904b96922ded6e6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.521876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f85317d32d34eae904b96922ded6e6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.523841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.560955 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2624/5276] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:14 2022] POST /identity/v3/projects => generated 339 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:14.565767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.599513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.613930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invalidating the token cache because user 2f85317d32d34eae904b96922ded6e6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:14.614366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.614967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.617160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2653/5277] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 21:12:14 2022] PATCH /identity/v3/users/2f85317d32d34eae904b96922ded6e6c => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:14.621475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.625617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.638005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:14.667023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc922-6f0f-4588-be70-5d9fca308dbc tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.715921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34ab7d-8c89-45a2-8232-c238443fc390 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.722896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.723788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.724301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.724688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.725804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:14.727366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.731221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.749347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.750305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.750588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.750985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/2f85317d32d34eae904b96922ded6e6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.769103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f85317d32d34eae904b96922ded6e6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.771402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.777489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2625/5278] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:14 2022] GET /identity/v3/projects => generated 8052 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:14.781773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.784336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.827027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631851f5-a634-4560-9e71-b81bf22f9b77 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.841877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.843670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.843853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.844496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.844971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects/eebc7e08874e49a2bd3f4c2025abca38` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.847950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:get_project(project_id=eebc7e08874e49a2bd3f4c2025abca38)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.850547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.853288 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2626/5279] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:14 2022] GET /identity/v3/projects/eebc7e08874e49a2bd3f4c2025abca38 => generated 387 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:14.857213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.869054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invalidating the token cache because user 2f85317d32d34eae904b96922ded6e6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:14.875605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a2ac-b6f9-4564-97a6-6ff43b627243 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.883127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.885999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e0337486-cbc1-4833-ab98-7058e9a1945e tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:14.895820 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2654/5280] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 21:12:14 2022] PATCH /identity/v3/users/2f85317d32d34eae904b96922ded6e6c => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:14.898329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.898732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.899019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.906575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.912984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.913286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.913574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects/ae6e3d768d974e3383c22545f2dd6e8a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.917156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae6e3d768d974e3383c22545f2dd6e8a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.918819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.923075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2627/5281] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:14 2022] GET /identity/v3/projects/ae6e3d768d974e3383c22545f2dd6e8a => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:14.930338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.932142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.939586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] MFA Rules not processed for user `2f85317d32d34eae904b96922ded6e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:14.940842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.947450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2655/5282] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:14 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:14.948680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:14.951047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:14.963560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51039d4-1d92-41a5-ad9f-daa4b1dce4b1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.969786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f63aa3-1f66-4be6-b6e1-bd2f13dc2126 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:14.970615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.972101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.972565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.972923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.973779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.975409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:14.975899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:14.976474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:14.976877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:14.977230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/2f85317d32d34eae904b96922ded6e6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:14.978923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f85317d32d34eae904b96922ded6e6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:14.981250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.023371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2628/5283] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:14 2022] GET /identity/v3/projects => generated 8052 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:12:15.025003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.035123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.053480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1da1af-671e-4141-8311-2fb5ccd671f9 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.055783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invalidating the token cache because user 2f85317d32d34eae904b96922ded6e6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:15.056214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.057283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.060451 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2656/5284] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 21:12:14 2022] PATCH /identity/v3/users/2f85317d32d34eae904b96922ded6e6c => generated 297 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:15.067604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.069178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:15.073165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.073931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.076243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.076641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.077500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:15.078175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.080193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.085118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2bd2e-c5d1-446c-9dce-940201bcbd91 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.091092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.092500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.093419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.093419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.093990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.096259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.112294 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2629/5285] 10.222.0.39 () {58 vars in 1165 bytes} [Sat Jun 25 21:12:15 2022] GET /identity/v3/projects?domain_id=default => generated 7721 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:15.114818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.118281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:15.145400 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2657/5286] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:12:15 2022] POST /identity/v3/users => generated 264 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:15.146592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.147690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea434-7b43-4b38-aa0c-4ccd27c5d323 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.153354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.154183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.154473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.154769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.155637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.157846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.162549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9dde-1772-4c0e-93f6-a037e691c2ad tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.168614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.170653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.170653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.171238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/8619c2a17fe44932a530ba7e73516873/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.193328 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2630/5287] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:15 2022] GET /identity/v3/projects => generated 8052 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:15.198488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.222815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e907731-1017-40cf-8b7e-ee6a46e5068e tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.237740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.238425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.238735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.238996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.239761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:15.240074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.242125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.267612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.281844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2658/5288] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:12:15 2022] POST /identity/v3/users/8619c2a17fe44932a530ba7e73516873/password => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:15.289011 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2631/5289] 10.222.0.39 () {58 vars in 1165 bytes} [Sat Jun 25 21:12:15 2022] GET /identity/v3/projects?domain_id=default => generated 7721 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:12:15.302552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.322633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b19a53-f37c-4c5c-a1bc-5cf102cf562f tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.334447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.335222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.335572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.335883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.337367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.341430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.394776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2659/5290] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:15 2022] GET /identity/v3/projects => generated 8052 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:15.399610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.426598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f94ce-3cb5-46a0-877c-e287341a238d tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.443756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.444526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.444824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.445106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.446030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-188316220) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:15.446504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.448456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.489631 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2632/5291] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:12:15 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-188316220 => generated 534 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:15.494698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.513961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa33e-a61f-425c-a5ba-ff55a069aef1 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.527904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af5921514914b8d9c73a7029734e13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9555e4342285417e966c6df10d5928af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.529043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.529881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:15.529881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] PATH_INFO: `/v3/projects/ae6e3d768d974e3383c22545f2dd6e8a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:15.531466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ae6e3d768d974e3383c22545f2dd6e8a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:15.559816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:15.660466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:15.695441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6e3d768d974e3383c22545f2dd6e8a', 'request_id': 'req-f901736d-b20c-4ac9-98df-84adbb0fecd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.718120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6e3d768d974e3383c22545f2dd6e8a', 'request_id': 'req-f901736d-b20c-4ac9-98df-84adbb0fecd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.731887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6e3d768d974e3383c22545f2dd6e8a', 'request_id': 'req-f901736d-b20c-4ac9-98df-84adbb0fecd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.752286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] The token cache is being invalidate because project ae6e3d768d974e3383c22545f2dd6e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:15.753005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.754038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f901736d-b20c-4ac9-98df-84adbb0fecd0 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:15.756994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2660/5292] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:15 2022] DELETE /identity/v3/projects/ae6e3d768d974e3383c22545f2dd6e8a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:15.761685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:15.764220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:15.903593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bd5c-0849-4047-b3ea-6de8a80da834 tempest-ListProjectsStaticTestJSON-5649843 tempest-ListProjectsStaticTestJSON-5649843-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:15.988803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:15.997553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:15.999028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:15.999479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.002079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] PATH_INFO: `/v3/users/1853a6e59c4040e198f63c3a2ee6474e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.004336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1853a6e59c4040e198f63c3a2ee6474e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.007436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:16.125904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1853a6e59c4040e198f63c3a2ee6474e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.144017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1853a6e59c4040e198f63c3a2ee6474e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.161032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1853a6e59c4040e198f63c3a2ee6474e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.162359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1853a6e59c4040e198f63c3a2ee6474e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.163872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77193ed6-742c-43d2-8122-2d82bf154a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1853a6e59c4040e198f63c3a2ee6474e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.200487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2633/5293] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:15 2022] DELETE /identity/v3/users/1853a6e59c4040e198f63c3a2ee6474e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:16.205872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.206487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.207040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.237498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:16.239482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.288895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.289409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.289897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.324654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] MFA Rules not processed for user `8619c2a17fe44932a530ba7e73516873`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:16.330435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.354590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2634/5294] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:16 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:16.355504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:16.357544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.387844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2661/5295] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:16.401405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:16.404735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.501685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d69fd-607a-45bc-9ccc-e8b52f8e575a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:16.513752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:16.514679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.515116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.515621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.515816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1c3a-aa3a-47fa-a4ad-0346c1c20556 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:16.525500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:16.526324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.526443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.526712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.532896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.537092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:16.552743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.555838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:16.560856 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2635/5296] 10.222.0.39 () {56 vars in 1262 bytes} [Sat Jun 25 21:12:16 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:16.563408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:16.567487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.573114 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2662/5297] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:16.573114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:16.592375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1d263-b396-4d7c-8aed-162160af4bf2 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:16.592610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc435bc-4652-4524-9923-bd7762d9a8c1 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:16.597427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:16.598394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.598650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.598933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/8619c2a17fe44932a530ba7e73516873` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.599486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:16.600514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.600859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.601131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8619c2a17fe44932a530ba7e73516873)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.601356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] PATH_INFO: `/v3/users/cfb795b2d1394fa7bf02c107989731e7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.603087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:16.603909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb795b2d1394fa7bf02c107989731e7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.606161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:16.696181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.697165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.701395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb795b2d1394fa7bf02c107989731e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.718285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.721110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:16.722971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb795b2d1394fa7bf02c107989731e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.733304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:16.743678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb795b2d1394fa7bf02c107989731e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.744571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb795b2d1394fa7bf02c107989731e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.745790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb795b2d1394fa7bf02c107989731e7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.752732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.763101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8619c2a17fe44932a530ba7e73516873'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:16.774306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2636/5298] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:16 2022] DELETE /identity/v3/users/cfb795b2d1394fa7bf02c107989731e7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:16.780999 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2663/5299] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:16 2022] DELETE /identity/v3/users/8619c2a17fe44932a530ba7e73516873 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:16.789197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:16.790895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:16.887443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f04-1527-46c5-a2ed-1a2ee4444a41 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:16.975305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:16.976535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:16.977027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:16.977716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:16.978699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:16.981748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.018413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2637/5300] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:16 2022] POST /identity/v3/users => generated 364 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:17.023475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.028903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.069432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f7e9f-318e-4b2d-8810-8af09607ed62 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.092398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.093524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.094046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.094408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.095239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.097189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.176587 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2664/5301] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:17 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:17.177932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.195179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc61a-08ea-45c4-b6f7-ee2b64bd069d tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.264745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.268203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.304777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.306292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.306822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.307340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/9a6620b3a97d41aba7d0f792df301be4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.363231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:update_user(user_id=9a6620b3a97d41aba7d0f792df301be4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.366351 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:17.366351 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:12:17.366351 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:12:17.370278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.379089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:17.409860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed386-3939-4ba6-aefd-71a07182dde0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.417115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.417604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.417891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.418167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] PATH_INFO: `/v3/projects/c32fe49f7bcc41e3977a7773bef15000` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.419821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32fe49f7bcc41e3977a7773bef15000)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.422382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.458509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2638/5302] 10.222.0.39 () {60 vars in 1243 bytes} [Sat Jun 25 21:12:17 2022] PATCH /identity/v3/users/9a6620b3a97d41aba7d0f792df301be4 => generated 523 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:17.460037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.483792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002e86-f0db-438c-9a8f-d3f8a9734ead tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.487299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32fe49f7bcc41e3977a7773bef15000', 'request_id': 'req-ae701e83-5926-41ad-8c15-e165e63780e7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.497676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32fe49f7bcc41e3977a7773bef15000', 'request_id': 'req-ae701e83-5926-41ad-8c15-e165e63780e7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.518807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32fe49f7bcc41e3977a7773bef15000', 'request_id': 'req-ae701e83-5926-41ad-8c15-e165e63780e7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.559917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] The token cache is being invalidate because project c32fe49f7bcc41e3977a7773bef15000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:17.560221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.561068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.563318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2665/5303] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:17 2022] DELETE /identity/v3/projects/c32fe49f7bcc41e3977a7773bef15000 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:17.564270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.566063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.641018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.643298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.644025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.644305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/9a6620b3a97d41aba7d0f792df301be4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.646590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:17.670969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:get_user(user_id=9a6620b3a97d41aba7d0f792df301be4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.675264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2170c6-59e9-42d6-ae76-49df14d0f59c tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.677716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e83-5926-41ad-8c15-e165e63780e7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.680546 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2639/5304] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:12:17 2022] GET /identity/v3/users/9a6620b3a97d41aba7d0f792df301be4 => generated 389 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:17.683491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.683784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.684063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.685982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.687008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.687479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.687824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] PATH_INFO: `/v3/projects/eebc7e08874e49a2bd3f4c2025abca38` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.689750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebc7e08874e49a2bd3f4c2025abca38)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.691864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.707540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:17.709562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.720296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2640/5305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:17.721209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.722509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.741345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c5276-4896-4133-9bfa-c34a56d85fb5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.747852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.749023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.749443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.749645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/projects/09d02bb852894e3390d9f6d37b330e35` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.751791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09d02bb852894e3390d9f6d37b330e35)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.753960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:17.775872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebc7e08874e49a2bd3f4c2025abca38', 'request_id': 'req-fa8fcc32-4f64-486c-b357-0df483061df7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.789712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebc7e08874e49a2bd3f4c2025abca38', 'request_id': 'req-fa8fcc32-4f64-486c-b357-0df483061df7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.799489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebc7e08874e49a2bd3f4c2025abca38', 'request_id': 'req-fa8fcc32-4f64-486c-b357-0df483061df7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.821717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d02bb852894e3390d9f6d37b330e35', 'request_id': 'req-f49aca12-d00e-4ff6-b3ca-84856c5600f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.830437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] The token cache is being invalidate because project eebc7e08874e49a2bd3f4c2025abca38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:17.831070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.831978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fa8fcc32-4f64-486c-b357-0df483061df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.834104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d02bb852894e3390d9f6d37b330e35', 'request_id': 'req-f49aca12-d00e-4ff6-b3ca-84856c5600f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.838437 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2666/5306] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:17 2022] DELETE /identity/v3/projects/eebc7e08874e49a2bd3f4c2025abca38 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:17.839879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.840226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.840581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.843677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d02bb852894e3390d9f6d37b330e35', 'request_id': 'req-f49aca12-d00e-4ff6-b3ca-84856c5600f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.860861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] The token cache is being invalidate because project 09d02bb852894e3390d9f6d37b330e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:17.861520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.862412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:17.868306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2641/5307] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:17 2022] DELETE /identity/v3/projects/09d02bb852894e3390d9f6d37b330e35 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:17.869495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:17.869848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:17.870776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.871745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:17.946392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:17.966008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aca12-d00e-4ff6-b3ca-84856c5600f0 tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:17.979500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:17.981177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:17.981177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:17.981177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] PATH_INFO: `/v3/users/6af5921514914b8d9c73a7029734e13f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:17.983489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af5921514914b8d9c73a7029734e13f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:17.987122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.043433 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2667/5308] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:18.044789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.049666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.073909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af5921514914b8d9c73a7029734e13f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.086028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af5921514914b8d9c73a7029734e13f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.111217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af5921514914b8d9c73a7029734e13f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.112101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af5921514914b8d9c73a7029734e13f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.113637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af5921514914b8d9c73a7029734e13f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.148123 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2642/5309] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:17 2022] DELETE /identity/v3/users/6af5921514914b8d9c73a7029734e13f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:18.152000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.153926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.217899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b9f3-5c84-424b-8d6c-e3d244c537ee None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.237814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb47eb-3e40-4ab1-8b73-723abdbaa031 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.243708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.244407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.244747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.245023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.245478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:18.245912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:18.246549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.248027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.270770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2643/5310] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:18.273307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.295855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4776-6c64-42c6-945c-b07b9f7484ee admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.309395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.310057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.310341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.310801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.311324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.313636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.331862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2154360134646e2a7fba91500a8fe04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66d5852d1c504b0485ff0d4a982b7c52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.332775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.333069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.333345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] PATH_INFO: `/v3/users/9a6620b3a97d41aba7d0f792df301be4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.335384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9a6620b3a97d41aba7d0f792df301be4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.338243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.373006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2644/5311] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:18 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:18.376010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.434452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6620b3a97d41aba7d0f792df301be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.435483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6620b3a97d41aba7d0f792df301be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.444766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6620b3a97d41aba7d0f792df301be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.462042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6620b3a97d41aba7d0f792df301be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.463685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:18.473733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6620b3a97d41aba7d0f792df301be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.483633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2668/5312] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:18 2022] DELETE /identity/v3/users/9a6620b3a97d41aba7d0f792df301be4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:18.491210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.492973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.503038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca21616-b3d0-4404-8fcb-02fe06db138c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.580205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10d0d-de30-49be-8dfe-3c560a5d44bb tempest-UsersV3TestJSON-1293807237 tempest-UsersV3TestJSON-1293807237-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.591745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.592895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.593606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.593986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] PATH_INFO: `/v3/users/2f85317d32d34eae904b96922ded6e6c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.623624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f85317d32d34eae904b96922ded6e6c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.626380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.658702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.659974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.660274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.660726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.661629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.663582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.695478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2645/5313] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:18 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:18.700280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.702665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.704169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:18.733475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a6e60-9f55-468f-a397-ec2fe63349c7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.742150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.744796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.745745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.746601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.746783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.747168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.747977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.749948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.759746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.777976 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2646/5314] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:18.784280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.784793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.793547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.799238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db71c0d3-cb7b-4f7a-b952-e6416f2f03d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f85317d32d34eae904b96922ded6e6c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:18.814319 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2669/5315] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:18 2022] DELETE /identity/v3/users/2f85317d32d34eae904b96922ded6e6c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:18.818877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129c8c-ff41-4d69-946b-1473ff6e627c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:18.819473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.819887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.820142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.857732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:18.858800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:18.926171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:18.928048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:18.928593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:18.929056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:18.929984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:18.932309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:18.947713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2647/5316] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:18.955943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:18.984555 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2670/5317] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:18.987814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5001d-12d9-4a7c-8ff9-53cfb7c08440 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.007937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:19.011459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.015441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.017934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.019515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.019870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] PATH_INFO: `/v3/projects/2afdedec58384749bdf082455e2cc2b9/users/8478d4ac9a9045e8b82fd5f47feb1602/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.067348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afdedec58384749bdf082455e2cc2b9, user_id=8478d4ac9a9045e8b82fd5f47feb1602, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:19.074365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899787b-a02e-4d61-be4b-3eae5a0c6d3d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:19.116681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2648/5318] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:18 2022] PUT /identity/v3/projects/2afdedec58384749bdf082455e2cc2b9/users/8478d4ac9a9045e8b82fd5f47feb1602/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:19.120947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.121524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.122600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.126661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2dde0-e7db-4bc3-a53a-48fe628532fc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.241117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] MFA Rules not processed for user `8478d4ac9a9045e8b82fd5f47feb1602`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:19.242365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.267620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.272451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.272451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.272451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.318631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:19.344214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:19.395721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2649/5319] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:19.397009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:19.399978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.418198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:19.419897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:19.433236 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2671/5320] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:19.434786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:19.435962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.451003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb1b3-42d6-4583-a58c-2e14e7331716 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.455201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.456022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.456361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.456871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.458787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.521101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aa011-c6c1-4147-a803-518027b03aee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.526895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.529190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.529781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.530367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] PATH_INFO: `/v3/projects/9555e4342285417e966c6df10d5928af` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.532067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9555e4342285417e966c6df10d5928af)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:19.534675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:19.605629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9555e4342285417e966c6df10d5928af', 'request_id': 'req-87e62232-f1ab-42c6-b48e-aa09bb572528'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:19.620908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9555e4342285417e966c6df10d5928af', 'request_id': 'req-87e62232-f1ab-42c6-b48e-aa09bb572528'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:19.631542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:19.634052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:19.638725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9555e4342285417e966c6df10d5928af', 'request_id': 'req-87e62232-f1ab-42c6-b48e-aa09bb572528'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:19.656005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] The token cache is being invalidate because project 9555e4342285417e966c6df10d5928af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:19.656222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:19.656981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:19.659190 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2650/5321] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:19 2022] DELETE /identity/v3/projects/9555e4342285417e966c6df10d5928af => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:19.659326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2672/5322] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:19.661599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:19.663339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.677353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:19.680951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.847697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62232-f1ab-42c6-b48e-aa09bb572528 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.857776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.858455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.858741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.859097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.860983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.862936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c0095-25df-4595-8db5-4ea559cc26c8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:19.887807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:19.889394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32919aa-53bc-462f-b9f7-7436a811e903 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:19.902962 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2651/5323] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:19.904310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fd77-3168-402c-b45e-f14d00fb99ad None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.904618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fd77-3168-402c-b45e-f14d00fb99ad None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.904906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fd77-3168-402c-b45e-f14d00fb99ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.914475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:19.926225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:19.946115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ea15fd77-3168-402c-b45e-f14d00fb99ad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:19.947730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea15fd77-3168-402c-b45e-f14d00fb99ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:19.965405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:19.967588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:19.969610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:19.972565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:19.974918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:20.071085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2652/5324] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:20.079516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.079516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.079516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.118204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:20.119445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:20.134567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.136515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.138139 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2653/5325] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:20.145454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.154450 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2673/5326] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:20.166965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7202fbc-6169-4861-b752-d9a55bfa686f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.188462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.192226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.192662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.193452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.194384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:20.194794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.198174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bea9e-fa0a-4754-8ad8-00576a7cb5eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.223717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2654/5327] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:20.225614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.245923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb87ac-5360-492c-8589-417f60164942 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.254992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.255706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.255992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.257094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.258270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.262513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.271968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a3c4-da71-4945-8133-f6561989834d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.272884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a3c4-da71-4945-8133-f6561989834d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.273272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a3c4-da71-4945-8133-f6561989834d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.302740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3949a3c4-da71-4945-8133-f6561989834d None None] MFA Rules not processed for user `8478d4ac9a9045e8b82fd5f47feb1602`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:20.304397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3949a3c4-da71-4945-8133-f6561989834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:20.326994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2655/5328] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:20.331989 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2674/5329] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:20.349780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.489591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376315-4cb1-451a-b3f2-961b968792eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.505742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.506513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.506893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.507236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.507826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.510097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.558110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2675/5330] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:20.562262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949a3c4-da71-4945-8133-f6561989834d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.581830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949a3c4-da71-4945-8133-f6561989834d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.607792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.609793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.610863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.611262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.613238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.615342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.653375 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2656/5331] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:20.657747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.672588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c143b-12b8-4167-b334-f99d6aea8e78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.681806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.681806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.681806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.681806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.682328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.684210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d6a4b-71cf-461e-8081-9a5f1ad55473 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.716788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2676/5332] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:20.725619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.758352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff35b-0a41-41d7-b27b-97efe4471f9b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:20.763841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:20.765835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.766218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.766743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] PATH_INFO: `/v3/projects/d6a95c4aedd44a609fc8910355ab0246/users/f8a4d9af144249de856277f382c9cc70/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.791198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a95c4aedd44a609fc8910355ab0246, user_id=f8a4d9af144249de856277f382c9cc70, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:20.794415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:20.823435 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2657/5333] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:20 2022] PUT /identity/v3/projects/d6a95c4aedd44a609fc8910355ab0246/users/f8a4d9af144249de856277f382c9cc70/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:20.835550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:20.835841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:20.836199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:20.866828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] MFA Rules not processed for user `f8a4d9af144249de856277f382c9cc70`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:20.868941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:20.892096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:20.966696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:20.969245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:20.995983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2677/5334] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:20.996954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.094318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243a14-6115-4fd1-b204-d62fdf2d1609 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.102655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.103659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.104090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.104536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.105383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.107470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.124242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acc23-c3f4-4ac9-a5eb-03ce1b86ec97 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.145168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.147859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.148254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.150761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] PATH_INFO: `/v3/users/8478d4ac9a9045e8b82fd5f47feb1602` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.153446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8478d4ac9a9045e8b82fd5f47feb1602)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.156245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.177182 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2678/5335] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:20 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:21.180914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.260126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:21.264260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8478d4ac9a9045e8b82fd5f47feb1602'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.289231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae3f9-d55f-4c26-a415-6541570acb28 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.295161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8478d4ac9a9045e8b82fd5f47feb1602'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.300996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.301734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.302014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.302360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.303195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.305124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.342268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8478d4ac9a9045e8b82fd5f47feb1602'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.344684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8478d4ac9a9045e8b82fd5f47feb1602'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.345379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8478d4ac9a9045e8b82fd5f47feb1602'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.353282 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2679/5336] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:21 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:21.354405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.357753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.372451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b550-68d3-4b4f-ad7e-a1ca24bc50ca admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.373593 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2658/5337] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:20 2022] DELETE /identity/v3/users/8478d4ac9a9045e8b82fd5f47feb1602 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:21.374370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.375732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.426289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:21.459155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.460161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.460630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.461010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] PATH_INFO: `/v3/projects/f82c5b46749f4cd2addc5eca6fbd45ad` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.463052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82c5b46749f4cd2addc5eca6fbd45ad)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.465263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.474584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb9d57-bb9b-4a9c-b4d8-6de2bc5516c6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.480786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.481485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.481773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.482052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.482780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.484553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2136cba-388e-4f9a-b3b8-aa139d3e37d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.499589 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2659/5338] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:21.502083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.502454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.502807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.525572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:21.527703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.530293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82c5b46749f4cd2addc5eca6fbd45ad', 'request_id': 'req-b41168ec-5375-45c7-a782-e8479dc1d64c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.544691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82c5b46749f4cd2addc5eca6fbd45ad', 'request_id': 'req-b41168ec-5375-45c7-a782-e8479dc1d64c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.557842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82c5b46749f4cd2addc5eca6fbd45ad', 'request_id': 'req-b41168ec-5375-45c7-a782-e8479dc1d64c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.579579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] The token cache is being invalidate because project f82c5b46749f4cd2addc5eca6fbd45ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:21.580702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.582908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.585772 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2680/5339] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:21 2022] DELETE /identity/v3/projects/f82c5b46749f4cd2addc5eca6fbd45ad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:21.586994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.588885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.653514 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2660/5340] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:21.658819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.661662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.705918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac43f9-419a-435f-bbd4-e126a3a78a5e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.722278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.723641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.727700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.729261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] PATH_INFO: `/v3/users/f2154360134646e2a7fba91500a8fe04` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.753286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2154360134646e2a7fba91500a8fe04)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.763016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.865090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ec-5375-45c7-a782-e8479dc1d64c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:21.878375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:21.881185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:21.881563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:21.881862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] PATH_INFO: `/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac/users/d04aeee153c0450fb1a60a1481f37a04/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:21.915400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2154360134646e2a7fba91500a8fe04'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.923369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8411b7f87d4d60ba2c0a9108b806ac, user_id=d04aeee153c0450fb1a60a1481f37a04, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:21.926168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:21.948713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2154360134646e2a7fba91500a8fe04'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.949277 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2681/5341] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:21 2022] PUT /identity/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac/users/d04aeee153c0450fb1a60a1481f37a04/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:21.950207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:21.952899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:21.955362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:21.989152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2154360134646e2a7fba91500a8fe04'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.990291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2154360134646e2a7fba91500a8fe04'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:21.991715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2154360134646e2a7fba91500a8fe04'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:22.025836 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2661/5342] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:21 2022] DELETE /identity/v3/users/f2154360134646e2a7fba91500a8fe04 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:22.026683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.031233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:22.083223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52660cdb-8b59-427f-ba66-87df79665057 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.098273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:22.195043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceef55-ed21-4500-80f7-842f20c497b3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.208768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.209919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.210600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.212753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.220738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.225240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.225857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:22.227953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.229213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.229981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.236208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:22.255996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2662/5343] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:22.260810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.271839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.274187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19605497-8b64-4306-9b7c-c2edcfd8a70f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:22.284282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb6c8-707b-41e0-8ade-256cb672a862 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.295130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.298201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.298598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.298985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] PATH_INFO: `/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac/users/d04aeee153c0450fb1a60a1481f37a04/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.300361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2682/5344] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:22.302540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8411b7f87d4d60ba2c0a9108b806ac, user_id=d04aeee153c0450fb1a60a1481f37a04, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.305195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:22.325952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2663/5345] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:22 2022] PUT /identity/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac/users/d04aeee153c0450fb1a60a1481f37a04/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:22.328261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.328719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.329107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.379720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] MFA Rules not processed for user `d04aeee153c0450fb1a60a1481f37a04`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:22.382419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:22.514023 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2683/5346] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:22.518494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.530820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15a5d1-85cb-4381-955e-c1a906e129b4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.536334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.537101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.537394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.537718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.538442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.540670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:22.586162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2664/5347] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:22 2022] POST /identity/v3/projects => generated 334 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:22.590675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.603960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c36882-f840-4040-a8f0-fa76009b0888 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.748859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.749503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.749795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.750078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.750774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.754813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:22.825718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2684/5348] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:22 2022] POST /identity/v3/projects => generated 333 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:22.831198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.853867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41a1e-8f84-41d6-b034-505e23e7cae8 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:22.889940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:22.893748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:22.939030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:22.960944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:22.962491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:22.962776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:22.963054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:22.963752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:22.966172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.001309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186ba88-41d2-4a45-8cbf-0539a9daf7f0 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.009763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.011019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.011379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.011788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] PATH_INFO: `/v3/projects/2afdedec58384749bdf082455e2cc2b9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.013127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afdedec58384749bdf082455e2cc2b9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.016869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.037289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2665/5349] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:22 2022] POST /identity/v3/projects => generated 357 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:23.041784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.062179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:23.084619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afdedec58384749bdf082455e2cc2b9', 'request_id': 'req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.097546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afdedec58384749bdf082455e2cc2b9', 'request_id': 'req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.107061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afdedec58384749bdf082455e2cc2b9', 'request_id': 'req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.120923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] The token cache is being invalidate because project 2afdedec58384749bdf082455e2cc2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:23.121206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.122589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ed613fa4-18a6-4d24-b505-ee5e1ceaced2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.127830 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2685/5350] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:22 2022] DELETE /identity/v3/projects/2afdedec58384749bdf082455e2cc2b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:23.130668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74bca-1e23-476d-a86d-0bf9aaef772c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.130948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74bca-1e23-476d-a86d-0bf9aaef772c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.131278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e74bca-1e23-476d-a86d-0bf9aaef772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.156570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c1e74bca-1e23-476d-a86d-0bf9aaef772c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:23.157937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c1e74bca-1e23-476d-a86d-0bf9aaef772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:23.169165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c203ae3-2fdf-4bfb-acfe-c1e4036ebe37 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.294148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2686/5351] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:23.296099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.296884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.297421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.309916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.311428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.311428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.311428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.312489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.315393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.324650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:23.328004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:23.342552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2687/5352] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:23.343758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.346176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2666/5353] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:23 2022] GET /identity/v3/projects => generated 7963 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:23.351390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.353890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:23.354589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45e9c-b65e-45b6-9d34-304bf2111e5f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.367292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.368014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc08a-ae59-46b4-8aac-200889a90fea tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.368216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.368535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.368872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.369628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:23.371334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.374182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.375144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.375562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.375985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.376169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.377738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:23.378197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.380401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.408219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2688/5354] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:23.409143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2667/5355] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:12:23 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:23.415553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.421625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.435556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f8dc-10fd-46fc-89a7-a79c6e96bd75 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.442174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf102a-d391-40be-8c30-7295a61b8a48 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.445734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.446551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.446933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.447669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.449772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Adding query filter params (parent_id=e6d663e7bd2f431f9fb1aed49b33d5f6) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:23.450652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.453951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.454800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.455592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.457818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.458214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.459268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.462404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.501826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2668/5356] 10.222.0.39 () {58 vars in 1215 bytes} [Sat Jun 25 21:12:23 2022] GET /identity/v3/projects?parent_id=e6d663e7bd2f431f9fb1aed49b33d5f6 => generated 497 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:23.503307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.524416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892803-c4bc-427e-aa81-5848194f567e tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.539215 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2689/5357] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:23 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:23.545480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.568289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:23.645754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.648151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.648546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.648836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects/62cec1c9d1154c9d83ce3a92ed09586a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.652513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62cec1c9d1154c9d83ce3a92ed09586a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.656676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.690317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba21aa-c2c0-447d-bb82-8234f2eace91 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.697570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.698389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.698872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.699218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.700027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.703616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.714899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:23.742654 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2690/5358] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:23 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:23.744371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.747297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:23.763305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cec1c9d1154c9d83ce3a92ed09586a', 'request_id': 'req-3660f4cc-5abf-430b-ae17-ddd9c07e85de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.766931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab475f-7723-4d6d-8fea-cc6df245ebe7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:23.779260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cec1c9d1154c9d83ce3a92ed09586a', 'request_id': 'req-3660f4cc-5abf-430b-ae17-ddd9c07e85de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.789542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cec1c9d1154c9d83ce3a92ed09586a', 'request_id': 'req-3660f4cc-5abf-430b-ae17-ddd9c07e85de'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.841915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] The token cache is being invalidate because project 62cec1c9d1154c9d83ce3a92ed09586a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:23.843719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.844636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.852567 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2669/5359] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:23 2022] DELETE /identity/v3/projects/62cec1c9d1154c9d83ce3a92ed09586a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:23.852567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:23.853252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:23.863508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:23.864688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:23.865315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:23.865803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] PATH_INFO: `/v3/users/9d87994650a141c1b3dcefbaa3a2954f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:23.871480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d87994650a141c1b3dcefbaa3a2954f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:23.873831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:23.951906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d87994650a141c1b3dcefbaa3a2954f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.952405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d87994650a141c1b3dcefbaa3a2954f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.965273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d87994650a141c1b3dcefbaa3a2954f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:23.998005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d87994650a141c1b3dcefbaa3a2954f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.001536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f4cc-5abf-430b-ae17-ddd9c07e85de tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.011447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.012394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.012760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.012914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d87994650a141c1b3dcefbaa3a2954f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.017178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] PATH_INFO: `/v3/projects/66d5852d1c504b0485ff0d4a982b7c52` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.018742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d5852d1c504b0485ff0d4a982b7c52)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.021152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.022552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2691/5360] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:23 2022] DELETE /identity/v3/users/9d87994650a141c1b3dcefbaa3a2954f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:24.023562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.045107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.084809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:24.115344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d5852d1c504b0485ff0d4a982b7c52', 'request_id': 'req-e7a4bff3-2a0a-461c-b89b-55a06781c857'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.128016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d5852d1c504b0485ff0d4a982b7c52', 'request_id': 'req-e7a4bff3-2a0a-461c-b89b-55a06781c857'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.140793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d5852d1c504b0485ff0d4a982b7c52', 'request_id': 'req-e7a4bff3-2a0a-461c-b89b-55a06781c857'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.170521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] The token cache is being invalidate because project 66d5852d1c504b0485ff0d4a982b7c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:24.171957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.172992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.179180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5bf2d-a642-4a66-b2e7-e46779ee5171 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.188321 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2670/5361] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:23 2022] DELETE /identity/v3/projects/66d5852d1c504b0485ff0d4a982b7c52 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:24.189804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.191516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.273739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.276459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.276869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.277587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.278789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.284046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6659443-636f-4f32-ba7f-13ff100d0291 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.297344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:24.300819 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2692/5362] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:24.302342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.302635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.302911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.323359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4bff3-2a0a-461c-b89b-55a06781c857 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.328829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:24.329858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.330040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.331019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.331406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.331781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects/e6d663e7bd2f431f9fb1aed49b33d5f6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.333262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e6d663e7bd2f431f9fb1aed49b33d5f6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.335461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.341344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2693/5363] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:24.342368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.347788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.370435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8299c10-a7e7-4f3c-b5dc-8581abbdda11 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.376960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.378065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.378556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.378848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.380688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.382825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc093bd-6fe3-4ebc-b994-5ced05f71ae1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.395340 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2694/5364] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:24.397376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.397792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.398130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.421734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:24.423400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.438529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d663e7bd2f431f9fb1aed49b33d5f6', 'request_id': 'req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.451265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d663e7bd2f431f9fb1aed49b33d5f6', 'request_id': 'req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.462040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d663e7bd2f431f9fb1aed49b33d5f6', 'request_id': 'req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.479326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] The token cache is being invalidate because project e6d663e7bd2f431f9fb1aed49b33d5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:24.479624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.480308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.483042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2671/5365] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:24 2022] DELETE /identity/v3/projects/e6d663e7bd2f431f9fb1aed49b33d5f6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:24.484133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.485868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.552962 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2695/5366] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:24.554445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.555879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.619727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdeb1-f7d2-4bf8-99cc-829a4c201d2b tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.634809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.636077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.636776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.637472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] PATH_INFO: `/v3/projects/78bbd68e6c6e4a9ca1a5e5a4c872eb5d/users/bd74e4b366624b72844b2d19f8b8bc35/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.651453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:24.659024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bbd68e6c6e4a9ca1a5e5a4c872eb5d, user_id=bd74e4b366624b72844b2d19f8b8bc35, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.668143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.678543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12265828-fe6c-4ec4-9d55-db4f0527084e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.693262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd04aeee153c0450fb1a60a1481f37a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.695213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.695888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.696469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] PATH_INFO: `/v3/projects/0b120d4d9a2342609ea3a155cbf84803` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.698940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b120d4d9a2342609ea3a155cbf84803)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.700129 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2672/5367] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:24 2022] PUT /identity/v3/projects/78bbd68e6c6e4a9ca1a5e5a4c872eb5d/users/bd74e4b366624b72844b2d19f8b8bc35/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:24.702029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.702178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.765584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b120d4d9a2342609ea3a155cbf84803', 'request_id': 'req-33f9d64c-f318-4d9a-a1c7-642efe9ea109'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.775155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b120d4d9a2342609ea3a155cbf84803', 'request_id': 'req-33f9d64c-f318-4d9a-a1c7-642efe9ea109'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.783112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b120d4d9a2342609ea3a155cbf84803', 'request_id': 'req-33f9d64c-f318-4d9a-a1c7-642efe9ea109'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.792708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e80622-4048-4ddb-a019-25dacabd4c57 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.795298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] The token cache is being invalidate because project 0b120d4d9a2342609ea3a155cbf84803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:24.795627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.796637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.801511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2696/5368] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:24 2022] DELETE /identity/v3/projects/0b120d4d9a2342609ea3a155cbf84803 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:24.801678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:24.801777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.801777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.879493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.880113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.881026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.881319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.882070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:24.882382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.884240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96780-8e3e-42fe-9ead-51893a2e39ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.896032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d64c-f318-4d9a-a1c7-642efe9ea109 tempest-ListProjectsTestJSON-783572384 tempest-ListProjectsTestJSON-783572384-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.900243 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2673/5369] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:24.900243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.900243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.900243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.910278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.911184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.911466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.911913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] PATH_INFO: `/v3/projects/ad6090a9a7c9488ba44277ab6fbf40aa` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.913350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6090a9a7c9488ba44277ab6fbf40aa)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.915398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.921497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:24.923083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.932360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2674/5370] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:24.933749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:24.936659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:24.952126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652cdb6-dd9b-4c9c-a445-8e55acf74081 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:24.958732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:24.960259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:24.961551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:24.961846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] PATH_INFO: `/v3/users/f8a4d9af144249de856277f382c9cc70` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:24.963255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a4d9af144249de856277f382c9cc70)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:24.965862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:24.973461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6090a9a7c9488ba44277ab6fbf40aa', 'request_id': 'req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.983038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6090a9a7c9488ba44277ab6fbf40aa', 'request_id': 'req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:24.991109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6090a9a7c9488ba44277ab6fbf40aa', 'request_id': 'req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.005364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] The token cache is being invalidate because project ad6090a9a7c9488ba44277ab6fbf40aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:25.005758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.006675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.008980 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2697/5371] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:24 2022] DELETE /identity/v3/projects/ad6090a9a7c9488ba44277ab6fbf40aa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:25.009609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.011175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.024219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:25.037232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a4d9af144249de856277f382c9cc70'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.049024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a4d9af144249de856277f382c9cc70'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.070776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a4d9af144249de856277f382c9cc70'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.072330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a4d9af144249de856277f382c9cc70'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.073382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a4d9af144249de856277f382c9cc70'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.096879 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2675/5372] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:24 2022] DELETE /identity/v3/users/f8a4d9af144249de856277f382c9cc70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:25.096879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.097195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.103070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4ba3-f1c3-4026-ad82-0aff045b1784 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.178469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.179483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.179908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.180334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.181217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.183069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86002-3f8d-4d1f-8104-673c67e69996 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.183984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.188071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.189061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.189848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.190136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.192918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.212017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.213603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47baa97-b9ac-4bca-b0bf-bfa5b93adbfc service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.218505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2698/5373] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:25 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:25.219623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.223701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.230428 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2676/5374] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:25.245445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.245735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.246031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.278616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:25.280747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.287143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:25.308634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457e784-409a-401a-97f9-3d073a414e2a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.317150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.318440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.318876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.319305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] PATH_INFO: `/v3/users/22786e5abe474005ad857fd96d64b067` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.320897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22786e5abe474005ad857fd96d64b067)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.323412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.384989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2677/5375] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:25.386827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.389401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.406753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:25.412392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298755a-c698-4612-875e-45cc631e7bb6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.420637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22786e5abe474005ad857fd96d64b067'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.421259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.422094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.422370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.422649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.423114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22786e5abe474005ad857fd96d64b067'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.424055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.427946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.445279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22786e5abe474005ad857fd96d64b067'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.456243 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2678/5376] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:25 2022] POST /identity/v3/users => generated 287 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:25.458129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.467245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.474089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22786e5abe474005ad857fd96d64b067'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.491294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22786e5abe474005ad857fd96d64b067'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:25.504760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2699/5377] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:25 2022] DELETE /identity/v3/users/22786e5abe474005ad857fd96d64b067 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:25.505866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.508229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.616696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff1d2-3b68-479a-ae2d-72ebc4ff8eb3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.623551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338303-75ac-4e44-9b0e-603fcf2f8617 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.630770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.631635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.631924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.632203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.632999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.634695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.650963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2700/5378] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:25.656730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.675379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be73898-b837-4959-8bc8-0c1095c27546 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.684460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.686673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.688921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.688921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.689405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.691056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.720614 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2701/5379] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:25.724671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:25.728279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.731050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.731403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.732642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.739324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.754216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934bb29-f487-4c80-ba93-d9d0460a8ade admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:25.768451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.769909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a835c-e965-4745-b070-623dcf469d33 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.772681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:25.774864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.775024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.775449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] PATH_INFO: `/v3/projects/639cf96fe6ea4cccb327c67bc5049f97/users/37e6cfaf7d31479f9cef0419cc4f3de9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.805620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639cf96fe6ea4cccb327c67bc5049f97, user_id=37e6cfaf7d31479f9cef0419cc4f3de9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:25.811124 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2679/5380] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:25.811436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64709841-3822-4f73-b3d2-29ac4070bdf0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:25.844618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2702/5381] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:25 2022] PUT /identity/v3/projects/639cf96fe6ea4cccb327c67bc5049f97/users/37e6cfaf7d31479f9cef0419cc4f3de9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:25.847091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.847441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.847721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.858742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:25.859379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:25.859801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:25.873995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] MFA Rules not processed for user `aa2aaa29e0dd479283202bd6575b4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:25.875333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.899774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] MFA Rules not processed for user `37e6cfaf7d31479f9cef0419cc4f3de9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:25.901379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:25.952779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:25.981482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2680/5382] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:26.004930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2703/5383] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:26.010556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.047527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b269ce-4183-4851-8d2d-f278f1a89119 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.062086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e6cfaf7d31479f9cef0419cc4f3de9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639cf96fe6ea4cccb327c67bc5049f97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.062797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.065519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.065876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] PATH_INFO: `/v3/auth/catalog` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.067608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.071118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.080099 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2681/5384] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 21:12:26 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:26.082453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.101569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:26.193854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77422d0f-5123-4bfa-961c-b8aa238d96a4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.199679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.200631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.200921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.201285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] PATH_INFO: `/v3/users/37e6cfaf7d31479f9cef0419cc4f3de9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.202526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.202655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e6cfaf7d31479f9cef0419cc4f3de9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.204922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.205377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.234356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a55a-4153-49af-ba42-939a73f0f209 tempest-IdentityCatalogTest-696039750 tempest-IdentityCatalogTest-696039750-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.245485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.248547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.248970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.249522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] PATH_INFO: `/v3/projects/631b547c310b480385b87ef9e3ecbc54` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.251299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631b547c310b480385b87ef9e3ecbc54)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.259977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.293532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e6cfaf7d31479f9cef0419cc4f3de9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.295931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e6cfaf7d31479f9cef0419cc4f3de9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.314558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e6cfaf7d31479f9cef0419cc4f3de9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.339411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e6cfaf7d31479f9cef0419cc4f3de9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.355991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-61893263-e166-498f-a385-548662f1a4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e6cfaf7d31479f9cef0419cc4f3de9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.370146 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2704/5385] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:26 2022] DELETE /identity/v3/users/37e6cfaf7d31479f9cef0419cc4f3de9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:26.375211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.375211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.375211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.388880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631b547c310b480385b87ef9e3ecbc54', 'request_id': 'req-fa828fd4-601a-42c2-b999-564d645521b5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.408122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631b547c310b480385b87ef9e3ecbc54', 'request_id': 'req-fa828fd4-601a-42c2-b999-564d645521b5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.416407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631b547c310b480385b87ef9e3ecbc54', 'request_id': 'req-fa828fd4-601a-42c2-b999-564d645521b5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.418300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:26.425229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.438776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] The token cache is being invalidate because project 631b547c310b480385b87ef9e3ecbc54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:26.439499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.441861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa828fd4-601a-42c2-b999-564d645521b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:26.445125 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2682/5386] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:26 2022] DELETE /identity/v3/projects/631b547c310b480385b87ef9e3ecbc54 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:26.450015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617569-77e7-4386-8cf7-280d38c2f70d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.450539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617569-77e7-4386-8cf7-280d38c2f70d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.451276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617569-77e7-4386-8cf7-280d38c2f70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.502309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-83617569-77e7-4386-8cf7-280d38c2f70d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:26.515503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-83617569-77e7-4386-8cf7-280d38c2f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.618574 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2705/5387] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:26.650805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.653778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.670018 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2683/5388] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:26.673844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.674190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.674441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.712478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:26.742810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:26.744108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.774102 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2684/5389] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:26.781278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.796656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b87c46-27ce-43eb-b9c9-cf2da9644b5b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.814978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.817067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.817980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.818606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.825124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f24a-c5ea-4cd9-8568-7fde31ec65be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.837265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.838031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.838370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.841317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.841317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:26.841317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.843423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.848992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.851675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.868259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2706/5390] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:12:26.871115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.875719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:26.876791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2685/5391] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:26.883281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:26.895651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4925-82b6-4384-a5de-9f1d991a5ebc service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.901999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.903089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.903673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.903956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] PATH_INFO: `/v3/projects/d6a95c4aedd44a609fc8910355ab0246` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.905569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a95c4aedd44a609fc8910355ab0246)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.907526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.914243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a889a1-0402-4704-9f88-1257c18def83 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:26.921659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:26.922423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:26.922717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:26.923001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:26.923707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:26.925706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:26.994734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2686/5392] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:26 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:26.999293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.002268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a95c4aedd44a609fc8910355ab0246', 'request_id': 'req-07f15857-5246-44f0-bf64-5267b71825ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.026473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a95c4aedd44a609fc8910355ab0246', 'request_id': 'req-07f15857-5246-44f0-bf64-5267b71825ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.037152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a95c4aedd44a609fc8910355ab0246', 'request_id': 'req-07f15857-5246-44f0-bf64-5267b71825ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.063763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] The token cache is being invalidate because project d6a95c4aedd44a609fc8910355ab0246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:27.064069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.067013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.071675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2707/5393] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:26 2022] DELETE /identity/v3/projects/d6a95c4aedd44a609fc8910355ab0246 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:27.075740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.078338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.082055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:27.155282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b760d0-9b0b-4d7b-81b5-ce7800922cac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.161087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.161826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.162110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.162386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.163231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.165544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.185192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15857-5246-44f0-bf64-5267b71825ce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.193783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.197360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2687/5394] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:26 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:27.198426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.198742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.199315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.199863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] PATH_INFO: `/v3/users/d04aeee153c0450fb1a60a1481f37a04` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.200502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.201795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04aeee153c0450fb1a60a1481f37a04)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.204590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.219031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e732-0b41-44aa-8a50-bfdde7a6c03f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.226863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.227593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.228030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.228311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.229202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.231176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.248257 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2688/5395] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:27.249901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.264473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daee27-4061-47b0-a626-c240f340d213 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.271327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.272023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.272350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.272664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.273502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.275582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.292593 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2689/5396] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:27.297437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.298118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04aeee153c0450fb1a60a1481f37a04'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.298895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04aeee153c0450fb1a60a1481f37a04'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.309918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757afd4-6258-4405-a851-a929132eb13b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.317247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04aeee153c0450fb1a60a1481f37a04'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.318169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.319033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:27.319340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.320224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.320662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] PATH_INFO: `/v3/projects/95a5eb9d131249a1877c27389479afd2/users/c79c434dbfcd4eae8a1d6090974e0dbb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.354066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04aeee153c0450fb1a60a1481f37a04'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.366376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04aeee153c0450fb1a60a1481f37a04'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:27.375449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a5eb9d131249a1877c27389479afd2, user_id=c79c434dbfcd4eae8a1d6090974e0dbb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.375849 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2708/5397] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:27 2022] DELETE /identity/v3/users/d04aeee153c0450fb1a60a1481f37a04 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:27.377697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.379971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763b63-6f1b-473e-8f0f-ac8ac7306cc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.383003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.409703 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2690/5398] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:27 2022] PUT /identity/v3/projects/95a5eb9d131249a1877c27389479afd2/users/c79c434dbfcd4eae8a1d6090974e0dbb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:27.414495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.414859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.415210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.447450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:27.448978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.512933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780edb-1749-4fc6-acf1-de52d58bc35d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.542862 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2691/5399] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:27.564338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.566377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.649775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.650463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.650746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.657157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.660416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.697291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.699022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.709195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e955ba0-da64-4b1f-852d-293b1a0fc6b9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:27.717946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:27.718676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:27.719326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:27.719326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:27.726196 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2709/5400] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:27.759048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:27.760562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:27.788811 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2692/5401] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:12:27.952740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:27.954311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:27.985398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f9df-c54c-4144-a1b4-ae248dc1419e service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:28.009002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:28.010106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.010315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.011105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] PATH_INFO: `/v3/projects/639cf96fe6ea4cccb327c67bc5049f97` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.013537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639cf96fe6ea4cccb327c67bc5049f97)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:28.029579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:28.185293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639cf96fe6ea4cccb327c67bc5049f97', 'request_id': 'req-85ae30b8-402a-4995-bf2a-dd5b5442f293'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.199290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639cf96fe6ea4cccb327c67bc5049f97', 'request_id': 'req-85ae30b8-402a-4995-bf2a-dd5b5442f293'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.201772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.204244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:28.207534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:28.214475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639cf96fe6ea4cccb327c67bc5049f97', 'request_id': 'req-85ae30b8-402a-4995-bf2a-dd5b5442f293'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.244688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] The token cache is being invalidate because project 639cf96fe6ea4cccb327c67bc5049f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:28.245032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.246766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85ae30b8-402a-4995-bf2a-dd5b5442f293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.249128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a090-5903-4828-aa9a-39c34c23777b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:28.253234 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2710/5402] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:27 2022] DELETE /identity/v3/projects/639cf96fe6ea4cccb327c67bc5049f97 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:28.259071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6cbe-e788-4f09-84e1-d2ccbd8bf92b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.260328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6cbe-e788-4f09-84e1-d2ccbd8bf92b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.262281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc6cbe-e788-4f09-84e1-d2ccbd8bf92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.313446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8acc6cbe-e788-4f09-84e1-d2ccbd8bf92b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:28.316936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8acc6cbe-e788-4f09-84e1-d2ccbd8bf92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:28.330696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:28.429409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:28.430335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.430624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.430954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] PATH_INFO: `/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.433345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8411b7f87d4d60ba2c0a9108b806ac)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:28.438710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:28.501052 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2711/5403] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:28.502302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.502600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.502887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.554130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'request_id': 'req-113f433d-1c9c-43bb-82cc-0e4eefd42974'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.561278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:28.565838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:28.567059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'request_id': 'req-113f433d-1c9c-43bb-82cc-0e4eefd42974'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.587479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8411b7f87d4d60ba2c0a9108b806ac', 'request_id': 'req-113f433d-1c9c-43bb-82cc-0e4eefd42974'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.603663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] The token cache is being invalidate because project ad8411b7f87d4d60ba2c0a9108b806ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:28.604255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.605055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-113f433d-1c9c-43bb-82cc-0e4eefd42974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:28.607418 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2693/5404] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:28 2022] DELETE /identity/v3/projects/ad8411b7f87d4d60ba2c0a9108b806ac => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:28.613243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6f56-aa8a-4d0d-87a0-93ce0901e50a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.614355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6f56-aa8a-4d0d-87a0-93ce0901e50a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.614746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6f56-aa8a-4d0d-87a0-93ce0901e50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.637611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-191f6f56-aa8a-4d0d-87a0-93ce0901e50a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:28.639018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-191f6f56-aa8a-4d0d-87a0-93ce0901e50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:28.719838 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2712/5405] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:28.720915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.744801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c6ff-cbd5-4315-a011-d15a01bd8bb1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:28.756066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:28.756836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.757168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.757451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.761139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:28.761880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:28.764435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:28.796729 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2694/5406] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:28.800357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.801666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.801992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.816621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2713/5407] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:28.817606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.840745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7e14-e4dc-478d-b330-e1cde2959075 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:28.851144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:28.852504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:28.857155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:28.857853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.858139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.858422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.859209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:28.862761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:28.882409 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2695/5408] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:28.883341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.899848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c088-3cd4-4e44-89ae-408015f17158 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:28.926191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:28.926890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:28.927177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:28.927848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:28.930226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:28.930601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:28.934995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:28.938949 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2714/5409] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:28.943839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.966824 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2696/5410] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:28.973474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:28.996675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c5af-5e64-4356-be95-80f523a4b7fd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.045926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:29.072797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:29.100341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e26fd-75b2-49f7-89a2-398096919216 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.111223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.112523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.113098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.113220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.113799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.113922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.114784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.114784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.116338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.118127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.119641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.120112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.159398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2697/5411] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:29.163762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.179125 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2715/5412] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:28 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:29.180048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.216596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4516-c08a-42bc-aa5d-f81e94413af6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.300316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6735bd-2685-4b34-9232-00403a5ef645 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.308325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.310637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.311038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.312376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.313560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.316728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.351176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2698/5413] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:29 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:29.366246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.380912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.381655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.381946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.382219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.382964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.384646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.403411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf26483-5654-4481-b1bc-439645d3d3fd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.423056 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2716/5414] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:29.426838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.427240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.432000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.432831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.434917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.438754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.444037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.449476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15cb8-e5d2-4d72-8577-16523ee30bd8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.461666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.462597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.464858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.465158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] PATH_INFO: `/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd/users/f270288d6c7546b48579a5f15bebf6de/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.492211 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2699/5415] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:29.500840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.508124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5f01afc8a142fda0ca37bd15f5a3cd, user_id=f270288d6c7546b48579a5f15bebf6de, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.518918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f11e-90da-4e5e-ac25-acfd1c58dcd5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.519772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.527814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.529355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.529841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.530224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.531250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.533179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.553552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2717/5416] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:29 2022] PUT /identity/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd/users/f270288d6c7546b48579a5f15bebf6de/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:29.557844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.566458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2700/5417] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:29.571653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.591394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5d15e-e1d5-49e6-8ff0-f356abd753b4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.653640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb46a4a-5e29-487a-a645-406b7f268f0a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.661260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.662080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.662824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.663341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.664194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.666504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.673340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.674407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.674803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.675419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] PATH_INFO: `/v3/projects/4d6568376f0f40be9b9b1a066432fd5c/users/c2dbd7793d2b49828ea353a41d088b71/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.685736 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2718/5418] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:29.697154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6568376f0f40be9b9b1a066432fd5c, user_id=c2dbd7793d2b49828ea353a41d088b71, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.697936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.700152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05275-4826-4746-aa96-81ae10aa617c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.722867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c335f-2078-4601-a3c8-5a76730051ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.743793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2701/5419] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:29 2022] PUT /identity/v3/projects/4d6568376f0f40be9b9b1a066432fd5c/users/c2dbd7793d2b49828ea353a41d088b71/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:29.745971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.746458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.746942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.767944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:29.812114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:29.814624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] MFA Rules not processed for user `c2dbd7793d2b49828ea353a41d088b71`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:29.825450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:29.848538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:29.851433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.851993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.853035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] PATH_INFO: `/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd/users/f270288d6c7546b48579a5f15bebf6de/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.863514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5f01afc8a142fda0ca37bd15f5a3cd, user_id=f270288d6c7546b48579a5f15bebf6de, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:29.874914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e43e5-2316-411f-b14b-cef108851fb3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:29.920626 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2719/5420] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:29 2022] PUT /identity/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd/users/f270288d6c7546b48579a5f15bebf6de/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:29.932120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:29.932802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:29.933097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:29.941541 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2702/5421] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:29.945885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:29.965965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050001c5-39aa-43c4-85b4-dd7bd2a91055 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:29.981075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] MFA Rules not processed for user `f270288d6c7546b48579a5f15bebf6de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:29.984442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:30.112113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.112839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.113124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.113408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.114120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.116081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.135357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2720/5422] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:30.139956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.160000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222db20f-02eb-4356-8640-8d1a74f975bf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.167620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.170096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.170096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.170339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.171593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.174916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.189954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2703/5423] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:29 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:30.191030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.243757 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2721/5424] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:30 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:30.244958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.350502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d80446-53e1-4dfb-8988-5d48ebc07146 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.401224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:30.403816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc9ed8-6912-4c50-b8c8-bd08e1d69633 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.416857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.417659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.418016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.418366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.420476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.429099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.469379 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2722/5425] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:30 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:30.470572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.475116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.478434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.478812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.479162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.479951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.482033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.489205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e582b-868d-4869-95b9-2c13102b55c8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.502872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.504563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.505073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.505572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.507702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.509753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.527531 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2704/5426] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:30 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:30.528991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.544416 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2723/5427] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:30.544646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa9b6d-cf2b-494b-ba67-fe7a3a48ea02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.545740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.552498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.553474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.553979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.554593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.555819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.557749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.571602 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2705/5428] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:30.576987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.578907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cdcf0-8c5c-4b7f-8f41-103af9693f4a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.588241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.588996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.589280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.589553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.590437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.590914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc3873-e699-4395-972a-ff7185b3d435 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.592061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.597056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.598348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.599107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.599633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] PATH_INFO: `/v3/projects/d3d7e1e35a464775b12103bccb741788/users/b547839dcc054eeeb1d5e5afed198901/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.621799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d7e1e35a464775b12103bccb741788, user_id=b547839dcc054eeeb1d5e5afed198901, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.624980 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2724/5429] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:30.626465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.629865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.646637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2706/5430] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:30 2022] PUT /identity/v3/projects/d3d7e1e35a464775b12103bccb741788/users/b547839dcc054eeeb1d5e5afed198901/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:30.650940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.651678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ac9c-4529-4307-9ae2-992793d731c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.678592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:30.738952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e549-7081-427d-88fd-dc00f959dc4e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.746541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.747754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.748654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.749273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.750465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.753728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.769344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2707/5431] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:30.772819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.773749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.774041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.774324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] PATH_INFO: `/v3/projects/a4ef48e82e0646c08a83adbc03bdf961/users/25577c5f7d234fb0bca3b4cb76ae582d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.775667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:30.801769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e344f6e-72ac-42bf-a524-4664d7cb22e8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:30.812151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ef48e82e0646c08a83adbc03bdf961, user_id=25577c5f7d234fb0bca3b4cb76ae582d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.814899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b8435-e40c-4a21-9350-3d1a0382fc49 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.825123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:30.826280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.826640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.826986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] PATH_INFO: `/v3/projects/d3d7e1e35a464775b12103bccb741788/users/b547839dcc054eeeb1d5e5afed198901/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.829824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d7e1e35a464775b12103bccb741788, user_id=b547839dcc054eeeb1d5e5afed198901, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:30.835101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7fac4-e368-46fa-9453-fbdaf85b1194 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:30.847612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2725/5432] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:30 2022] PUT /identity/v3/projects/a4ef48e82e0646c08a83adbc03bdf961/users/25577c5f7d234fb0bca3b4cb76ae582d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:30.859639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.859930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.860210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.861471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2708/5433] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:30 2022] PUT /identity/v3/projects/d3d7e1e35a464775b12103bccb741788/users/b547839dcc054eeeb1d5e5afed198901/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:30.863304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:30.863593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:30.863868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:30.906004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] MFA Rules not processed for user `25577c5f7d234fb0bca3b4cb76ae582d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:30.907245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:30.919265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] MFA Rules not processed for user `b547839dcc054eeeb1d5e5afed198901`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:30.921801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:31.061897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:31.075748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2726/5434] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:31.090376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.091837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:31.096489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2709/5435] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:31.102290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.119593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a5da3-e82f-4737-b388-e118fe120e9b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.135310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.136023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.136459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.136749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.137482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.138572 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:31.138572 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:12:31.138572 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:12:31.139600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.170563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2710/5436] 10.222.0.39 () {60 vars in 1184 bytes} [Sat Jun 25 21:12:31 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:31.174354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.193828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ae96-e64b-41de-b092-3df640069ecf tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.214486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.215745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.215745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.215745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0d08008f7cf74bf3ac1f8061aa58adef` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.216377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0d08008f7cf74bf3ac1f8061aa58adef)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.217446 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:31.217446 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:12:31.217446 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:12:31.218543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.219806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f9ec-79d5-4c40-b3de-c87d3a96fbb5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.226202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.227237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.233284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.233835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.235285 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2711/5437] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:12:31 2022] GET /identity/v3/OS-OAUTH1/consumers/0d08008f7cf74bf3ac1f8061aa58adef => generated 221 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:31.239275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.271098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06723860-ab6b-41b6-bf58-3ffd0da51c9b tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.287913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.289989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.290286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.290564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0d08008f7cf74bf3ac1f8061aa58adef` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.291233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0d08008f7cf74bf3ac1f8061aa58adef)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.292272 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:31.292272 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:12:31.292272 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:12:31.293226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.293500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer 0d08008f7cf74bf3ac1f8061aa58adef has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:31.293780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.300371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.327041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:31.350260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0d08008f7cf74bf3ac1f8061aa58adef', 'request_id': 'req-2933fb72-c2c3-4e75-bddc-5690dec7941c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.383969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2712/5438] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0d08008f7cf74bf3ac1f8061aa58adef => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:31.386011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.389911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:31.433945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fb72-c2c3-4e75-bddc-5690dec7941c tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.439197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.441525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.447885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.448824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.449123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.449401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.450175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.451818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.466155 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2727/5439] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:12:31.484758 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2713/5440] 10.222.0.39 () {60 vars in 1184 bytes} [Sat Jun 25 21:12:31 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:31.489522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.536481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4e96a-6704-4555-b614-adba3e505222 service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.548409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.549418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.549752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.552323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.553116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0245d93006c44727b4d373420f7c56fd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.556877 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:31.556877 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:12:31.556877 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:12:31.560400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.589953 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2728/5441] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:12:31 2022] GET /identity/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd => generated 220 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:31.592725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.608064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ea96-d546-4eb2-9718-c9ce79dc8b18 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.637232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.644829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.671661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.671661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.676745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0245d93006c44727b4d373420f7c56fd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.679536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.683777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer 0245d93006c44727b4d373420f7c56fd has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:31.684785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.695878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.737703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0245d93006c44727b4d373420f7c56fd', 'request_id': 'req-75354f2f-4ce6-4624-a6ef-2863528bd5b4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:31.762199 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2714/5442] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:31.767440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:31.769975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:31.850090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad613-c058-4395-a5ad-1fe8aa820431 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:31.877040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:31.879077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:31.879592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:31.880131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:31.881055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0245d93006c44727b4d373420f7c56fd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:31.890281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jun 25 21:12:31.976714 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 25 21:12:31.977895 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:31.978723 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2729/5443] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:12:31 2022] GET /identity/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd => generated 74 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:12:31.984331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.008572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75354f2f-4ce6-4624-a6ef-2863528bd5b4 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.027363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.028287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.028598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.028883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.032562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0245d93006c44727b4d373420f7c56fd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.037886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.043826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer 0245d93006c44727b4d373420f7c56fd has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:32.044887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.050556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jun 25 21:12:32.112415 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:32.118560 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2715/5444] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0245d93006c44727b4d373420f7c56fd => generated 74 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:12:32.120079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.122385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:32.201328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c4d55-3182-40a7-94c1-032a4ccce07d tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.235393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.236048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.236344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.244791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.245649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.246725 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:32.246725 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:12:32.246725 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:12:32.247655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.325828 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2730/5445] 10.222.0.39 () {60 vars in 1184 bytes} [Sat Jun 25 21:12:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:32.329960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.356920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d176b8-b5c0-464b-94de-0f6936860d38 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.367566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.369171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.371181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.371181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.384259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.386023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.420289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2716/5446] 10.222.0.39 () {60 vars in 1184 bytes} [Sat Jun 25 21:12:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:32.422913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.463526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d8087-d209-4418-acb1-f70a6fcaa71e tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.480207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.480918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.481201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.484915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.489908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.492388 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:32.492388 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:12:32.492388 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:12:32.504123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.534884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2731/5447] 10.222.0.39 () {58 vars in 1163 bytes} [Sat Jun 25 21:12:32 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:32.539163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.559584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c76b2-0452-4adb-bf6b-72ca9e43f520 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.574375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.578352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.579569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.580095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c360bde39fc14e06a10154ea9d9d7439` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.584935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c360bde39fc14e06a10154ea9d9d7439)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.592239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.592560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer c360bde39fc14e06a10154ea9d9d7439 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:32.594056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.595674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.619848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c360bde39fc14e06a10154ea9d9d7439', 'request_id': 'req-b36506cd-bc95-41a7-b6ba-344115f19334'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.655579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.655870 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2717/5448] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c360bde39fc14e06a10154ea9d9d7439 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:32.659611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:32.660117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.662053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:32.702328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36506cd-bc95-41a7-b6ba-344115f19334 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.721777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.722681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.724169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.724298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9414e9be7a6149508c8017a0b743097c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.725155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9414e9be7a6149508c8017a0b743097c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.727010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.727318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer 9414e9be7a6149508c8017a0b743097c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:32.727955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.728948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.754475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9414e9be7a6149508c8017a0b743097c', 'request_id': 'req-587db508-ff25-4403-bfbf-644e034d70f5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:32.783946 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2718/5449] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9414e9be7a6149508c8017a0b743097c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:32.789308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.791448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:32.844919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587db508-ff25-4403-bfbf-644e034d70f5 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.858524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.859819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.860014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.860292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.863235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.870004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.891484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dd2-e2fd-497d-a734-b8155b6240e6 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.901175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.901895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.902626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.902626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.904671 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2719/5450] 10.222.0.39 () {60 vars in 1184 bytes} [Sat Jun 25 21:12:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:32.908414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:32.909849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:32.938175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e2ed5-6be1-4d75-b945-3605809468da tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:32.939530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.941125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.953345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:32.956647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:32.956834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:32.957326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:32.958035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=c6346c107cfc4e6097c0b6611a3c5334)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:32.962809 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:32.962809 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:12:32.962809 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:12:32.965195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:32.981083 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2732/5451] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:33.005677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:33.007214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:33.025557 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2720/5452] 10.222.0.39 () {60 vars in 1284 bytes} [Sat Jun 25 21:12:32 2022] PATCH /identity/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334 => generated 221 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:33.026585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:33.065479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d42c-b37a-4c25-9fac-8b8755568541 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:33.090230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:33.091114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.091409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.091689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.092386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c6346c107cfc4e6097c0b6611a3c5334)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:33.094263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:33.124564 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2721/5453] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:12:33 2022] GET /identity/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334 => generated 221 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:33.125603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:33.161409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cdfd6-27c3-4a99-981b-f493836ae030 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:33.180374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b547839dcc054eeeb1d5e5afed198901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3d7e1e35a464775b12103bccb741788', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:33.181429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.181715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.181997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.182674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c6346c107cfc4e6097c0b6611a3c5334)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:33.184376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:33.184679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invalidating token cache because consumer c6346c107cfc4e6097c0b6611a3c5334 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:33.184971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.192879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.200141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:INSERT=8,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:33.235499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c6346c107cfc4e6097c0b6611a3c5334', 'request_id': 'req-09474130-d694-43f6-bbd6-f3ae20e50ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.240447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303e8f-2ae2-431c-b215-5e2692449a9c service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:33.260739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:33.264626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.265433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.266007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] PATH_INFO: `/v3/users/f270288d6c7546b48579a5f15bebf6de` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.274477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f270288d6c7546b48579a5f15bebf6de)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:33.276243 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2722/5454] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:12:33 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c6346c107cfc4e6097c0b6611a3c5334 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:33.282519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:33.285235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:33.286198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:33.329292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474130-d694-43f6-bbd6-f3ae20e50ea7 tempest-OAUTHConsumersV3Test-1650581647 tempest-OAUTHConsumersV3Test-1650581647-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:33.334729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:33.335802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.335914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.336791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] PATH_INFO: `/v3/users/c2dbd7793d2b49828ea353a41d088b71` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.345701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2dbd7793d2b49828ea353a41d088b71)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:33.349694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:33.437345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:33.448694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f270288d6c7546b48579a5f15bebf6de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.451146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f270288d6c7546b48579a5f15bebf6de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.465023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2dbd7793d2b49828ea353a41d088b71'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.478857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f270288d6c7546b48579a5f15bebf6de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.488062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2dbd7793d2b49828ea353a41d088b71'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.511656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f270288d6c7546b48579a5f15bebf6de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.526435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-344033ea-2cd3-4cf8-b817-2de9d5da2f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f270288d6c7546b48579a5f15bebf6de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.545174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2dbd7793d2b49828ea353a41d088b71'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.546384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2dbd7793d2b49828ea353a41d088b71'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.546576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2733/5455] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:33 2022] DELETE /identity/v3/users/f270288d6c7546b48579a5f15bebf6de => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:33.549055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.551097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.551679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.552934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12a2e519-33a6-4875-ac43-0aca4e76054a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2dbd7793d2b49828ea353a41d088b71'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:33.583368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:33.585412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:33.605892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2723/5456] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:33 2022] DELETE /identity/v3/users/c2dbd7793d2b49828ea353a41d088b71 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:33.613913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:33.627877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:33.628100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:33.691375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2734/5457] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:33.706602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:33.707871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:33.765526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:33.767172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:33.899872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2724/5458] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:33.918009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24580088-983d-46d4-ab9a-0ca02500e436 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:33.986257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:34.056947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:34.057638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:34.057922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:34.058197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:34.077308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:34.078828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3d5a8-7605-40f0-b15b-af6a2a48e285 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:34.107699 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2735/5459] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:34.124662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8100528-15d6-4a5e-be20-499c7b880484 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:34.140206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:34.141500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:34.141780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:34.142061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:34.164377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:34.169893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:34.175255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:34.190373 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2725/5460] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:35.067267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:35.067836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:35.067836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:35.115983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] MFA Rules not processed for user `bd74e4b366624b72844b2d19f8b8bc35`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:35.117745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:35.133032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:35.240870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2736/5461] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:35.253129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:35.255092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:35.489028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b426-0338-46fd-a3a2-c95d341fe0b5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:35.573203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:35.573897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:35.574184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:35.574461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:35.614467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:35.621133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:35.643801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2726/5462] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:36.475887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:36.477707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:36.488191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:36.490346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:36.520727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551f49c-9fcd-4587-9997-59a48a643677 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:36.524931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8109-4863-4bda-97a5-f91bdbb9efd3 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:36.549990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:36.551309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:36.553308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:36.554377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:36.554747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] PATH_INFO: `/v3/projects/4d6568376f0f40be9b9b1a066432fd5c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:36.555454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:36.555848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:36.557772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] PATH_INFO: `/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:36.557949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6568376f0f40be9b9b1a066432fd5c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:36.561120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5f01afc8a142fda0ca37bd15f5a3cd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:36.562540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:36.571866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:36.705030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6568376f0f40be9b9b1a066432fd5c', 'request_id': 'req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.715763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5f01afc8a142fda0ca37bd15f5a3cd', 'request_id': 'req-3e57659d-97cc-48c8-a119-c0c187ca521b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.737319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6568376f0f40be9b9b1a066432fd5c', 'request_id': 'req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.742929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5f01afc8a142fda0ca37bd15f5a3cd', 'request_id': 'req-3e57659d-97cc-48c8-a119-c0c187ca521b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.749639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6568376f0f40be9b9b1a066432fd5c', 'request_id': 'req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.758459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5f01afc8a142fda0ca37bd15f5a3cd', 'request_id': 'req-3e57659d-97cc-48c8-a119-c0c187ca521b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.794332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] The token cache is being invalidate because project 3a5f01afc8a142fda0ca37bd15f5a3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:36.794782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.795659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] The token cache is being invalidate because project 4d6568376f0f40be9b9b1a066432fd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:36.796319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.796806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.799679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:36.801796 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2727/5463] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:36 2022] DELETE /identity/v3/projects/3a5f01afc8a142fda0ca37bd15f5a3cd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:36.806612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:36.809808 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2737/5464] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:36 2022] DELETE /identity/v3/projects/4d6568376f0f40be9b9b1a066432fd5c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:36.813527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:36.815049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:36.818857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:36.954959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:36.981257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57659d-97cc-48c8-a119-c0c187ca521b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:36.992598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:36.993681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:36.994074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:36.994463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] PATH_INFO: `/v3/users/25577c5f7d234fb0bca3b4cb76ae582d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:36.997274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25577c5f7d234fb0bca3b4cb76ae582d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:36.999430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:37.075304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf49d0-0a5a-4d9d-bb0d-ae91abd9bd87 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:37.094658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:37.099811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:37.100505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:37.101312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] PATH_INFO: `/v3/users/b547839dcc054eeeb1d5e5afed198901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:37.103928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b547839dcc054eeeb1d5e5afed198901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:37.107288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:37.168331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25577c5f7d234fb0bca3b4cb76ae582d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.189370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25577c5f7d234fb0bca3b4cb76ae582d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.207452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:37.217196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25577c5f7d234fb0bca3b4cb76ae582d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.219173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25577c5f7d234fb0bca3b4cb76ae582d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.220231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25577c5f7d234fb0bca3b4cb76ae582d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.244410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b547839dcc054eeeb1d5e5afed198901'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.246116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b547839dcc054eeeb1d5e5afed198901'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.266292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2728/5465] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:36 2022] DELETE /identity/v3/users/25577c5f7d234fb0bca3b4cb76ae582d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:37.271254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b547839dcc054eeeb1d5e5afed198901'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.300532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b547839dcc054eeeb1d5e5afed198901'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.325443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e58b7432-f3f4-40e1-9632-98a3893a6e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b547839dcc054eeeb1d5e5afed198901'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:37.349608 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2738/5466] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:36 2022] DELETE /identity/v3/users/b547839dcc054eeeb1d5e5afed198901 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:38.247166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:38.249285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:38.469626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817fb9b-2745-4840-92ce-39f6db0524dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:38.649356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:38.651241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:38.651688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:38.652134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] PATH_INFO: `/v3/projects/d3d7e1e35a464775b12103bccb741788` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:38.657116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d7e1e35a464775b12103bccb741788)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:38.659803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:38.729022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:38.836618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d7e1e35a464775b12103bccb741788', 'request_id': 'req-aff11372-7a77-4d9f-a569-e50c640fddf4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:38.863957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d7e1e35a464775b12103bccb741788', 'request_id': 'req-aff11372-7a77-4d9f-a569-e50c640fddf4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:38.888549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d7e1e35a464775b12103bccb741788', 'request_id': 'req-aff11372-7a77-4d9f-a569-e50c640fddf4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:38.909819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] The token cache is being invalidate because project d3d7e1e35a464775b12103bccb741788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:38.910456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:38.911455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aff11372-7a77-4d9f-a569-e50c640fddf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:38.913567 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2729/5467] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:38 2022] DELETE /identity/v3/projects/d3d7e1e35a464775b12103bccb741788 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:38.920877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:38.921394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:38.921476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:38.969851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:38.972643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.140260 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2739/5468] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:39.148337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.148888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.149400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.218368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:39.219841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.236861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:39.238166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.269056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2730/5469] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:39.270052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:39.279457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e7b87-a13a-475d-92d5-050383473c84 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:39.289804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:39.291082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.291466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.291754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] PATH_INFO: `/v3/projects/a4ef48e82e0646c08a83adbc03bdf961` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.294022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ef48e82e0646c08a83adbc03bdf961)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:39.298508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:39.340566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65176-877a-43e2-a871-4b5f5db3e57b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:39.355018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:39.356223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.368169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.368990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.370357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:39.371100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:39.373299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4739e36-5021-4884-8bd5-8cafb03106c8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:39.447677 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2731/5470] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:39.450181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473e03-244a-46f8-bdd9-ff6f778f4ec8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.451080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473e03-244a-46f8-bdd9-ff6f778f4ec8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.451664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3473e03-244a-46f8-bdd9-ff6f778f4ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.509232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ef48e82e0646c08a83adbc03bdf961', 'request_id': 'req-fe0abe8f-b17c-454a-8c63-5bf557e8af32'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:39.534116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ef48e82e0646c08a83adbc03bdf961', 'request_id': 'req-fe0abe8f-b17c-454a-8c63-5bf557e8af32'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:39.546589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ef48e82e0646c08a83adbc03bdf961', 'request_id': 'req-fe0abe8f-b17c-454a-8c63-5bf557e8af32'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:39.558308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a3473e03-244a-46f8-bdd9-ff6f778f4ec8 None None] MFA Rules not processed for user `c79c434dbfcd4eae8a1d6090974e0dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:39.562027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a3473e03-244a-46f8-bdd9-ff6f778f4ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.584637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] The token cache is being invalidate because project a4ef48e82e0646c08a83adbc03bdf961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:39.585180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:39.588409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:39.595459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2740/5471] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:39 2022] DELETE /identity/v3/projects/a4ef48e82e0646c08a83adbc03bdf961 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:39.596404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:39.602393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.679708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:39.741718 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2732/5472] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:39.744403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.745231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.746230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.788127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:39.790804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.791165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0abe8f-b17c-454a-8c63-5bf557e8af32 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:39.797668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:39.798545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.798837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.799501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.800617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:39.802693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7d5cb-75ab-4012-b9a1-4dfb0727c230 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:39.814366 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2733/5473] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:39.826125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:39.832784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.867479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc67c-e10e-439d-84cf-c29255f45a7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:39.883869 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2741/5474] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/projects => generated 395 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:39.885872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.886166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.886477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.887498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:39.888212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:39.888571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:39.888862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:39.889599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:39.892889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:39.928719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:39.929953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:39.956212 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2734/5475] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:39.956212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.084586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2742/5476] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:40.084586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.095919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e428ea4-e750-49be-8d8c-dc088a361420 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.104369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:40.148248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff194-6e37-491b-9623-e7f27efda9bb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.164165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.165026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.165722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.166105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.167968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.178908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.221074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.222105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.225272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.225946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.227122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2735/5477] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:39 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:40.227438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.228284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.237630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.259881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb9aa-da65-4c10-a98e-b4ff0bbc55e8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.266535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.268342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.270034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.270584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.271455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:40.271774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.274614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.279301 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2743/5478] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:40 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:40.281140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.293488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2736/5479] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:40.295162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.308089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693045-25b3-473d-a0b5-b9378939c701 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.320033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.320792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.321080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.321346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.322075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.324316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.325708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd160-6084-44d0-bc75-4c09b701787f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.336386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2744/5480] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:40.339914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.341506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.342645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.345413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.347953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.358682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.364445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.373013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4d1e-b71b-47fc-9e86-3fcbb6a050ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.387389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.388245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.388594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.388917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.389922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.392119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.394130 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2737/5481] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:40.395068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.406081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a1206-0cbf-494f-846d-0ae5228da07a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.416536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.417258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.417536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.417863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.418626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.420313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.442953 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2738/5482] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:40.443949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.445627 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2745/5483] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:40 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:40.452286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.459601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863bbd3-2eb9-4318-b73c-99165ceb19d5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.469576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:40.599370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.607856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.608259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.608560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] PATH_INFO: `/v3/projects/113e8385615d430ca60af9afcc5a3e5b/users/6e277a300e4e4947b2e08d668daa9ed3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.646175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-628f-4c66-b4d3-63a51a564454 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.650149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113e8385615d430ca60af9afcc5a3e5b, user_id=6e277a300e4e4947b2e08d668daa9ed3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.653014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.680389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.681411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.682310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.682624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] PATH_INFO: `/v3/projects/b1ea617b9c554ac78031bc984e8213d8/users/55879cd03d4b44aebfecc8136c9f5146/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.695260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2739/5484] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:40 2022] PUT /identity/v3/projects/113e8385615d430ca60af9afcc5a3e5b/users/6e277a300e4e4947b2e08d668daa9ed3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:40.696268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.709519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ea617b9c554ac78031bc984e8213d8, user_id=55879cd03d4b44aebfecc8136c9f5146, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.712390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.737944 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2746/5485] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:40 2022] PUT /identity/v3/projects/b1ea617b9c554ac78031bc984e8213d8/users/55879cd03d4b44aebfecc8136c9f5146/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:40.739076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.878894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba0e9d-d755-4267-a288-2769e5644d27 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.896361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388b1-1974-4f42-8fe7-77743ddb1926 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.898542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.899248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.899534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.899811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.900600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.902205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d1c01-aee9-42fa-ad0a-8d541d779fd7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.904090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.905107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.905578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.906035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.906919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.910511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:40.927716 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2747/5486] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:40.929277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.929903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.929903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.957571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2740/5487] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:40 2022] POST /identity/v3/users => generated 305 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:40.958485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:40.970656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f032370-3cba-43fa-8e9e-718bf039c2eb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:40.978643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:40.979791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:40.980068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:40.980346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] PATH_INFO: `/v3/projects/113e8385615d430ca60af9afcc5a3e5b/users/6e277a300e4e4947b2e08d668daa9ed3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:40.982469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] RBAC: Authorizing `identity:create_grant(project_id=113e8385615d430ca60af9afcc5a3e5b, user_id=6e277a300e4e4947b2e08d668daa9ed3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:40.985778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.003987 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2741/5488] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:40 2022] PUT /identity/v3/projects/113e8385615d430ca60af9afcc5a3e5b/users/6e277a300e4e4947b2e08d668daa9ed3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:41.005064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.011125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] MFA Rules not processed for user `55879cd03d4b44aebfecc8136c9f5146`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:41.014933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:41.017929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:41.113644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe59c4b-882c-4453-be46-7ae443f9683b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.119226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.120160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.120633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.121081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.121983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.124024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.136443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2742/5489] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:41.141018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.155261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899a858-540e-4e38-9970-9f0d6c849a1a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.158294 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2748/5490] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:41.162349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.169910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.171978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.172748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.173132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] PATH_INFO: `/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91/users/be3b9d99d122462ebd2d30876dc3c033/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.190724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364e39-445d-408a-822b-c549a1d954fe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.197480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8fe557d4d14ce5a9f45675415d1c91, user_id=be3b9d99d122462ebd2d30876dc3c033, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.201706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.207655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.208770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.209059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.209339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.210048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.212767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.229504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2743/5491] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:41 2022] PUT /identity/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91/users/be3b9d99d122462ebd2d30876dc3c033/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:41.233406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:41.234585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.262978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2749/5492] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:41 2022] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:41.265480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.350747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c230b-8a10-46bb-b219-86058d5ae0d6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.447249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ecb50-1512-4092-98de-dd623af3ad76 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.452329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.453128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.453501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.453844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.454628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.457055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.477809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.478573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.479012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.479361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.480109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.481968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.491850 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2750/5493] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:41 2022] POST /identity/v3/users => generated 305 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:41.495715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.497882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2744/5494] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:12:41.503028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.518192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299526-16f6-49bd-8a4b-58be60f7237c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.520975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4bd19-081b-4188-a2ad-aacd626502ba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.527657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.528850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.529258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.529625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.530316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.530592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.530923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.531186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] PATH_INFO: `/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91/users/be3b9d99d122462ebd2d30876dc3c033/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.531476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.538039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.543188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8fe557d4d14ce5a9f45675415d1c91, user_id=be3b9d99d122462ebd2d30876dc3c033, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.558766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6520-88fb-47d7-aa0c-355db4201f44 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.560883 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2751/5495] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:41.565253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.587557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f86416-ecbc-4ea5-987a-53db26585a3d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.598754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2745/5496] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:41 2022] PUT /identity/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91/users/be3b9d99d122462ebd2d30876dc3c033/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:41.600451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.600758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.601232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.632791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:41.665777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] MFA Rules not processed for user `be3b9d99d122462ebd2d30876dc3c033`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:41.667061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:41.695247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.697339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.697835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.698431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] PATH_INFO: `/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe/users/f880d88af98c4d298392cb9e394613c9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.728033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a418493b0a4923b1e4cdd38ec793fe, user_id=f880d88af98c4d298392cb9e394613c9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.736109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.771791 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2752/5497] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:41 2022] PUT /identity/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe/users/f880d88af98c4d298392cb9e394613c9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:41.775320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.850263 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2746/5498] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:41.854127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.884553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c9a5c-c227-4d76-bebf-12c4ea170aab None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.895477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:41.902091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c998-e83b-4778-a737-2de9ad3e52c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.913170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.916472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.916745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.917032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.918184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:41.919369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:41.919907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:41.920245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:41.920570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.921108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:41.922261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.923121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:41.955046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2753/5499] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:41.956508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.971828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66b76-2959-4afa-852a-665e496f13a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:41.985549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2747/5500] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:41 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:41.989393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:41.999119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.001495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.005827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.007114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] PATH_INFO: `/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe/users/f880d88af98c4d298392cb9e394613c9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.011894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a418493b0a4923b1e4cdd38ec793fe, user_id=f880d88af98c4d298392cb9e394613c9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.022048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ef1e-3965-46bb-8e97-574081e36521 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.043930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2754/5501] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:41 2022] PUT /identity/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe/users/f880d88af98c4d298392cb9e394613c9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:42.061349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.062131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.062131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.115200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] MFA Rules not processed for user `f880d88af98c4d298392cb9e394613c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:42.118641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:42.158088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a446-a668-454c-9253-71765d39d81c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.300296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.301122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.301530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.301875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.302649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.306173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.313921 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2755/5502] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:42.319805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.365993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2748/5503] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:41 2022] POST /identity/v3/users => generated 300 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:42.368757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.390847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcb08-4ddc-4a20-9a2c-15e752bca332 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.407601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.408323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.408631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.409349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.409635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.411269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.413083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:42.433501 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2749/5504] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:42.434755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.447994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4f94-a99c-49f1-8168-0130464f3317 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.453077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.453773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.454070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.454503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.455325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.457139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.484375 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2750/5505] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:42.490417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.507711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181b4fb-5f35-40a4-88a3-60f01e9ea374 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.511505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dac52-4106-4d97-befc-23b3d86ef29b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.513891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55879cd03d4b44aebfecc8136c9f5146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ea617b9c554ac78031bc984e8213d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.515840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.517002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.517918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.518189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.518515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.519308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.519308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] PATH_INFO: `/v3/projects/a9cc0895f5f643ceabd52ca28d91fb01/users/b1d055aef2d64a97bf747d8f4ad2d4d4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.521835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jun 25 21:12:42.535986 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 25 21:12:42.537482 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.542811 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2756/5506] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:42 2022] POST /identity/v3/projects => generated 136 bytes in 223 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:12:42.544270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.558463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cc0895f5f643ceabd52ca28d91fb01, user_id=b1d055aef2d64a97bf747d8f4ad2d4d4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.561404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395642-c724-4eb6-94f0-afb423ddf0cf tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.564224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc296d-e5ad-4d0e-8d3f-4da3dc42cd6e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.570055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.570996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.571946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.572404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.573622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.577098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.596815 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2751/5507] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:42 2022] PUT /identity/v3/projects/a9cc0895f5f643ceabd52ca28d91fb01/users/b1d055aef2d64a97bf747d8f4ad2d4d4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invalid input for field 'name': '' is too short Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: '' Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise error Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application '' Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.602940 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:12:42.604541 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application '' Jun 25 21:12:42.605594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.610660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2757/5508] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:42 2022] POST /identity/v3/projects => generated 283 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:12:42.611828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.612118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.612884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.615474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.645002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cddad-b686-4019-9a9c-5c19f81aeb42 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.677617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] MFA Rules not processed for user `b1d055aef2d64a97bf747d8f4ad2d4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:42.679366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:42.801312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.801999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.802295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.803090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.803795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.808920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise error Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:12:42.825322 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:42.826503 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:12:42.827640 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.831714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2758/5509] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:42 2022] POST /identity/v3/projects => generated 412 bytes in 213 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:12:42.835695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2752/5510] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:42.835865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.851281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.857095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:42.859441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a178c-8e76-4e43-ac5c-9b7a788b6f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.870028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.871579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.871870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.872699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects/2c715b8f356943858a3fc3ebef93ed0e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:42.884630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c715b8f356943858a3fc3ebef93ed0e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:42.888738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:42.892551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Could not find project: 2c715b8f356943858a3fc3ebef93ed0e.: keystone.exception.ProjectNotFound: Could not find project: 2c715b8f356943858a3fc3ebef93ed0e. Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 25 21:12:42.915290 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2c715b8f356943858a3fc3ebef93ed0e. Jun 25 21:12:42.916296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:42.921597 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2759/5511] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:42 2022] DELETE /identity/v3/projects/2c715b8f356943858a3fc3ebef93ed0e => generated 113 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:12:42.922654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:42.962627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639b24-6184-4ce6-a900-b29ac1fc1bb4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:42.968623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:42.969636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:42.969636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:42.970741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.028852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9d54-d568-429b-baa5-11d3bdfa1799 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.035289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55879cd03d4b44aebfecc8136c9f5146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1ea617b9c554ac78031bc984e8213d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.036215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.036643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.036991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.038260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] RBAC: Authorizing `identity:list_projects()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jun 25 21:12:43.049709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._list_projects() Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 25 21:12:43.050744 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:43.052152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2760/5512] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:12:42 2022] GET /identity/v3/projects => generated 135 bytes in 129 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:12:43.056387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:43.071507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9585a5-2e1f-4f9a-8c39-a123b412690b tempest-ProjectsNegativeStaticTestJSON-754934226 tempest-ProjectsNegativeStaticTestJSON-754934226-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.076618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.077463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.077847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.078224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.079013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.081029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.089593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.091186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.098370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:43.115599 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2753/5513] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:43.127936 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2761/5514] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:43 2022] POST /identity/v3/projects => generated 358 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:43.128826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:43.151338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045a6e8-b9b5-4347-8a39-c235ac48076c service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.283779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.284490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.284784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.286901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.287042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.290306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.387659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.sql.core [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-858251247' for key 'project.ixu_project_name_domain_id'") Jun 25 21:12:43.387659 ncdv-master-1 devstack@keystone.service[97719]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 21:12:43.387659 ncdv-master-1 devstack@keystone.service[97719]: [parameters: {'id': '704ccc2937ac42328f6474cebb71d3a6', 'name': 'tempest-project-dup-858251247', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 21:12:43.387659 ncdv-master-1 devstack@keystone.service[97719]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97719) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-858251247, project id 704ccc2937ac42328f6474cebb71d3a6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-858251247, project id 704ccc2937ac42328f6474cebb71d3a6. Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application conn.query(q) Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 21:12:43.466625 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result.read() Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-858251247' for key 'project.ixu_project_name_domain_id'") Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 21:12:43.467690 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application yield resource Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise self.value Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 21:12:43.468772 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application session.commit() Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.flush() Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application compat.raise_( Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 21:12:43.470951 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 21:12:43.473239 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application conn.query(q) Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result.read() Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 21:12:43.475694 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-858251247' for key 'project.ixu_project_name_domain_id'") Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [parameters: {'id': '704ccc2937ac42328f6474cebb71d3a6', 'name': 'tempest-project-dup-858251247', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:43.477703 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-858251247 at domain ID default. Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:43.479850 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-858251247, project id 704ccc2937ac42328f6474cebb71d3a6. Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:12:43.483926 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2754/5515] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:12:43 2022] POST /identity/v3/projects => generated 284 bytes in 340 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:12:43.486595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:43.493849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2b97-d58a-4fc6-8a91-b321b269fafa tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.523741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f880d88af98c4d298392cb9e394613c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3a418493b0a4923b1e4cdd38ec793fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.526173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.527200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.527935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] PATH_INFO: `/v3/projects/b7bbcf80e49547b29ccec7ce395d0196` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.532208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7bbcf80e49547b29ccec7ce395d0196)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.541333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.653935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bbcf80e49547b29ccec7ce395d0196', 'request_id': 'req-0c6d5357-2c49-438e-9fce-11bb00539a28'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.676945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bbcf80e49547b29ccec7ce395d0196', 'request_id': 'req-0c6d5357-2c49-438e-9fce-11bb00539a28'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.686632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bbcf80e49547b29ccec7ce395d0196', 'request_id': 'req-0c6d5357-2c49-438e-9fce-11bb00539a28'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.734859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] The token cache is being invalidate because project b7bbcf80e49547b29ccec7ce395d0196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:43.735159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.737239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.742128 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2762/5516] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:43 2022] DELETE /identity/v3/projects/b7bbcf80e49547b29ccec7ce395d0196 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:43.747338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:43.749433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:43.778289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:43.780411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:43.890390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5357-2c49-438e-9fce-11bb00539a28 tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.895256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.896169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.896537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.896847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] PATH_INFO: `/v3/users/be3b9d99d122462ebd2d30876dc3c033` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.898086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3b9d99d122462ebd2d30876dc3c033)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.900214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.904365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab34f6-0210-4ce4-b3b4-dff0a2874f7e tempest-ProjectsNegativeStaticTestJSON-1072657537 tempest-ProjectsNegativeStaticTestJSON-1072657537-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:43.906383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:43.912260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:43.913811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:43.914637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:43.915126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] PATH_INFO: `/v3/users/55879cd03d4b44aebfecc8136c9f5146` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:43.916885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55879cd03d4b44aebfecc8136c9f5146)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:43.920998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:43.982437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3b9d99d122462ebd2d30876dc3c033'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.983957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3b9d99d122462ebd2d30876dc3c033'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.994252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55879cd03d4b44aebfecc8136c9f5146'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:43.994558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3b9d99d122462ebd2d30876dc3c033'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.013518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55879cd03d4b44aebfecc8136c9f5146'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.018461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3b9d99d122462ebd2d30876dc3c033'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.029016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c7195338-a34d-484a-980d-8f31cfdca247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3b9d99d122462ebd2d30876dc3c033'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.034708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55879cd03d4b44aebfecc8136c9f5146'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.035685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55879cd03d4b44aebfecc8136c9f5146'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.036668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e3695c9-cf4b-4936-9d3b-9799e383b839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55879cd03d4b44aebfecc8136c9f5146'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:44.046417 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2763/5517] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:43 2022] DELETE /identity/v3/users/be3b9d99d122462ebd2d30876dc3c033 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:44.051734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:44.052271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:44.052902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:44.073575 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2755/5518] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:43 2022] DELETE /identity/v3/users/55879cd03d4b44aebfecc8136c9f5146 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:44.078648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:44.079147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:44.079574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:44.101518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:44.103442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:44.105028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:44.107989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:44.110855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:44.192725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2764/5519] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:44.200754 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2756/5520] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:44.204101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:44.207780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:44.213610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:44.215180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:44.280835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b679420-5809-444c-9a48-5a8a4f8d381b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:44.285014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:44.286124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:44.286480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:44.286864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:44.297153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7b75-8712-48d5-949c-79535056e146 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:44.305731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:44.306381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:44.306673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:44.306939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:44.308406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:44.310650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:44.319079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:44.320962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:44.333875 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2757/5521] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:12:44.340188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2765/5522] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:44.845063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:44.850130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:44.893440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb8c6-813b-461a-a365-7dab8007c51a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:44.908986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:44.934290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:44.934814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:44.935290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] PATH_INFO: `/v3/projects/b1ea617b9c554ac78031bc984e8213d8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:44.939449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ea617b9c554ac78031bc984e8213d8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:44.946617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:45.040863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:45.043470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ea617b9c554ac78031bc984e8213d8', 'request_id': 'req-84d57550-6c07-4582-94cb-ff8da299c919'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.044032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:45.054746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ea617b9c554ac78031bc984e8213d8', 'request_id': 'req-84d57550-6c07-4582-94cb-ff8da299c919'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.064728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ea617b9c554ac78031bc984e8213d8', 'request_id': 'req-84d57550-6c07-4582-94cb-ff8da299c919'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.068849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45328701-5e0c-47fa-8921-7f469c935bf2 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:45.095428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] The token cache is being invalidate because project b1ea617b9c554ac78031bc984e8213d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:45.095681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.096773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.100657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2758/5523] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:44 2022] DELETE /identity/v3/projects/b1ea617b9c554ac78031bc984e8213d8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:45.104878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:45.108135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:45.124804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:45.198595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:45.204207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:45.205387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:45.205644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:45.205930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] PATH_INFO: `/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:45.215070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8fe557d4d14ce5a9f45675415d1c91)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:45.229394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:45.269796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d57550-6c07-4582-94cb-ff8da299c919 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:45.281157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:45.283485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:45.287372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:45.287949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] PATH_INFO: `/v3/users/f880d88af98c4d298392cb9e394613c9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:45.292228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f880d88af98c4d298392cb9e394613c9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:45.294819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:45.330020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8fe557d4d14ce5a9f45675415d1c91', 'request_id': 'req-491e3abf-bf28-42f3-a9bc-ece2e20469be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.349926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8fe557d4d14ce5a9f45675415d1c91', 'request_id': 'req-491e3abf-bf28-42f3-a9bc-ece2e20469be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.357752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8fe557d4d14ce5a9f45675415d1c91', 'request_id': 'req-491e3abf-bf28-42f3-a9bc-ece2e20469be'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.382055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] The token cache is being invalidate because project 7b8fe557d4d14ce5a9f45675415d1c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:45.382371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.383168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f880d88af98c4d298392cb9e394613c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.383922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.390436 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2766/5524] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:45 2022] DELETE /identity/v3/projects/7b8fe557d4d14ce5a9f45675415d1c91 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:45.391769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:45.396913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:45.402051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f880d88af98c4d298392cb9e394613c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.421689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f880d88af98c4d298392cb9e394613c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.422760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f880d88af98c4d298392cb9e394613c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.423703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f880d88af98c4d298392cb9e394613c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.451373 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2759/5525] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:45 2022] DELETE /identity/v3/users/f880d88af98c4d298392cb9e394613c9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:45.542849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e3abf-bf28-42f3-a9bc-ece2e20469be admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:45.634337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:45.635351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:45.635652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:45.636711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] PATH_INFO: `/v3/users/b1d055aef2d64a97bf747d8f4ad2d4d4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:45.638309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d055aef2d64a97bf747d8f4ad2d4d4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:45.640927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:45.650400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:45.732017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d055aef2d64a97bf747d8f4ad2d4d4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.732755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d055aef2d64a97bf747d8f4ad2d4d4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.755689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d055aef2d64a97bf747d8f4ad2d4d4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.780630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d055aef2d64a97bf747d8f4ad2d4d4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.799578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d055aef2d64a97bf747d8f4ad2d4d4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:45.818102 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2767/5526] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:45 2022] DELETE /identity/v3/users/b1d055aef2d64a97bf747d8f4ad2d4d4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:46.293896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:46.295990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:46.328706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205beb8f-c09d-49c5-bc0c-53a6657dfc9b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:46.487239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:46.488334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:46.489768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:46.492065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] PATH_INFO: `/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:46.498447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a418493b0a4923b1e4cdd38ec793fe)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:46.501458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:46.560971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:46.564095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:46.596540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd059a-05fb-4511-ad24-b3eda52a96f9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:46.614725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a418493b0a4923b1e4cdd38ec793fe', 'request_id': 'req-7bc962b1-876e-4f1e-9746-dac8ebd898b0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.637231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a418493b0a4923b1e4cdd38ec793fe', 'request_id': 'req-7bc962b1-876e-4f1e-9746-dac8ebd898b0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.640480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:46.650655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a418493b0a4923b1e4cdd38ec793fe', 'request_id': 'req-7bc962b1-876e-4f1e-9746-dac8ebd898b0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.676101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] The token cache is being invalidate because project a3a418493b0a4923b1e4cdd38ec793fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:46.676613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.678175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.688138 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2760/5527] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:46 2022] DELETE /identity/v3/projects/a3a418493b0a4923b1e4cdd38ec793fe => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:46.689221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:46.693907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:46.806945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:46.809364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:46.814971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:46.815532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] PATH_INFO: `/v3/projects/a9cc0895f5f643ceabd52ca28d91fb01` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:46.822608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cc0895f5f643ceabd52ca28d91fb01)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:46.827397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:46.880607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc962b1-876e-4f1e-9746-dac8ebd898b0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:46.897714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:46.898398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:46.898687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:46.898965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:46.901904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:46.949728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cc0895f5f643ceabd52ca28d91fb01', 'request_id': 'req-fc45f65d-c2b8-4e96-9a00-c4263404fd46'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.964499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:46.966759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424804f-75ed-47a0-9b57-87d4e0a9eb58 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:46.970692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cc0895f5f643ceabd52ca28d91fb01', 'request_id': 'req-fc45f65d-c2b8-4e96-9a00-c4263404fd46'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:46.982619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cc0895f5f643ceabd52ca28d91fb01', 'request_id': 'req-fc45f65d-c2b8-4e96-9a00-c4263404fd46'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:47.007128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2761/5528] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:47.011685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2731-b8c4-402b-a7eb-2db436a1d6b0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.013818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2731-b8c4-402b-a7eb-2db436a1d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.014347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb2731-b8c4-402b-a7eb-2db436a1d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.019986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] The token cache is being invalidate because project a9cc0895f5f643ceabd52ca28d91fb01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:47.020284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:47.027335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fc45f65d-c2b8-4e96-9a00-c4263404fd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:47.037562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2768/5529] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:46 2022] DELETE /identity/v3/projects/a9cc0895f5f643ceabd52ca28d91fb01 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:47.039088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34bf2-916d-434f-b98c-eabe0253fb5b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.039382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34bf2-916d-434f-b98c-eabe0253fb5b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.039664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34bf2-916d-434f-b98c-eabe0253fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.066177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cbfb2731-b8c4-402b-a7eb-2db436a1d6b0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:47.067529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cbfb2731-b8c4-402b-a7eb-2db436a1d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:47.098476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dba34bf2-916d-434f-b98c-eabe0253fb5b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:47.102913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dba34bf2-916d-434f-b98c-eabe0253fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:47.126207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:47.216677 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2762/5530] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:47.225799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.226155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.226377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.250426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:47.251654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:47.266267 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2769/5531] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:47.271994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.272524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.272774 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2763/5532] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:47.273151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.273744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.283518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906915-fe2b-4680-a567-7d2d1a6fa04d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.289346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.290233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.290437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.290852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.291623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:47.292904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.295394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.320052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:47.321237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2764/5533] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:47.322176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.325910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:47.335255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b457de-c04a-45af-a52f-e977f08e34ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.341702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.342667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.343014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.343291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.346755 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2770/5534] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:47.349535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.350650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.351699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.372722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb834a-7990-4eb7-a984-40e0d74bbda1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.384689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.385714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.386551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.387135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.388761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:47.389265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.391100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.396458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2765/5535] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:47.398027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.431582 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2771/5536] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:47.435803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.446702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:47.449777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc411f0-85a4-411c-85d8-b1faab04595c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.498775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904af07a-4b26-48d7-8161-eb2a14e8b304 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.506430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.507325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.508842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.509243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.510336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.514375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.534692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.535754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.536165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.536505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.537321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.539395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.552625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2766/5537] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:47.555981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.572264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c7fd-e3d9-4a94-97f4-a4b145a80fbd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.578329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.579026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.579309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.579638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.580379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.582255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.585617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2772/5538] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:47.587601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.598816 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2767/5539] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:47.603684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.614572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06e8a0-d292-4216-b322-801f478be750 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.688576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.689296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.689886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.689886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.691204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.693000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.716895 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2768/5540] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:47.718562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.731208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfc4fd-36fd-46ca-a235-b75f9c223e48 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.731574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325a10-c1ff-401b-aa46-b3586ce92ebb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.736638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.737383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.737815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.738101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.738877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.740829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.742428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:47.743510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.743795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.744081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] PATH_INFO: `/v3/projects/fcdc6cbba7d64ac28439bb00f284fedb/users/461f11d4a39a497187f54bfc6c03819a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.763996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdc6cbba7d64ac28439bb00f284fedb, user_id=461f11d4a39a497187f54bfc6c03819a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:47.766992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab43ece-0e1d-45c9-a6f3-2c984eda8c93 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:47.794642 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2773/5541] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:47.799578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:47.806868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2769/5542] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:47 2022] PUT /identity/v3/projects/fcdc6cbba7d64ac28439bb00f284fedb/users/461f11d4a39a497187f54bfc6c03819a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:47.817224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:47.817224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:47.817224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:47.829764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b9f2-ea5c-4a5f-834e-435ba9c70621 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:47.854352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:47.879409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] MFA Rules not processed for user `461f11d4a39a497187f54bfc6c03819a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:47.880957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:48.019610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.026001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.026305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.026591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.030666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.038616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.079380 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2774/5543] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:48.082342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.118274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82d411-b4f1-4d66-a537-9e1cb0ad3b5e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.128581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2770/5544] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:48.136107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.139418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.140280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.140596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.140878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.141619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.150849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.161788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceffe5-4d6e-4205-b2f5-5be2bd8be7db None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.180119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.181244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.181362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.181590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.182415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.187101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.187295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2775/5545] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:48.192565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.201383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:48.218471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7be2a-3163-40cd-8467-4e46c2135737 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.234796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.235877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.236166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.236640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] PATH_INFO: `/v3/projects/b9bc07ccc76a4c0e911885dba1c1c423/users/3dfb48225ada43b6ad0c409c3e4f4c59/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.253239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2771/5546] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:48.257316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.272223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bc07ccc76a4c0e911885dba1c1c423, user_id=3dfb48225ada43b6ad0c409c3e4f4c59, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.280984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f915-78e3-4856-b736-a639eb6f1b0a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.304829 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2776/5547] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:48 2022] PUT /identity/v3/projects/b9bc07ccc76a4c0e911885dba1c1c423/users/3dfb48225ada43b6ad0c409c3e4f4c59/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:48.315488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.315774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.316059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.361122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] MFA Rules not processed for user `3dfb48225ada43b6ad0c409c3e4f4c59`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:48.362373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:48.422034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded120-2569-41df-b4f5-894af78c8071 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.547405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2777/5548] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:48.551505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.560077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.561546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.562048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.562542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.564114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.566655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.574379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199fde-e78c-491b-b924-d2935d3fb74d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.581374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.582070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.582356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.582633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.584081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.587278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.622219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2772/5549] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:48 2022] POST /identity/v3/users => generated 290 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:48.623264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.658514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946c1d0-34c6-4771-8cee-a34ae605cc81 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.672779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.674155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.676638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.677272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.680570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.683298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.694954 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2778/5550] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:48 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:48.706228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.722454 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2773/5551] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:48.725893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.764485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007fdda-3a87-4931-87e8-4f4d9a961bb7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.834976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:48.869221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.870798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.871082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.871361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.872154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.875742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.881217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a711b-939e-406c-be9c-4f950df8ebbe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.891302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.891734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.892144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.892356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.898980 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2774/5552] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:48.899268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:48.901456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:48.905537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.932504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b872e-3418-4a41-b745-b9f45e46e028 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:48.938695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:48.939644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:48.940192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:48.940308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] PATH_INFO: `/v3/projects/d27ef779b39b4b7c8dd003348f49640c/users/5851c960b2fc4d87b4801fc3ec3872ac/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:48.951692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2779/5553] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:48 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:48.954216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:48.956084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:48.989956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0dff7-45b2-4d81-844b-7cb99c0f7420 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:49.000127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27ef779b39b4b7c8dd003348f49640c, user_id=5851c960b2fc4d87b4801fc3ec3872ac, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:49.003230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:49.003930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.004220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.006340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:49.007493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.007902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:49.009701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8c464-555a-4d81-8e6b-3af75d426abb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:49.048485 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2775/5554] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:48 2022] PUT /identity/v3/projects/d27ef779b39b4b7c8dd003348f49640c/users/5851c960b2fc4d87b4801fc3ec3872ac/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:49.048711 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2780/5555] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:49.050432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:49.057319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.057546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.058398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.154151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] MFA Rules not processed for user `5851c960b2fc4d87b4801fc3ec3872ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:49.155567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:49.260901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987c86-3600-4d28-bacb-771e9e823c3f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:49.299832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:49.301273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.303453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.303969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.305079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:49.310160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:49.382442 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2776/5556] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:49.385641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:49.406746 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2781/5557] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:49.412177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:49.421071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b752-904a-47f0-80bd-fa1c7e2c1943 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:49.440104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:49.441071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.441457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.441613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] PATH_INFO: `/v3/projects/64d0eb20acba4a9a8cca9ce161689305/users/e309ceb70d3f4be486bae85504ab9d91/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.501192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d0eb20acba4a9a8cca9ce161689305, user_id=e309ceb70d3f4be486bae85504ab9d91, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:49.503904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c274d-4dbc-4df2-b482-4acc15961f3d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:49.541081 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2777/5558] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:49 2022] PUT /identity/v3/projects/64d0eb20acba4a9a8cca9ce161689305/users/e309ceb70d3f4be486bae85504ab9d91/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:49.549728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d964-e4da-424f-84d8-b1496d1442c3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.551985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d964-e4da-424f-84d8-b1496d1442c3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.552310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d964-e4da-424f-84d8-b1496d1442c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.553577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557bca-1f89-470e-ac1f-186217603f02 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:49.633363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6810d964-e4da-424f-84d8-b1496d1442c3 None None] MFA Rules not processed for user `e309ceb70d3f4be486bae85504ab9d91`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:49.635310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6810d964-e4da-424f-84d8-b1496d1442c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:49.678265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '461f11d4a39a497187f54bfc6c03819a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcdc6cbba7d64ac28439bb00f284fedb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:49.680826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.681739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.682145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] PATH_INFO: `/v3/users/461f11d4a39a497187f54bfc6c03819a/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.684094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] RBAC: Authorizing `identity:list_user_projects(user_id=461f11d4a39a497187f54bfc6c03819a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:49.686505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b97384-7905-4d20-a24a-715e862413a8 tempest-IdentityV3ProjectsTest-1455117100 tempest-IdentityV3ProjectsTest-1455117100-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:49.695651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:49.750899 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2782/5559] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:12:49 2022] GET /identity/v3/users/461f11d4a39a497187f54bfc6c03819a/projects => generated 517 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:49.757009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.757545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.758349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.820475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] MFA Rules not processed for user `461f11d4a39a497187f54bfc6c03819a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:49.822044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:49.833494 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2778/5560] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:49.842645 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2783/5561] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:49.854047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:49.854310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:49.854557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:49.856756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:49.857073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:49.938734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] MFA Rules not processed for user `461f11d4a39a497187f54bfc6c03819a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:49.940342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:50.020512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133000-66a9-4724-b6c2-f84e5a0c0037 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:50.026806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:50.027901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:50.028252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:50.028903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:50.056168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:50.059276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.models.token_model [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] User 461f11d4a39a497187f54bfc6c03819a has no access to project d27ef779b39b4b7c8dd003348f49640c {{(pid=97719) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jun 25 21:12:50.063669 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.application [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:12:50.066622 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2779/5562] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:49 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 214 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 25 21:12:50.071724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:50.144759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:50.146336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:50.171410 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2784/5563] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:50.214508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650c5f5-771d-4fba-b3d5-43dad39226ea None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:50.221432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:50.223144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:50.223589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:50.224014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] PATH_INFO: `/v3/users/461f11d4a39a497187f54bfc6c03819a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:50.226207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=461f11d4a39a497187f54bfc6c03819a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:50.239554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:50.346174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461f11d4a39a497187f54bfc6c03819a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:50.363462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461f11d4a39a497187f54bfc6c03819a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:50.373507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:50.383797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461f11d4a39a497187f54bfc6c03819a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:50.384960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461f11d4a39a497187f54bfc6c03819a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:50.386827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162644b-8dca-4869-87c2-640391f889f1 service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:50.387393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5654f1cb-098a-4bb7-9a59-ce80cbaff5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461f11d4a39a497187f54bfc6c03819a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:50.391271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:50.392025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:50.392372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:50.392759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:50.394751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:50.409459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:50.411107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:50.418276 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2780/5564] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:50 2022] DELETE /identity/v3/users/461f11d4a39a497187f54bfc6c03819a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:50.422597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:50.424936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:50.425633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:50.431118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2785/5565] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:50.452190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:50.454548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:50.537065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2781/5566] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:50.580627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:50.582529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:50.713501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca297d-6fad-4aee-8480-7cc4bb84a33e service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:50.724799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:50.857196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:50.858268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:50.858419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:50.858624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:50.882156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:50.883652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc55f0-4dd7-4e04-b966-fd348ba9465d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:50.907558 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2786/5567] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:51.074315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:51.076519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:51.098988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6a7c4-dd22-48ba-ae27-de2e3dd67bbf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:51.109073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:51.110239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:51.110709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:51.111138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] PATH_INFO: `/v3/users/3dfb48225ada43b6ad0c409c3e4f4c59` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:51.112547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfb48225ada43b6ad0c409c3e4f4c59)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:51.114915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:51.137955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:51.241782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfb48225ada43b6ad0c409c3e4f4c59'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:51.256538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfb48225ada43b6ad0c409c3e4f4c59'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:51.275705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfb48225ada43b6ad0c409c3e4f4c59'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:51.276606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfb48225ada43b6ad0c409c3e4f4c59'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:51.277278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfb48225ada43b6ad0c409c3e4f4c59'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:51.303706 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2782/5568] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:51 2022] DELETE /identity/v3/users/3dfb48225ada43b6ad0c409c3e4f4c59 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:51.305290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cf317-a752-44c1-83c9-6a34d9725c5c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:51.305760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cf317-a752-44c1-83c9-6a34d9725c5c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:51.306188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cf317-a752-44c1-83c9-6a34d9725c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:51.352662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cd5cf317-a752-44c1-83c9-6a34d9725c5c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:51.354206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd5cf317-a752-44c1-83c9-6a34d9725c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:51.460631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2787/5569] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:51.480013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:51.482907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:51.583494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2783a-a25f-4a37-b672-924bfce1a5bf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:51.596256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:51.599108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:51.599659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:51.600154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:51.613390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:51.615282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:51.629745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2783/5570] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:51.813539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855c9b-c310-4530-bc62-2b52d130b4af None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:51.825131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855c9b-c310-4530-bc62-2b52d130b4af None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:51.826300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855c9b-c310-4530-bc62-2b52d130b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:51.856889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-91855c9b-c310-4530-bc62-2b52d130b4af None None] MFA Rules not processed for user `6e277a300e4e4947b2e08d668daa9ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:51.858597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91855c9b-c310-4530-bc62-2b52d130b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:51.949564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2788/5571] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:51.957120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:51.958562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:52.081032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9d2c9-c665-4f24-8487-7f70f43d248b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:52.086868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:52.087540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:52.087828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:52.088109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:52.098563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:52.100387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:52.112914 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2784/5572] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:52.183406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:52.183406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:52.183629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:52.207336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] MFA Rules not processed for user `c79c434dbfcd4eae8a1d6090974e0dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:52.209593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:52.463618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:52.465124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:52.478589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:52.482573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ef65-f7df-4abf-b486-2d13a35b8056 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:52.493426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:52.494554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:52.497708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:52.498163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] PATH_INFO: `/v3/projects/fcdc6cbba7d64ac28439bb00f284fedb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:52.501517 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2789/5573] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:52.501845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdc6cbba7d64ac28439bb00f284fedb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:52.503826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:52.554847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:52.638413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdc6cbba7d64ac28439bb00f284fedb', 'request_id': 'req-089c2f5a-1b41-484a-802e-546caa17c59e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.655863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdc6cbba7d64ac28439bb00f284fedb', 'request_id': 'req-089c2f5a-1b41-484a-802e-546caa17c59e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.666247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdc6cbba7d64ac28439bb00f284fedb', 'request_id': 'req-089c2f5a-1b41-484a-802e-546caa17c59e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.682089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] The token cache is being invalidate because project fcdc6cbba7d64ac28439bb00f284fedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:52.682393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.683158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.689789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:52.690069 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2785/5574] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:52 2022] DELETE /identity/v3/projects/fcdc6cbba7d64ac28439bb00f284fedb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:52.710698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3bc27-044e-400d-8271-a9265c4901f8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:52.847671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:52.848622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:52.848901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:52.849171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] PATH_INFO: `/v3/users/5851c960b2fc4d87b4801fc3ec3872ac` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:52.850665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5851c960b2fc4d87b4801fc3ec3872ac)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:52.852907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:52.951846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5851c960b2fc4d87b4801fc3ec3872ac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.952837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5851c960b2fc4d87b4801fc3ec3872ac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.964792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5851c960b2fc4d87b4801fc3ec3872ac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:52.989817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5851c960b2fc4d87b4801fc3ec3872ac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.000605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:53.003361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:53.007435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5851c960b2fc4d87b4801fc3ec3872ac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.023537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2790/5575] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:52 2022] DELETE /identity/v3/users/5851c960b2fc4d87b4801fc3ec3872ac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:53.072265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2f5a-1b41-484a-802e-546caa17c59e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:53.153091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:53.154624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:53.155583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:53.156029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] PATH_INFO: `/v3/projects/b9bc07ccc76a4c0e911885dba1c1c423` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:53.157881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bc07ccc76a4c0e911885dba1c1c423)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:53.160266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:53.255194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bc07ccc76a4c0e911885dba1c1c423', 'request_id': 'req-97b095cc-aa81-46e1-b65f-ca2ea70eca25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.276609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bc07ccc76a4c0e911885dba1c1c423', 'request_id': 'req-97b095cc-aa81-46e1-b65f-ca2ea70eca25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.295866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bc07ccc76a4c0e911885dba1c1c423', 'request_id': 'req-97b095cc-aa81-46e1-b65f-ca2ea70eca25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.330597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] The token cache is being invalidate because project b9bc07ccc76a4c0e911885dba1c1c423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:53.332542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.333584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.340628 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2786/5576] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:52 2022] DELETE /identity/v3/projects/b9bc07ccc76a4c0e911885dba1c1c423 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:53.346059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:53.348232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:53.390623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62257d15-76f7-450e-a375-f59ed634e1f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:53.509989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:53.511102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:53.511430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:53.511762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] PATH_INFO: `/v3/users/e309ceb70d3f4be486bae85504ab9d91` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:53.513070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e309ceb70d3f4be486bae85504ab9d91)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:53.515583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:53.527485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:53.621870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e309ceb70d3f4be486bae85504ab9d91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.622819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e309ceb70d3f4be486bae85504ab9d91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.640661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e309ceb70d3f4be486bae85504ab9d91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.695393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e309ceb70d3f4be486bae85504ab9d91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.704603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d0cc9dc0-c7c1-49c3-9eaf-9683f8182a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e309ceb70d3f4be486bae85504ab9d91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:53.717402 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2791/5577] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:53 2022] DELETE /identity/v3/users/e309ceb70d3f4be486bae85504ab9d91 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:54.334496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:54.336529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:54.368379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b095cc-aa81-46e1-b65f-ca2ea70eca25 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:54.455498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:54.517747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:54.520081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:54.521743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:54.522097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] PATH_INFO: `/v3/projects/d27ef779b39b4b7c8dd003348f49640c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:54.525149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27ef779b39b4b7c8dd003348f49640c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:54.528673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:54.635286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27ef779b39b4b7c8dd003348f49640c', 'request_id': 'req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:54.654958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27ef779b39b4b7c8dd003348f49640c', 'request_id': 'req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:54.664003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27ef779b39b4b7c8dd003348f49640c', 'request_id': 'req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:54.708907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] The token cache is being invalidate because project d27ef779b39b4b7c8dd003348f49640c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:54.709239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:54.710090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9cda1ada-128b-4aa7-8ce5-b955dd5557cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:54.715055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2787/5578] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:54 2022] DELETE /identity/v3/projects/d27ef779b39b4b7c8dd003348f49640c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:54.720762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:54.721579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:54.721579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:54.785955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:54.787562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:54.972047 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2792/5579] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:54.980891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:54.981328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:54.981498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.014731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:55.016003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:55.040896 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2788/5580] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:55.042035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.063042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757275-9392-45bf-93b6-3d00fdc69ba7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.070741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.071437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.071724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.072001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.072789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:55.073099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.086309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.107099 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2793/5581] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:12:55.108777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.122438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5b1b6-e955-470d-8f73-53323bfea71a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.134203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.134938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.135180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.135515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.136454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.146314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.285318 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2789/5582] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:55 2022] POST /identity/v3/projects => generated 359 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:55.289571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.308043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09863-6783-439d-b1ff-c8edee005e84 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.527628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.527628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.527978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.528084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.528787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.536268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.539244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:55.540198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.565599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8fe71-75fa-4573-ac33-a3fba33b6730 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.594211 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2794/5583] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:55 2022] POST /identity/v3/users => generated 280 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:55.604118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.610351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.613156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.617448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.618094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] PATH_INFO: `/v3/projects/64d0eb20acba4a9a8cca9ce161689305` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.620653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:55.624724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d0eb20acba4a9a8cca9ce161689305)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.628834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.630520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fb74f-89d0-4bc6-9270-fcb5261737c4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.646453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.648808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.651864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.652190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.653891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.658293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.690911 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2795/5584] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:55.691902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.722118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971df7-0349-4e4f-856d-3d74912df067 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.732257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:55.733624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.734457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.736594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.738287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:55.742022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:55.771909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2796/5585] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:55.779341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:55.821093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9ffa5-d820-4028-a4bb-474c172e1186 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:55.865995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d0eb20acba4a9a8cca9ce161689305', 'request_id': 'req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:55.884777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d0eb20acba4a9a8cca9ce161689305', 'request_id': 'req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:55.901283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d0eb20acba4a9a8cca9ce161689305', 'request_id': 'req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:55.929350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] The token cache is being invalidate because project 64d0eb20acba4a9a8cca9ce161689305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:55.929648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:55.938518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3220f2d-2b57-4646-8dee-cf1cc6a0015b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:55.940541 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2790/5586] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:55 2022] DELETE /identity/v3/projects/64d0eb20acba4a9a8cca9ce161689305 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:55.947631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19863db5-c38c-4cc9-9bf5-968d2e26492d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:55.948003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19863db5-c38c-4cc9-9bf5-968d2e26492d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:55.948186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19863db5-c38c-4cc9-9bf5-968d2e26492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:55.981402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-19863db5-c38c-4cc9-9bf5-968d2e26492d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:55.983061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-19863db5-c38c-4cc9-9bf5-968d2e26492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.005505 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2791/5587] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:56.014014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.014363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.014484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.014608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.015470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.015751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.016035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] PATH_INFO: `/v3/projects/ae89bad40517434c9fa7ee252bd158b5/users/827882858fd340a8812a3b3389315fae/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.051530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:56.053444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae89bad40517434c9fa7ee252bd158b5, user_id=827882858fd340a8812a3b3389315fae, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.056190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67d5a4-aacd-4408-a1e2-f6f72ddd0eb6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.057142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.082678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2792/5588] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:12:56.087224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.092731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2797/5589] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:55 2022] PUT /identity/v3/projects/ae89bad40517434c9fa7ee252bd158b5/users/827882858fd340a8812a3b3389315fae/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:56.097130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:56.105715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f55d9-fb9a-4449-a020-d487ef87b47c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.106309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f55d9-fb9a-4449-a020-d487ef87b47c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.106847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f55d9-fb9a-4449-a020-d487ef87b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.124719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76b344-e389-4d6d-bf90-d13006790eb0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.178613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f95f55d9-fb9a-4449-a020-d487ef87b47c None None] MFA Rules not processed for user `827882858fd340a8812a3b3389315fae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:56.184302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f95f55d9-fb9a-4449-a020-d487ef87b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.276407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.277261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.277576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.277828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.280070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:12:56.280392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.282733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.309522 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2793/5590] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:12:56.312993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.327781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6bfc-8b6b-4c9f-ba5b-b4688399d072 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.335063 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2798/5591] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:56.343427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.343850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28db8-150b-442a-b57a-799df1296284 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.344360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28db8-150b-442a-b57a-799df1296284 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.345242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.345475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28db8-150b-442a-b57a-799df1296284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.347127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.347523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.348467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.350851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.371276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7ba28db8-150b-442a-b57a-799df1296284 None None] MFA Rules not processed for user `827882858fd340a8812a3b3389315fae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:56.372776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7ba28db8-150b-442a-b57a-799df1296284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.377884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2799/5592] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:56.385550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.385916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.386262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.391997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2794/5593] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:56.393788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.415391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] MFA Rules not processed for user `827882858fd340a8812a3b3389315fae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:56.417603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.429447 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2800/5594] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:56.433413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.502141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:56.510171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad927-88cc-4f76-b912-c10902c64274 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.517529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.518700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.519553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.523803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a2388-879b-4171-a142-bb59787ea360 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.526862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.528762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.529177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.529543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.529828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.533326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.537173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.538333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorizing `identity:check_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.550147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.584370 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2801/5595] 10.222.0.39 () {56 vars in 1263 bytes} [Sat Jun 25 21:12:56 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jun 25 21:12:56.590963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.610840 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2795/5596] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:56.615246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.619802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e6bc-7a4d-400d-9e97-9d7d9cc32628 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.637209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0227f0-149f-4d2c-80fa-f8f4f10735eb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.637712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.638403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.638687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.639147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.647661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.655094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.656088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.657138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.657575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.658016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.658920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.665917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2802/5597] 10.222.0.39 () {56 vars in 1262 bytes} [Sat Jun 25 21:12:56 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:56.668234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.678030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.689266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2796/5598] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:56.694315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.700080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9f02-4ec6-4ed1-827d-457cdaac1f3e tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.704996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.711511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.712039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.712521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.729200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.730953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.734834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ede6e5-b2a7-4e92-9cbe-59f0a01b0978 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.742774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.744237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.744747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.746623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.748013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.751063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.767873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2803/5599] 10.222.0.39 () {56 vars in 1265 bytes} [Sat Jun 25 21:12:56 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:56.780898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.823400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6cc2-9dba-4c3d-9cd8-3d2132b34953 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.829382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2797/5600] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:56.835125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:56.839919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.840649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.842112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.842416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.858146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.874389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7463aa-b7b8-479f-93a6-4f1de8dde7e6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:56.888786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:56.889819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.890158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.890442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] PATH_INFO: `/v3/projects/86420a14e24e4e12a2d2a6688c742bf7/users/bdd7e638c15b4d678618405faf5ab217/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-cf7516fe-608b-4b3e-bb26-ebf013b1a128 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jun 25 21:12:56.903887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 25 21:12:56.905337 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:12:56.906632 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:56.908145 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2804/5601] 10.222.0.39 () {56 vars in 1263 bytes} [Sat Jun 25 21:12:56 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jun 25 21:12:56.916260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.916767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.917268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.918407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=86420a14e24e4e12a2d2a6688c742bf7, user_id=bdd7e638c15b4d678618405faf5ab217, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:56.922341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df421c82-8977-4fa7-ab4a-a900efb5fecd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:56.958106 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2798/5602] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:56 2022] PUT /identity/v3/projects/86420a14e24e4e12a2d2a6688c742bf7/users/bdd7e638c15b4d678618405faf5ab217/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:56.962750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] MFA Rules not processed for user `827882858fd340a8812a3b3389315fae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:56.964304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:56.972902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:56.973409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:56.973853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:56.982703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2805/5603] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 21:12:56.989570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.056244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] MFA Rules not processed for user `bdd7e638c15b4d678618405faf5ab217`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:57.057684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:57.075022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:57.138778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb540e81-4f82-410f-9ac6-86ac8a74b4e8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.153776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.154940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.155457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.155954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.170922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.174091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.192752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2806/5604] 10.222.0.39 () {56 vars in 1262 bytes} [Sat Jun 25 21:12:56 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:57.195612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.215891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9a51-846c-49d2-9879-cac2e30653cd tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.217528 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2799/5605] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:57.222341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.235880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.241184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.241473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.241760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.279779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.294102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.357467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2807/5606] 10.222.0.39 () {56 vars in 1265 bytes} [Sat Jun 25 21:12:57 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:57.370206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.385311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029054a6-cdf4-4d45-b3fb-ff161ed39a03 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.391577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.392278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.392627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.392904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.393601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.395826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.397775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d567eb-c449-4030-b05d-ac4cad2ac9b4 tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.405969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '827882858fd340a8812a3b3389315fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae89bad40517434c9fa7ee252bd158b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.406823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.407253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.407697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.410440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 25 21:12:57.424638 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 25 21:12:57.425908 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:12:57.427200 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:12:57.430721 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2808/5607] 10.222.0.39 () {56 vars in 1262 bytes} [Sat Jun 25 21:12:57 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:12:57.431815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.433864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:57.452913 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2800/5608] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:12:57 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:12:57.453479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3833e9-a5c7-4d7b-8163-c05447b087fc tempest-TokensV3Test-753744654 tempest-TokensV3Test-753744654-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.456746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.548962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.550694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.550848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.551848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c92e-063c-45dc-9826-8bb6cfcffb0d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.554364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] PATH_INFO: `/v3/users/827882858fd340a8812a3b3389315fae` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.556146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827882858fd340a8812a3b3389315fae)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.557888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.558991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.559282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.559559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.560265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.560589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.562599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:57.562843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.598236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2801/5609] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:12:57 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:12:57.602133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.624673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad7789-0948-4b09-8057-88ad71d1c377 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.641957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.646907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.647090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.647512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.648123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.652073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.670747 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2802/5610] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:57.673770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827882858fd340a8812a3b3389315fae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:57.674578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.676623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827882858fd340a8812a3b3389315fae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:57.676914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:57.692877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827882858fd340a8812a3b3389315fae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:57.699280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcaffc-195c-4f87-9a36-42ab9124480a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.709690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.711995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.712596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.713278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] PATH_INFO: `/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2/users/1deac9a20be14da3800c265ab521e049/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.716444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827882858fd340a8812a3b3389315fae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:57.728792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3210436f-9364-481a-a865-8ce99ee6cf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827882858fd340a8812a3b3389315fae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:57.738696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:57.746993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe9ff8c7f3d41e9963a6020f1a557e2, user_id=1deac9a20be14da3800c265ab521e049, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.752118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.757723 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2809/5611] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:57 2022] DELETE /identity/v3/users/827882858fd340a8812a3b3389315fae => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:57.759660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c06e-b14e-408c-b563-698be3d2ed34 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.760040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c06e-b14e-408c-b563-698be3d2ed34 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.760573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1c06e-b14e-408c-b563-698be3d2ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.775088 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2803/5612] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:57 2022] PUT /identity/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2/users/1deac9a20be14da3800c265ab521e049/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:12:57.778822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.801998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-09f1c06e-b14e-408c-b563-698be3d2ed34 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:57.807412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-09f1c06e-b14e-408c-b563-698be3d2ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:57.894548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d92626-3d59-47d8-9d85-22f8b6802522 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.900718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.901765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.902028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.902317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.903461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.905240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:57.932540 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2804/5613] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:12:57.947111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:57.970408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576c18-33c3-49fb-a828-2869e7e7143b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:57.979830 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2810/5614] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:57.988276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:57.989223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:57.989509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:57.989793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] PATH_INFO: `/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2/users/1deac9a20be14da3800c265ab521e049/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:57.995030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe9ff8c7f3d41e9963a6020f1a557e2, user_id=1deac9a20be14da3800c265ab521e049, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:57.999767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:58.028084 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2805/5615] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:12:57 2022] PUT /identity/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2/users/1deac9a20be14da3800c265ab521e049/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:58.038714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:58.039103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:58.039496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:58.083182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:58.085160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.106739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] MFA Rules not processed for user `1deac9a20be14da3800c265ab521e049`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:12:58.108299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.191936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e92ec-2be0-41ec-b204-5770bc4d1b20 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:58.197664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:58.198362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:58.198654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:58.199096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:58.274693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2811/5616] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:12:58.298851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:58.301373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:58.313642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2806/5617] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:58.329259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:58.330821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.343491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:58.358000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daec62-bf9e-421c-a8da-cb8ed0b13175 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:58.366177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:58.366855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:58.367136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:58.367412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:58.387213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:58.388886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:58.399565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:58.403111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.417297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2812/5618] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:12:58.474404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:58.598887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646662a9-7596-41a2-9479-8516e11d7dcc service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:58.618188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:58.619292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:58.619751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:58.621592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:58.629635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.749565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:58.751545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:58.776905 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2807/5619] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:12:58.932121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:58.933618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:58.964336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c4855-46dd-4d03-b0e2-7c18ff1a8305 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:58.977696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:58.979886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:58.980408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:58.983941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] PATH_INFO: `/v3/users/bd74e4b366624b72844b2d19f8b8bc35` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:58.985798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd74e4b366624b72844b2d19f8b8bc35)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:58.989755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:59.104545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd74e4b366624b72844b2d19f8b8bc35'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.105151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd74e4b366624b72844b2d19f8b8bc35'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.122471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd74e4b366624b72844b2d19f8b8bc35'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.160744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd74e4b366624b72844b2d19f8b8bc35'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.172336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4bfe356d-37e2-46cc-84f2-865856874f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd74e4b366624b72844b2d19f8b8bc35'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.187658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2813/5620] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:12:58 2022] DELETE /identity/v3/users/bd74e4b366624b72844b2d19f8b8bc35 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:59.614096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:59.616512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:12:59.647308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb2b8e-8164-4047-9e5e-81f9f2a207f9 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:12:59.799341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:12:59.800535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:59.801238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:59.801942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] PATH_INFO: `/v3/projects/ae89bad40517434c9fa7ee252bd158b5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:59.812219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae89bad40517434c9fa7ee252bd158b5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:12:59.814672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:12:59.905971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae89bad40517434c9fa7ee252bd158b5', 'request_id': 'req-5e3af924-dbb5-4904-b323-f9fde7bbd29b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.916153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae89bad40517434c9fa7ee252bd158b5', 'request_id': 'req-5e3af924-dbb5-4904-b323-f9fde7bbd29b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.921662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:59.925113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae89bad40517434c9fa7ee252bd158b5', 'request_id': 'req-5e3af924-dbb5-4904-b323-f9fde7bbd29b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.941651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] The token cache is being invalidate because project ae89bad40517434c9fa7ee252bd158b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:12:59.942599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.943931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:12:59.964722 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2808/5621] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:12:59 2022] DELETE /identity/v3/projects/ae89bad40517434c9fa7ee252bd158b5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:12:59.971337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdcf3-363a-4042-a6c2-3b4ad667b65a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:12:59.972280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdcf3-363a-4042-a6c2-3b4ad667b65a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:12:59.972823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdcf3-363a-4042-a6c2-3b4ad667b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:12:59.982448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:12:59.991526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.017281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7f6cdcf3-363a-4042-a6c2-3b4ad667b65a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:00.020407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f6cdcf3-363a-4042-a6c2-3b4ad667b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.143040 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2814/5622] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:00.155308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.155711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3af924-dbb5-4904-b323-f9fde7bbd29b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.156950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.158097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.167377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.168069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.168359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.168984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.170595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.193653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.197250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:00.198502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.198640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.211491 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2815/5623] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:00.220309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.234300 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2809/5624] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:00.235217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.236938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.251510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741b456-4b0d-458e-95ba-8d92c3147765 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.257288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.258048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.258397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.258736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.259533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:00.259905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.261668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.266029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4956e9-552f-475c-adc5-ecdb11955b4f service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.280092 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2816/5625] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:00.282039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.288253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.291749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.292455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.292890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] PATH_INFO: `/v3/projects/78bbd68e6c6e4a9ca1a5e5a4c872eb5d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.294483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bbd68e6c6e4a9ca1a5e5a4c872eb5d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.296539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2990d6-b93d-44f3-b86d-2a581ac7a762 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.298017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.307750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.308768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.309257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.309733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.310900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.313681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.355887 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2817/5626] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:00.357268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.367073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bbd68e6c6e4a9ca1a5e5a4c872eb5d', 'request_id': 'req-37e9b9b1-491f-4863-8cfa-7537b037729b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:00.384594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bbd68e6c6e4a9ca1a5e5a4c872eb5d', 'request_id': 'req-37e9b9b1-491f-4863-8cfa-7537b037729b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:00.393546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:00.397057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bbd68e6c6e4a9ca1a5e5a4c872eb5d', 'request_id': 'req-37e9b9b1-491f-4863-8cfa-7537b037729b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:00.410100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] The token cache is being invalidate because project 78bbd68e6c6e4a9ca1a5e5a4c872eb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:00.410586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:00.411995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37e9b9b1-491f-4863-8cfa-7537b037729b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:00.413700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2810/5627] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:00 2022] DELETE /identity/v3/projects/78bbd68e6c6e4a9ca1a5e5a4c872eb5d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:00.421187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7389-f8c4-4fec-ab44-00843fe6efd8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.421815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7389-f8c4-4fec-ab44-00843fe6efd8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.422273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7389-f8c4-4fec-ab44-00843fe6efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.444064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d88e7389-f8c4-4fec-ab44-00843fe6efd8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:00.445394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961fe2-45e8-4fc0-8c5f-c40419d5f647 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.445526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d88e7389-f8c4-4fec-ab44-00843fe6efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.450858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.452207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.452700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.453195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.456306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2811/5628] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:00.457648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.459765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.465745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.465981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.466192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.497606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:00.499522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.508624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2818/5629] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:13:00.511264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.512984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.519013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2812/5630] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:00.520821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.535408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b179-9633-4a0e-880d-ac58ba06a454 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.543869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.544812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.545370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.546524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.547268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154515-4641-4848-b2b6-c3e91a52ea10 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.547736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:00.548260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.550256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.563570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.564736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.565172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.565670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.566649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.568973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.571733 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2813/5631] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:00.588638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.598931 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2819/5632] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:00.604394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.605850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2286c-e3a5-4b34-a2b2-03aacefbe08d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.618047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.619575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.620214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.620520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.623550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.624556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83669-91e6-4f75-9b00-04980a4b147b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.626554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.642934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.643815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.644197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.644702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.645542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.647321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.659206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2820/5633] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:13:00.663360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.686207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69a7f3-0726-4666-8a58-8d715f9eca7f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.697738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2814/5634] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/projects => generated 395 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:00.697946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.698632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:00.698804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.699209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.699494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] PATH_INFO: `/v3/projects/9f780b616c84462da77def178b8a3895/users/3815fa76dbd347728447c58a5ee9c067/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.719264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f780b616c84462da77def178b8a3895, user_id=3815fa76dbd347728447c58a5ee9c067, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.719658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:00.721909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68fab-42f4-4de3-9587-2d4ba66adc45 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.747021 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2821/5635] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:00 2022] PUT /identity/v3/projects/9f780b616c84462da77def178b8a3895/users/3815fa76dbd347728447c58a5ee9c067/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:00.759453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.761788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.763391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.824040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] MFA Rules not processed for user `3815fa76dbd347728447c58a5ee9c067`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:00.825818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:00.857810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb5378-bec5-4ff5-9d7a-53ebfa0cd410 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:00.976729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:00.977423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:00.977705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:00.977980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:00.979879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:00.981342 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2822/5636] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:00.985675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:00.986392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.001589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe45973-c623-4bc8-ae92-ddd87613158b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.006760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.007470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.007757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.008034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.008764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.009144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2815/5637] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/users => generated 298 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:01.010857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.013739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.026351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a246-1173-4cd7-a6d0-de08afbfdcfe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.033235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.034001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.034610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.034901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.036112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.037554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.044264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2823/5638] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:00 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:13:01.048119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.057826 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2816/5639] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:01.061347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.076858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393a507-ea37-49df-bc46-04f52ae22719 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.103919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:01.143864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6982-ad4d-4cc3-9814-d8e9fc23c4e2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.150393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.151606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.152110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.153130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.154176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.156451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.195551 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2824/5640] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:01 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:01.199416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.203946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.204670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.204953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.205229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.205976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.207917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.220993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2817/5641] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:01.225422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.225846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa4c8-6f48-4d46-ad74-2dd926d14e86 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.240704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.241873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.242662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.243473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.245840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.248478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.250724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c6925-42c6-4b4d-ae03-6dc45e3bbc6a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.262965 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2825/5642] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:13:01.267029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.267477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.268534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.268822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.269110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] PATH_INFO: `/v3/projects/41ad5eda252e437fbe013b86b0bb5361/users/5bb232b046fa4ecc86c1490daf6da5e4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.285362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bfc7-6fe9-4dca-a052-bc5422e5293d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.291684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ad5eda252e437fbe013b86b0bb5361, user_id=5bb232b046fa4ecc86c1490daf6da5e4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.293562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.294507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.294796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448659d6-c009-4f23-aac0-551b7dfbd966 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.295277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.295855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.297144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.300280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.318183 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2818/5643] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:01 2022] PUT /identity/v3/projects/41ad5eda252e437fbe013b86b0bb5361/users/5bb232b046fa4ecc86c1490daf6da5e4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:01.320116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa65f4-d382-4065-9785-a73ff764f9d3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.320416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa65f4-d382-4065-9785-a73ff764f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.320791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa65f4-d382-4065-9785-a73ff764f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.323500 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2826/5644] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:01.328896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.350249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e4eb-6e90-4aaf-a7a8-3526e1ec32a3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.353660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:01.365102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e9aa65f4-d382-4065-9785-a73ff764f9d3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:01.367970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e9aa65f4-d382-4065-9785-a73ff764f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:01.503654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.504541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.504828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.505111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] PATH_INFO: `/v3/projects/7b0e7a38fc484fa6915c11f185d88fa4/users/27af9e0695fa4ca68fc90c7cf9ac4994/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.511186 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2819/5645] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:01.535940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0e7a38fc484fa6915c11f185d88fa4, user_id=27af9e0695fa4ca68fc90c7cf9ac4994, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.538962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.575802 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2827/5646] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:01 2022] PUT /identity/v3/projects/7b0e7a38fc484fa6915c11f185d88fa4/users/27af9e0695fa4ca68fc90c7cf9ac4994/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:13:01.579171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.579171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.579171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.588487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.591328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:01.656486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] MFA Rules not processed for user `27af9e0695fa4ca68fc90c7cf9ac4994`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:01.658810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:01.715221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28028-353a-4a0a-96ef-98641d86bdd5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:01.721612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:01.722289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:01.722571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:01.722844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:01.865497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:01.869649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2820/5647] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:01.877743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:01.883344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:01.926437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:01.928081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e03b1-9fc9-4be1-b698-f887d0aaae9d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:01.971513 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2828/5648] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:02.040836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99d95a-9e09-472e-95e2-9f3e630c774a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:02.046201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:02.046869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:02.047149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:02.047422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:02.126159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:02.139691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:02.142313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:02.171147 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2821/5649] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:02.383994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:02.384792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:02.384792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:02.459033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:02.463485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:02.575847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2829/5650] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:02.642691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:02.644698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:02.739398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977641b0-50c6-4737-86a4-0fe7b6b0caa7 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:02.747890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:02.754169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:02.754580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:02.755172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:02.766162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:02.768665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5075c-711e-4dae-9808-b938b6f0b41e service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:02.781246 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2822/5651] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:03.080589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:03.083607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:03.110554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375a67-bd01-4874-88e9-2712230f1e3d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:03.115538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:03.116377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:03.116793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:03.117177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:03.133331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:03.136577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:03.149762 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2830/5652] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:03.262979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257359b6-d748-4e47-9168-93edf84273ad None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:03.263753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257359b6-d748-4e47-9168-93edf84273ad None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:03.264585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257359b6-d748-4e47-9168-93edf84273ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:03.294040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-257359b6-d748-4e47-9168-93edf84273ad None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:03.296710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-257359b6-d748-4e47-9168-93edf84273ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:03.315207 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2823/5653] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:03.322893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:03.343508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4619ed-91ec-4be2-8dfb-a67cdb947d51 service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:03.350652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:03.353980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:03.353980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:03.353980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:03.363227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:03.365258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d83cc-6c64-4e2c-9cf8-16ce69fdecf5 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:03.378095 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2831/5654] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:03.597216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257359b6-d748-4e47-9168-93edf84273ad None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:03.613004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257359b6-d748-4e47-9168-93edf84273ad None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:03.619566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:03.620983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:03.621453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:03.621897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] PATH_INFO: `/v3/users/3815fa76dbd347728447c58a5ee9c067` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:03.623363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3815fa76dbd347728447c58a5ee9c067)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:03.625770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:03.692149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3815fa76dbd347728447c58a5ee9c067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:03.706040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3815fa76dbd347728447c58a5ee9c067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:03.723735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3815fa76dbd347728447c58a5ee9c067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:03.724664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3815fa76dbd347728447c58a5ee9c067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:03.725522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3815fa76dbd347728447c58a5ee9c067'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:03.748667 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2824/5655] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:03 2022] DELETE /identity/v3/users/3815fa76dbd347728447c58a5ee9c067 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:03.753989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:03.754940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:03.755378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:03.783192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:03.789079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:03.927536 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2832/5656] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:03.999202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:04.000921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:04.127842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:04.148584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97339e-d10c-45f9-a4f8-8e8447c2c5d0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:04.158247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:04.161986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:04.162806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:04.164727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:04.181115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:04.183863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:04.217093 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2825/5657] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:04.885871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:04.887625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:04.919496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6855a-a1be-458d-ae6e-cc1513118c38 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:04.934536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:04.935600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:04.935947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:04.936351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] PATH_INFO: `/v3/projects/9f780b616c84462da77def178b8a3895` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:04.942060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f780b616c84462da77def178b8a3895)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:04.944141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:05.047850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:05.062725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f780b616c84462da77def178b8a3895', 'request_id': 'req-3b4c0a70-4492-4563-b6d8-1c3f791c497d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.079564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f780b616c84462da77def178b8a3895', 'request_id': 'req-3b4c0a70-4492-4563-b6d8-1c3f791c497d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.107286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f780b616c84462da77def178b8a3895', 'request_id': 'req-3b4c0a70-4492-4563-b6d8-1c3f791c497d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.134973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] The token cache is being invalidate because project 9f780b616c84462da77def178b8a3895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:05.135537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.136779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.140487 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2833/5658] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:04 2022] DELETE /identity/v3/projects/9f780b616c84462da77def178b8a3895 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:05.145231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:05.162174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc5b5-f147-4be6-8aa5-d11fbedc2270 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:05.272014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:05.274576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:05.274836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:05.275334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] PATH_INFO: `/v3/users/27af9e0695fa4ca68fc90c7cf9ac4994` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:05.276976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27af9e0695fa4ca68fc90c7cf9ac4994)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:05.279155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:05.387863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27af9e0695fa4ca68fc90c7cf9ac4994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.407404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27af9e0695fa4ca68fc90c7cf9ac4994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.426262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27af9e0695fa4ca68fc90c7cf9ac4994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.427235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27af9e0695fa4ca68fc90c7cf9ac4994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.427839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-011fce5f-4e29-44a3-95b3-f31c4696c88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27af9e0695fa4ca68fc90c7cf9ac4994'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:05.446713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2826/5659] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:05 2022] DELETE /identity/v3/users/27af9e0695fa4ca68fc90c7cf9ac4994 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:06.321517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:06.323150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:06.349150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0a70-4492-4563-b6d8-1c3f791c497d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:06.471343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:06.472666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:06.473200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:06.473707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] PATH_INFO: `/v3/projects/7b0e7a38fc484fa6915c11f185d88fa4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:06.475448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0e7a38fc484fa6915c11f185d88fa4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:06.477831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:06.590938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0e7a38fc484fa6915c11f185d88fa4', 'request_id': 'req-ae2aad6d-b5a4-4d67-a0ca-222786644009'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:06.603347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0e7a38fc484fa6915c11f185d88fa4', 'request_id': 'req-ae2aad6d-b5a4-4d67-a0ca-222786644009'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:06.615993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0e7a38fc484fa6915c11f185d88fa4', 'request_id': 'req-ae2aad6d-b5a4-4d67-a0ca-222786644009'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:06.646217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] The token cache is being invalidate because project 7b0e7a38fc484fa6915c11f185d88fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:06.647525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:06.648607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ae2aad6d-b5a4-4d67-a0ca-222786644009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:06.698172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2834/5660] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:06 2022] DELETE /identity/v3/projects/7b0e7a38fc484fa6915c11f185d88fa4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:06.704830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:06.706060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:06.708510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:06.740864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:06.742473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:06.840773 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2827/5661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:06.850422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:06.850712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:06.851014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:06.890178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:06.891583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:06.921365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:06.928163 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2835/5662] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:06.938103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca81c4-5562-4f2b-b60f-9f0b2809e195 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:06.951527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:06.952731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:06.953176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:06.953724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:06.954915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:06.955011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:06.956680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:06.965531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:06.983111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2828/5663] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:06.987580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.001694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43296-b786-4e81-af25-4731cfe1034f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:07.021296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:07.022059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.022407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.022748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.023525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:07.026164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:07.085360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2836/5664] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:06 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:07.090610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.111036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede27b6-0f75-46c2-8187-4e3e68009567 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:07.290723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:07.291141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.291421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.291777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.292574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:07.294774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:07.347219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2829/5665] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:07 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:07.354059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.377013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4e42-a1fa-4799-9113-59cd8a737ec7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:07.386624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:07.388673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.392275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.393038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.394830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:07.404400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:07.426738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2837/5666] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:13:07.431423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.453765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5de53c-a028-477c-920c-62591ed57b46 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:07.462678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:07.463451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.463770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.464054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.464858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:07.466558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c6686-9b36-4d63-b193-bf60d3d81c11 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:07.498478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2830/5667] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:07.503618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.526336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec869eb-491c-409a-a171-da7e3241ff2d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:07.532849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:07.533836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.534125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.534433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] PATH_INFO: `/v3/projects/f09c7db56bf042f7b7ddc9bdaec44d08/users/0d98b9a22fe14f91adfd117dc5557bf5/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.569288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09c7db56bf042f7b7ddc9bdaec44d08, user_id=0d98b9a22fe14f91adfd117dc5557bf5, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:07.572984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:07.576866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:07.605253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2838/5668] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:07 2022] PUT /identity/v3/projects/f09c7db56bf042f7b7ddc9bdaec44d08/users/0d98b9a22fe14f91adfd117dc5557bf5/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:07.619664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363a7a5-cc29-4294-bcfc-2dd7a9890733 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:07.620027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363a7a5-cc29-4294-bcfc-2dd7a9890733 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:07.621170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363a7a5-cc29-4294-bcfc-2dd7a9890733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:07.704706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c363a7a5-cc29-4294-bcfc-2dd7a9890733 None None] MFA Rules not processed for user `0d98b9a22fe14f91adfd117dc5557bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:07.705925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c363a7a5-cc29-4294-bcfc-2dd7a9890733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:07.867654 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2831/5669] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:07.888810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:07.891138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:08.003991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cdeaf-52c3-440d-bb8d-b77a18962ad7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:08.011749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:08.012551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:08.013930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:08.014553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:08.030246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:08.032113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036c37-b72e-4bfb-a178-c97ca2e2bac8 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:08.057955 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2839/5670] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:08.225908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:08.226334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:08.226887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:08.266559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] MFA Rules not processed for user `6bcfb45bd9404205aefe7d1d2b33cd25`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:08.270259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:08.272153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd9c-d781-40ac-8c9f-e4b6fd254ef9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:08.272493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd9c-d781-40ac-8c9f-e4b6fd254ef9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:08.272797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd9c-d781-40ac-8c9f-e4b6fd254ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:08.305987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4a5edd9c-d781-40ac-8c9f-e4b6fd254ef9 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:08.309425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4a5edd9c-d781-40ac-8c9f-e4b6fd254ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:08.438040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2832/5671] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:08.448200 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2840/5672] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:08.464837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:08.466545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:08.485270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:08.610529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449119ba-3e6e-4c55-931c-77a349941ef4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:08.617597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:08.618768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:08.619331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:08.619763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:08.634502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:08.636703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:08.657509 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2833/5673] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:09.143893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2fea-428f-44cb-904b-e1087d38a09a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:09.144308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2fea-428f-44cb-904b-e1087d38a09a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:09.144993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2fea-428f-44cb-904b-e1087d38a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:09.168695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c5cd2fea-428f-44cb-904b-e1087d38a09a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:09.170541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c5cd2fea-428f-44cb-904b-e1087d38a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:09.185084 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2841/5674] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:09.195971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:09.211468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8ae6-9af0-4a37-acbd-94b101e5b943 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:09.220294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:09.220750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:09.221165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:09.221440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:09.234140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:09.235498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:09.247535 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2834/5675] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:09.563637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3d31-d3c9-43ab-b32b-9730c544c931 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:09.564186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3d31-d3c9-43ab-b32b-9730c544c931 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:09.564186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3d31-d3c9-43ab-b32b-9730c544c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:09.592363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1cec3d31-d3c9-43ab-b32b-9730c544c931 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:09.593894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1cec3d31-d3c9-43ab-b32b-9730c544c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:09.603236 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2842/5676] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:09.619714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:09.658543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303202bc-d912-4ca1-b6d1-54d03e09c9ee service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:09.671674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:09.673282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:09.673664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:09.674132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:09.685880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:09.687764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:09.703535 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2835/5677] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:10.126592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb28c-09f1-44b9-9914-342a9522434b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:10.127149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb28c-09f1-44b9-9914-342a9522434b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:10.127647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb28c-09f1-44b9-9914-342a9522434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:10.161826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ffafb28c-09f1-44b9-9914-342a9522434b None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:10.163308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffafb28c-09f1-44b9-9914-342a9522434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:10.180758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2843/5678] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:10.202516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:10.226731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c98e-3914-4d95-8b7e-9663c2c3ae22 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:10.253447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:10.255443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:10.256384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:10.257000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:10.275236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:10.279382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:10.291527 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2836/5679] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:10.619421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ada-4d28-46de-992b-cc63623c971b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:10.619421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ada-4d28-46de-992b-cc63623c971b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:10.619421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ada-4d28-46de-992b-cc63623c971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:10.648613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-047a3ada-4d28-46de-992b-cc63623c971b None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:10.664416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-047a3ada-4d28-46de-992b-cc63623c971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:10.687254 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2844/5680] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:10.716805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:10.734612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f51d-f4a8-4518-88d2-d7c0c59928ae service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:10.747731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:10.749249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:10.751860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:10.752404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:10.773568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:10.776185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:10.799794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2837/5681] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:11.201709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c7b4-f921-4f02-b386-c64ec96613e0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:11.201971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c7b4-f921-4f02-b386-c64ec96613e0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:11.202273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c7b4-f921-4f02-b386-c64ec96613e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:11.233524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bbd8c7b4-f921-4f02-b386-c64ec96613e0 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:11.235093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbd8c7b4-f921-4f02-b386-c64ec96613e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:11.275472 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2845/5682] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:11.276259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:11.299025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc044-4244-45c5-b0f5-51b957ab19d9 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:11.328173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:11.329623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:11.330118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:11.332944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:11.357449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:11.359912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:11.373430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2838/5683] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:13.353273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea28d49-661e-4ecb-9e1c-488fc93b22fd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:13.354266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea28d49-661e-4ecb-9e1c-488fc93b22fd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:13.354786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea28d49-661e-4ecb-9e1c-488fc93b22fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:13.381633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cea28d49-661e-4ecb-9e1c-488fc93b22fd None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:13.392087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cea28d49-661e-4ecb-9e1c-488fc93b22fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:13.422203 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2846/5684] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:13.430695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:13.452370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0e345-730a-4633-b1a6-49d18ea658be service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:13.459771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:13.461037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:13.461351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:13.461612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:13.479523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:13.481329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:13.518982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2839/5685] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:13.761831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46bf3-0817-425d-832e-a63627ffa179 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:13.763028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46bf3-0817-425d-832e-a63627ffa179 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:13.763534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46bf3-0817-425d-832e-a63627ffa179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:13.796007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c6f46bf3-0817-425d-832e-a63627ffa179 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:13.798442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c6f46bf3-0817-425d-832e-a63627ffa179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:13.818117 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2847/5686] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:13.834089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:13.870886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735bbe-116a-4547-816f-64346e93ca6e service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:13.878642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:13.879468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:13.880196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:13.880724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:13.905088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:13.907545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:13.918691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2840/5687] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:14.171253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.171552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.171833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.223964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:14.225803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:14.244892 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2848/5688] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:14.261524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:14.278834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab477-7b79-4e2b-a544-c68ec662ee7e service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:14.286303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:14.287031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.287544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.288220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.301881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:14.303976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:14.321477 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2841/5689] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:14.423794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:14.425279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:14.533130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:14.564083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77192323-0187-44f2-8513-c2c76e3cbb4e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:14.569999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1deac9a20be14da3800c265ab521e049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:14.570950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.571424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.571861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.572939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:14.573408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:14.575725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e1c09-b8bb-4fbf-811a-0db52b02b21f tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:14.609330 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2849/5690] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:14.613846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:14.630385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58d37-74e7-4098-9bfd-2cbf126a6839 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:14.637074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1deac9a20be14da3800c265ab521e049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:14.638103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.638373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.638848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.639346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.640440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.641171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.642446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:14.645456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c355259-1bb0-46bb-965a-f1ce90d0e9c7 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:14.690922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:14.692213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:14.703681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2842/5691] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:14 2022] POST /identity/v3/projects => generated 349 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:14.705820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.707770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.709778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.713344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2850/5692] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:14.731287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:14.741047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] MFA Rules not processed for user `c79c434dbfcd4eae8a1d6090974e0dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:14.742595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:14.770500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fdaed-b9c1-40a2-820b-a36a56975de0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:14.786001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:14.884284 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2843/5693] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:14.891164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:14.966226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1deac9a20be14da3800c265ab521e049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:14.967362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:14.969271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:14.969745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:14.973056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:14.973603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:14.977671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa3ba-feb7-4ee2-a45d-c7b2e7e1d7f8 tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:15.036531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2851/5694] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:15.106858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f0b3-0ac9-452c-9634-7bd949dd7fd6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:15.115389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:15.116476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:15.116943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:15.117476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:15.248584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:15.251152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:15.283390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2844/5695] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:15.583855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513538e-8895-41d3-a44b-0696556262db None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:15.584505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513538e-8895-41d3-a44b-0696556262db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:15.584505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513538e-8895-41d3-a44b-0696556262db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:15.616873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e513538e-8895-41d3-a44b-0696556262db None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:15.619146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e513538e-8895-41d3-a44b-0696556262db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:15.635571 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2852/5696] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:15.651095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:15.682937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01b32-39c8-4b29-bd79-d921f3b521a8 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:15.689488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775117-5b09-4133-8771-febb77640909 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:15.692620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775117-5b09-4133-8771-febb77640909 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:15.692759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775117-5b09-4133-8771-febb77640909 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:15.693302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775117-5b09-4133-8771-febb77640909 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:15.706193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87775117-5b09-4133-8771-febb77640909 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:15.708486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87775117-5b09-4133-8771-febb77640909 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:15.723773 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2845/5697] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:16.070261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:16.070796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:16.071257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:16.098751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:16.100306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:16.124640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775117-5b09-4133-8771-febb77640909 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:16.131590 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2853/5698] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:16.138375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775117-5b09-4133-8771-febb77640909 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:16.164854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:16.166792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:16.167427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:16.168659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:16.193488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:16.196047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:16.219364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2846/5699] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:13:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:16.438739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:16.574047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170c62-15e0-4ac9-9dd0-2e9ef7fa0841 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:16.580860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:16.582437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:16.582886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:16.583314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] PATH_INFO: `/v3/users/0d98b9a22fe14f91adfd117dc5557bf5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:16.585281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d98b9a22fe14f91adfd117dc5557bf5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:16.589333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:16.679430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d98b9a22fe14f91adfd117dc5557bf5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:16.680151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d98b9a22fe14f91adfd117dc5557bf5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:16.707080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d98b9a22fe14f91adfd117dc5557bf5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:16.713020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:16.728155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d98b9a22fe14f91adfd117dc5557bf5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:16.741340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-93789e9c-9cd1-47dc-b34a-70e80db03980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d98b9a22fe14f91adfd117dc5557bf5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:16.748648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:16.755027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2854/5700] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:16 2022] DELETE /identity/v3/users/0d98b9a22fe14f91adfd117dc5557bf5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:16.759552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:16.762177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:16.762626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:16.769555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da5df-69c4-4383-aef7-7bb637607b83 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:16.789722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:16.791282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:16.918297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2855/5701] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:16.953437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:16.969479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:16.973170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:16.983645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1deac9a20be14da3800c265ab521e049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:16.989455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:16.990297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:16.990891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] PATH_INFO: `/v3/projects/5d980ca79ee84b50ab62529769a02030` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:16.992646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d980ca79ee84b50ab62529769a02030)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:16.998660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:17.103646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d980ca79ee84b50ab62529769a02030', 'request_id': 'req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:17.127021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d980ca79ee84b50ab62529769a02030', 'request_id': 'req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:17.137467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d980ca79ee84b50ab62529769a02030', 'request_id': 'req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:17.142836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e591-3f4a-4a04-883e-9fe65726fea9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:17.168768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] The token cache is being invalidate because project 5d980ca79ee84b50ab62529769a02030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:17.169489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:17.171101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:17.184581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2847/5702] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:16 2022] DELETE /identity/v3/projects/5d980ca79ee84b50ab62529769a02030 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:13:17.196673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:17.199797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:17.409842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:17.410441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:17.410647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:17.410873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:17.422250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:17.517642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db633-2f71-4a0b-bc47-9bcc8a04baaf tempest-RoutersIpV6AdminTest-2115365572 tempest-RoutersIpV6AdminTest-2115365572-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:17.527807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:17.529072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:17.529378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:17.529751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:17.537748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:17.568852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:17.615542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:17.617847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827afd-c3a3-4ee0-9463-1f40fdf1ae23 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:17.631461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2856/5703] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:17.716721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:17.721640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:17.745636 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2848/5704] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:18.084758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:18.085049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:18.085329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:18.142106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] MFA Rules not processed for user `5bb232b046fa4ecc86c1490daf6da5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:18.143844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:18.242746 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2857/5705] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:18.258122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:18.259782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:18.306557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:18.351153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73659-3d19-4e9c-9c40-987f269de2db service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:18.365837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:18.366604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:18.367037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:18.367308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:18.389806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:18.391618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2f45f-5086-4e42-a04e-1df78d93112c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:18.403207 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2849/5706] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:19.459816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:19.462686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:19.483656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede5b1-c48b-4a0b-b098-7bc964b545cd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:19.506808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:19.508074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:19.509775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:19.517284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] PATH_INFO: `/v3/projects/f09c7db56bf042f7b7ddc9bdaec44d08` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:19.519114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09c7db56bf042f7b7ddc9bdaec44d08)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:19.529790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:19.652137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09c7db56bf042f7b7ddc9bdaec44d08', 'request_id': 'req-9e521ccc-d207-4596-a309-bb14a05eb344'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:19.664379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09c7db56bf042f7b7ddc9bdaec44d08', 'request_id': 'req-9e521ccc-d207-4596-a309-bb14a05eb344'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:19.681456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09c7db56bf042f7b7ddc9bdaec44d08', 'request_id': 'req-9e521ccc-d207-4596-a309-bb14a05eb344'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:19.709884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] The token cache is being invalidate because project f09c7db56bf042f7b7ddc9bdaec44d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:19.710288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:19.711426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9e521ccc-d207-4596-a309-bb14a05eb344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:19.716405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2858/5707] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:19 2022] DELETE /identity/v3/projects/f09c7db56bf042f7b7ddc9bdaec44d08 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:19.722115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:19.722658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:19.723189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:19.754381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:19.756398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:19.913600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2850/5708] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:19.921006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:19.921623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:19.922184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:19.969449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:19.970726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:19.998361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2859/5709] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:20.002488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.026064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562befd-604e-4c21-beff-091b16d9a65f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.043922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.044739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.045031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.045315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.046065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:20.046377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.048046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.070912 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2851/5710] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:13:20.073286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.084202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8812478-c982-4b19-8942-51e2e6b7f581 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.098775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.100466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.101098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.102551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.103675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.106694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.152036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2860/5711] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:20 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:20.156325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.166718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee9d5-4691-42ab-b0e0-a00a96f3dbac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.311279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.312824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.313318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.313906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.315343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.317576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.364502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2852/5712] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:20 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:20.366385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.382204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660326a-1b1b-46d7-bc64-b7816608b4ff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.412971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.420504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.421364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.423585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.426709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.430107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.462263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2861/5713] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:20.465174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.505337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843746-1cf6-40ae-901a-57cdc7995a7d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.512134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.512977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.513342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.513623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.515284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.517315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19537c-d460-434c-88c2-80505498e2e7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.571859 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2853/5714] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:20.575975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:20.594151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167680-12c2-4ea2-ab30-fdfee5b365dc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:20.607928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:20.609143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.609611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.610038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] PATH_INFO: `/v3/projects/afc041ba66854ff1a32173acef61086d/users/99418d7dc44e4d9daf476b636f14aada/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.645824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:20.649750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc041ba66854ff1a32173acef61086d, user_id=99418d7dc44e4d9daf476b636f14aada, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:20.652775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:20.693039 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2862/5715] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:20 2022] PUT /identity/v3/projects/afc041ba66854ff1a32173acef61086d/users/99418d7dc44e4d9daf476b636f14aada/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:20.703657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:20.703957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:20.704246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:20.786213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] MFA Rules not processed for user `99418d7dc44e4d9daf476b636f14aada`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:20.796220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:20.863464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:21.054360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2854/5716] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:21.058483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:21.301510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a88c-3e24-4430-8b7e-05121ebab74e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:21.318239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:21.319149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:21.319506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:21.319942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:21.320780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:21.322927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:21.383503 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2863/5717] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:21.384672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:21.407960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b3141-9b85-46d6-a380-10ddfb0846b9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:21.568656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:21.569513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:21.569915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:21.570262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:21.577298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:21.585081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:21.660867 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2855/5718] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:21 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:13:21.665031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:21.683245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ee39-2441-42f7-b0e3-32077cfcbb6f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:21.688913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:21.689903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:21.690331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:21.690747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:21.691629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:21.693545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:21.706610 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2864/5719] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:21.710984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:21.723255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdef10-8946-4114-9286-c0a3e48d3750 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:21.729546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:21.730882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:21.731388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:21.731927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] PATH_INFO: `/v3/projects/4a19cf3cb4454021a5933d85bd261f61/users/fe8e89455f324fa9841f7bec954644c2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:21.777484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a19cf3cb4454021a5933d85bd261f61, user_id=fe8e89455f324fa9841f7bec954644c2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:21.782017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:21.810240 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2856/5720] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:21 2022] PUT /identity/v3/projects/4a19cf3cb4454021a5933d85bd261f61/users/fe8e89455f324fa9841f7bec954644c2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:21.824941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:21.854810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e724dc-8865-4985-9da7-5cb5db72fa9e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:21.983375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:21.987880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:21.988180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:21.988464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:21.989233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:21.993742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20787a9-7b92-4f41-8436-fd369c53ccc7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:22.021676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2865/5721] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:22.028148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:22.046440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca85bc-46ad-4627-910e-af6060440f1b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:22.053329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:22.057689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:22.058379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:22.058900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] PATH_INFO: `/v3/projects/4a19cf3cb4454021a5933d85bd261f61/users/fe8e89455f324fa9841f7bec954644c2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:22.062757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a19cf3cb4454021a5933d85bd261f61, user_id=fe8e89455f324fa9841f7bec954644c2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:22.066195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:22.094573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2857/5722] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:22 2022] PUT /identity/v3/projects/4a19cf3cb4454021a5933d85bd261f61/users/fe8e89455f324fa9841f7bec954644c2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:22.106156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:22.106442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:22.107001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:22.155177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] MFA Rules not processed for user `fe8e89455f324fa9841f7bec954644c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:22.156839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:22.226776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:22.256735 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2866/5723] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:22.313353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:22.316010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:22.427090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb005-eb18-4232-b2ae-9fbd8fe4cdbb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:22.431380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:22.432161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:22.432606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:22.432974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:22.452204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:22.453841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:22.470213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2858/5724] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:24.041575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:24.044397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:24.219288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716d9a-aa38-49a2-844b-965dfaaa7ab2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:24.225565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:24.226841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:24.227127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:24.227404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:24.229512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:24.249522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:24.251572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e8ba-0b8d-4c77-be73-044e0c64972f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:24.275762 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2867/5725] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:25.751678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:25.766532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:25.843563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6b775-4cee-441c-ac63-729c627a0276 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:25.848671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:25.850015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:25.850396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:25.850746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] PATH_INFO: `/v3/users/99418d7dc44e4d9daf476b636f14aada` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:25.852244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99418d7dc44e4d9daf476b636f14aada)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:25.854477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:25.920186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99418d7dc44e4d9daf476b636f14aada'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:25.933331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99418d7dc44e4d9daf476b636f14aada'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:25.954148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99418d7dc44e4d9daf476b636f14aada'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:25.957044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99418d7dc44e4d9daf476b636f14aada'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:25.958453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99418d7dc44e4d9daf476b636f14aada'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:25.979647 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2859/5726] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:25 2022] DELETE /identity/v3/users/99418d7dc44e4d9daf476b636f14aada => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:25.984376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:25.984945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:25.984945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:26.007341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:26.008749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:26.116653 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2868/5727] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:26.125355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:26.127288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:26.194344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c956-f91e-4fee-923f-9661742d701d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:26.198299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:26.199047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:26.199336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:26.199598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:26.210113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:26.211686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:26.223445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2860/5728] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:13:26.571282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:26.572874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:26.599727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a56c-b4a1-4253-9916-c827210419db None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:26.607145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:26.609535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:26.610171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:26.610504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] PATH_INFO: `/v3/projects/afc041ba66854ff1a32173acef61086d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:26.611906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc041ba66854ff1a32173acef61086d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:26.613898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:26.681242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc041ba66854ff1a32173acef61086d', 'request_id': 'req-b66ab895-d511-481a-a2b4-ab63e43eb300'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.691534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc041ba66854ff1a32173acef61086d', 'request_id': 'req-b66ab895-d511-481a-a2b4-ab63e43eb300'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.697569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc041ba66854ff1a32173acef61086d', 'request_id': 'req-b66ab895-d511-481a-a2b4-ab63e43eb300'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.699453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:26.711004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] The token cache is being invalidate because project afc041ba66854ff1a32173acef61086d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:26.713098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.714121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.718972 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2869/5729] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:26 2022] DELETE /identity/v3/projects/afc041ba66854ff1a32173acef61086d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:26.720371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:26.741618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ef86d-ab4c-441c-ae68-cba90d1347e6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:26.797994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:26.845760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:26.847227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:26.847608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:26.848173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] PATH_INFO: `/v3/users/fe8e89455f324fa9841f7bec954644c2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:26.849550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8e89455f324fa9841f7bec954644c2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:26.851686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:26.909860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8e89455f324fa9841f7bec954644c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.918180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8e89455f324fa9841f7bec954644c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.931062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8e89455f324fa9841f7bec954644c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.931845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8e89455f324fa9841f7bec954644c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.932477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7105a17f-64f0-4400-bd52-95884c8b3162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8e89455f324fa9841f7bec954644c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:26.945926 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2861/5730] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:26 2022] DELETE /identity/v3/users/fe8e89455f324fa9841f7bec954644c2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:13:27.415195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:27.416780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:27.431754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ab895-d511-481a-a2b4-ab63e43eb300 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:27.506929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:27.507829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:27.508110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:27.508392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] PATH_INFO: `/v3/projects/4a19cf3cb4454021a5933d85bd261f61` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:27.510399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a19cf3cb4454021a5933d85bd261f61)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:27.512512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:27.603600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a19cf3cb4454021a5933d85bd261f61', 'request_id': 'req-ff16ed84-6351-432d-85eb-5b6cc555d2ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:27.617045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a19cf3cb4454021a5933d85bd261f61', 'request_id': 'req-ff16ed84-6351-432d-85eb-5b6cc555d2ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:27.624901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a19cf3cb4454021a5933d85bd261f61', 'request_id': 'req-ff16ed84-6351-432d-85eb-5b6cc555d2ad'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:27.639531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] The token cache is being invalidate because project 4a19cf3cb4454021a5933d85bd261f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:27.639802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:27.640408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff16ed84-6351-432d-85eb-5b6cc555d2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:27.642352 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2870/5731] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:27 2022] DELETE /identity/v3/projects/4a19cf3cb4454021a5933d85bd261f61 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:27.647566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:27.648296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:27.648775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:27.679088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:27.680314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:27.767030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2862/5732] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:27.776550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:27.776858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:27.777109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:27.819996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:27.821416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:27.833147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2871/5733] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:27.838890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:27.853474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50688-0ebe-4b9e-8f97-12326d2e4256 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:27.860731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:27.861869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:27.862245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:27.863056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:27.866519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:27.867517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:27.872174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:27.890709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2863/5734] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:27.892669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:27.904382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f75199-4640-49b4-b1b3-6b023576c3db None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:27.912244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:27.914150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:27.914625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:27.915643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:27.916685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:27.919918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:27.976361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:27.977498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2872/5735] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:27 2022] POST /identity/v3/projects => generated 357 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:27.980988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:27.983042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:27.995242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd6578-0279-4d6c-abf8-1b81538e74f5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.072702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:28.076036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:28.083347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9face3b8-c49e-4f63-9d2f-d3cc189eee8d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.095079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.096046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.097943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.098244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] PATH_INFO: `/v3/users/5bb232b046fa4ecc86c1490daf6da5e4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.100272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb232b046fa4ecc86c1490daf6da5e4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.103544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.138739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.140905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.142193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.143039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.145431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.150181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.185431 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2864/5736] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:27 2022] POST /identity/v3/users => generated 279 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:13:28.188274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb232b046fa4ecc86c1490daf6da5e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.189154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.190465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb232b046fa4ecc86c1490daf6da5e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.191084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.205542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb232b046fa4ecc86c1490daf6da5e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.206171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c0236-3fa5-44f1-b5b1-5aba20987f37 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.216669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.218445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.218700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.218988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.219754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.221422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.222420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb232b046fa4ecc86c1490daf6da5e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.233184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb232b046fa4ecc86c1490daf6da5e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.236601 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2865/5737] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:28.237855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.243730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2873/5738] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:27 2022] DELETE /identity/v3/users/5bb232b046fa4ecc86c1490daf6da5e4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:28.251347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e4509-bc71-443b-91af-32f024dccc91 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.323374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.324540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.325175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.325792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.327146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.329835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720da2c-4838-46f4-ba6b-df5a8d000cdc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.346588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2866/5739] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:28.351151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.363875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f294b-475c-4619-92ad-f66e6e87b97e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.369949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.370908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.371195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.371473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] PATH_INFO: `/v3/projects/cbdb7363c22a4fc78b202f859583798c/users/2643eda78e00425dad51367165d9ed80/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.393439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdb7363c22a4fc78b202f859583798c, user_id=2643eda78e00425dad51367165d9ed80, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.396412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.425157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2874/5740] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:28 2022] PUT /identity/v3/projects/cbdb7363c22a4fc78b202f859583798c/users/2643eda78e00425dad51367165d9ed80/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:28.428624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.429083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.429485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.459589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] MFA Rules not processed for user `2643eda78e00425dad51367165d9ed80`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:28.461263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.545224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2867/5741] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:28.556240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.558154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.566628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.568207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.634939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73855714-b0a3-4d79-857c-b67339cd0bac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.639217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.639972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.640379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.640801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.646148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:28.656711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.658240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5612395-4209-484b-8275-8b041c3e061c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.673269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2875/5742] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:28.676448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493950-4d49-4874-9b9c-6bd4a07853aa None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.681811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.682809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.683184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.683625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] PATH_INFO: `/v3/projects/41ad5eda252e437fbe013b86b0bb5361` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.685044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ad5eda252e437fbe013b86b0bb5361)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.687120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:28.740679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ad5eda252e437fbe013b86b0bb5361', 'request_id': 'req-f220212f-80c5-497f-8090-106b4ecd9af2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.750553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ad5eda252e437fbe013b86b0bb5361', 'request_id': 'req-f220212f-80c5-497f-8090-106b4ecd9af2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.759816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ad5eda252e437fbe013b86b0bb5361', 'request_id': 'req-f220212f-80c5-497f-8090-106b4ecd9af2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.772345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] The token cache is being invalidate because project 41ad5eda252e437fbe013b86b0bb5361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:28.772677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.773364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f220212f-80c5-497f-8090-106b4ecd9af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:28.775396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2868/5743] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:28 2022] DELETE /identity/v3/projects/41ad5eda252e437fbe013b86b0bb5361 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:28.783740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.783983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.784294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.804863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:28.806328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.888549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:28.915414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2876/5744] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:28.918632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.919210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.919522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.947899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:28.950135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:28.967216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2869/5745] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:28.968628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:28.980124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b281d-8099-4d72-81ee-f28b9f99a8e4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:28.988275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:28.990150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:28.991324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:28.991772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:28.993312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:28.994028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:28.996870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.024221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.032905 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2877/5746] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:29.039422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86cc4-e3fd-42ab-bbd4-35d68fd76617 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:29.050816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:29.052130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.052516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.052898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.053947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:29.056973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.140403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2870/5747] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:29.146549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.161832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460057b7-bdc7-42aa-a0ca-82a1eaefa22e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:29.257514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:29.258327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.258750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.259073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.260168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:29.262279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.314613 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2878/5748] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:29 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:29.319429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.335087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6cde-0bb1-4a36-bfa0-e5e087316f67 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:29.341590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:29.342499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.343010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.343438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.344402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:29.346437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.559720 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2871/5749] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:29.561843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.574926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c1605-daa7-48b5-b0b7-08177b6231e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:29.581638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:29.582742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.583303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.583831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.584879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:29.587354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcdcf4-db91-40ac-b388-80936fc410d6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.602841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2879/5750] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:29.607337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.618411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed865-9b28-4acc-9e4c-2a9808ae7b85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:29.624535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:29.625457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.625736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.626012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] PATH_INFO: `/v3/projects/4e4c7c00da2a44ada00ef3be3ffafb30/users/e18c0e3b16574a9d923a1159f08bbbd4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.643868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4c7c00da2a44ada00ef3be3ffafb30, user_id=e18c0e3b16574a9d923a1159f08bbbd4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:29.647344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:29.686095 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2872/5751] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:29 2022] PUT /identity/v3/projects/4e4c7c00da2a44ada00ef3be3ffafb30/users/e18c0e3b16574a9d923a1159f08bbbd4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:29.687561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:29.688071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:29.688811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:29.722006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:29.725689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:29.817008 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2880/5752] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:29.867407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:29.869390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:29.995536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3be7-9eba-423d-a818-3ca740db532d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:30.000968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:30.001879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:30.002539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:30.003459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:30.021014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:30.023709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad519f44-84bb-4efc-9ef6-87ccf7819746 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:30.043204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2873/5753] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:37.993478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:37.995142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:38.014419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cb1f-f790-4b88-9c32-39de73329c85 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:38.032719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:38.039299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:38.039876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:38.040242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:38.048784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:38.091551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:38.096330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:38.138734 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2881/5754] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:40.035485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:41.417107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a1120-8222-41eb-ae0d-9b7e9c44e74b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:41.418201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a1120-8222-41eb-ae0d-9b7e9c44e74b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:41.418706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a1120-8222-41eb-ae0d-9b7e9c44e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:41.455637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-155a1120-8222-41eb-ae0d-9b7e9c44e74b None None] MFA Rules not processed for user `e18c0e3b16574a9d923a1159f08bbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:41.457769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-155a1120-8222-41eb-ae0d-9b7e9c44e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:41.595151 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2874/5755] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:41.619028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:41.621090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:41.713904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:41.799794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2bba2-84ce-401a-bb55-b5a2593bedb9 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:41.820570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:41.822237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:41.822237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:41.822918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:41.854586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:41.857565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:41.878815 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2882/5756] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:43.357319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd757-7f37-4f53-9367-67e0cf1dc798 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:43.358076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd757-7f37-4f53-9367-67e0cf1dc798 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:43.358223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd757-7f37-4f53-9367-67e0cf1dc798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:43.382094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-803fd757-7f37-4f53-9367-67e0cf1dc798 None None] MFA Rules not processed for user `e18c0e3b16574a9d923a1159f08bbbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:43.383808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-803fd757-7f37-4f53-9367-67e0cf1dc798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:43.403562 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2875/5757] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:51.867046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:52.966803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:52.968973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:53.002739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43400-00f6-4eae-a27a-368b97bb375a service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:53.009069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:53.010507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:53.010740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:53.011175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] PATH_INFO: `/v3/users/2643eda78e00425dad51367165d9ed80` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:53.012857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2643eda78e00425dad51367165d9ed80)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:53.015554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:53.108887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2643eda78e00425dad51367165d9ed80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:53.109725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2643eda78e00425dad51367165d9ed80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:53.130193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2643eda78e00425dad51367165d9ed80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:53.145063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2643eda78e00425dad51367165d9ed80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:53.155326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2643eda78e00425dad51367165d9ed80'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:53.163148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2883/5758] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:52 2022] DELETE /identity/v3/users/2643eda78e00425dad51367165d9ed80 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:53.169295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:53.169741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:53.169838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:53.195439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:53.197085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:53.303614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2876/5759] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:53.336797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:53.339191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:53.457069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb637-8035-404f-9a9e-5e13a9476b4b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:53.463105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:53.463993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:53.466400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:53.466400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:53.481295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:53.483026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b164e-7c52-4fa9-907d-dd7967c50887 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:53.497751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2884/5760] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:53.974557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:53.978338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:54.012493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d712c7-d2bd-4b64-9505-358a04e6a90a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.029429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.031352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.032802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.034453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] PATH_INFO: `/v3/projects/cbdb7363c22a4fc78b202f859583798c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.037570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdb7363c22a4fc78b202f859583798c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.039725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.152539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdb7363c22a4fc78b202f859583798c', 'request_id': 'req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:54.178647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdb7363c22a4fc78b202f859583798c', 'request_id': 'req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:54.186658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdb7363c22a4fc78b202f859583798c', 'request_id': 'req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:54.215049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] The token cache is being invalidate because project cbdb7363c22a4fc78b202f859583798c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:54.215392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:54.216096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-81ea6af8-ca31-456e-8ab5-2ce6a053bd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:54.226518 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2877/5761] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:53 2022] DELETE /identity/v3/projects/cbdb7363c22a4fc78b202f859583798c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:54.231889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.232394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.232697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.278074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:54.287034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:54.396940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:54.425228 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2885/5762] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:54.425822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.426116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.426407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.453371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:54.463412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:54.465382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:54.491895 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2878/5763] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:54.495197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.507024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18502fa-4657-4bf1-a55b-a96018f6dba9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.512650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.513609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.513999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.514497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.515360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:54.515774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.517619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.541675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2886/5764] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:54.544020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.556762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc8bc-042b-4067-91e6-39a400eb5f29 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.563353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.564925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.565436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.566098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.567039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.583822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.624539 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2879/5765] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:54 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:54.627435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.644470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2038eb-594a-4912-bb7b-5b1c10fb13da admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.730168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.731351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.731860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.732386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.733586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.735822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.778841 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2887/5766] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:54 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:54.782340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.805541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fac9b-eb85-4a42-92f9-98494d0aa11b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.822350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.823229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.823622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.824006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.825015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.832629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.860511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2880/5767] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:54.862763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.887092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3314c-95ee-4975-a5ee-ba3be62c4d2a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.904136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.904891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.905184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.905466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:54.906219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:54.907887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beabdd-f5dc-420d-8658-4aeb8cec29c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:54.933281 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2888/5768] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:54.934447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:54.955692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ca71-fd17-4d48-8692-c6352ba72401 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:54.968401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:54.971155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:54.971694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:54.972189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] PATH_INFO: `/v3/projects/d3fa6e8df3e944c29296068746ecb646/users/7f9d8a81803c4d469fec9321c8854271/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.014378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fa6e8df3e944c29296068746ecb646, user_id=7f9d8a81803c4d469fec9321c8854271, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.017370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.041054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2881/5769] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:54 2022] PUT /identity/v3/projects/d3fa6e8df3e944c29296068746ecb646/users/7f9d8a81803c4d469fec9321c8854271/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:13:55.051503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.051804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.052088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.141658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] MFA Rules not processed for user `7f9d8a81803c4d469fec9321c8854271`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:55.143490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:55.246959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2889/5770] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:55.251804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.345891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d81e0-bb41-4c07-87f1-ee095e94c006 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.351488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.352284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.352701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.353075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.355041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.369126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.406486 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2882/5771] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:55 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:55.407828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.420175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af21ec-2096-4265-b147-ed2b0f3d301b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.479568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:55.490586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.491741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.492246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.492616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.493512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.496161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.528604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2890/5772] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:13:55 2022] POST /identity/v3/users => generated 309 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:13:55.532562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.544312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9b54-a651-4e2d-bffc-ce1d06641ff3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.552707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.553423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.553705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.553975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.554710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.556352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.572986 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2883/5773] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:55.575257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.586451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d2fa-a688-41af-8281-b481e6fb9d47 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.592080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.593171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.593714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.593961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] PATH_INFO: `/v3/projects/276d2a14bc884187b6372b1846a53d53/users/92136212a1c544c3aa9dddf2ef5ab94e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.613652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276d2a14bc884187b6372b1846a53d53, user_id=92136212a1c544c3aa9dddf2ef5ab94e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.616981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.633086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2891/5774] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:55 2022] PUT /identity/v3/projects/276d2a14bc884187b6372b1846a53d53/users/92136212a1c544c3aa9dddf2ef5ab94e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:55.637149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.666831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf6fc7-9ecc-484f-b4c6-baf8a19f99bc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.751595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.752466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.752852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.753223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.754101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.755878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f1064-9ebc-40a3-8fd8-d73069629148 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.770559 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2884/5775] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:13:55.771898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:55.784663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bde54-af1a-4393-9de1-1b2c9df1ada0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:55.792306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:55.793484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.794631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.795027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] PATH_INFO: `/v3/projects/276d2a14bc884187b6372b1846a53d53/users/92136212a1c544c3aa9dddf2ef5ab94e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.798032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276d2a14bc884187b6372b1846a53d53, user_id=92136212a1c544c3aa9dddf2ef5ab94e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:55.800841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:55.818536 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2892/5776] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:13:55 2022] PUT /identity/v3/projects/276d2a14bc884187b6372b1846a53d53/users/92136212a1c544c3aa9dddf2ef5ab94e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:55.831162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:55.831471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:55.832064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:55.891346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:55.902816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] MFA Rules not processed for user `92136212a1c544c3aa9dddf2ef5ab94e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:55.906819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:55.990413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2885/5777] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:56.002652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:56.012682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:56.109654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12fb6-41fa-4be3-b8fe-2ab5cedb8ae5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:56.113438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:56.114137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:56.114439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:56.114713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:56.124938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:56.126379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a75ae-418f-47f6-a25f-d5b26be1ad59 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:56.136741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2893/5778] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:56.287282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:56.388217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60edf44-623a-45df-b0a7-aeca290b0a30 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:56.399891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:56.407763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:56.408223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:56.408600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] PATH_INFO: `/v3/users/7f9d8a81803c4d469fec9321c8854271` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:56.414108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9d8a81803c4d469fec9321c8854271)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:56.417439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:56.494636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9d8a81803c4d469fec9321c8854271'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:56.522126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9d8a81803c4d469fec9321c8854271'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:56.551686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9d8a81803c4d469fec9321c8854271'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:56.556561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9d8a81803c4d469fec9321c8854271'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:56.557318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9d8a81803c4d469fec9321c8854271'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:56.584468 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2886/5779] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:56 2022] DELETE /identity/v3/users/7f9d8a81803c4d469fec9321c8854271 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:56.590437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:56.591316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:56.591751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:56.619900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:56.621220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:56.706540 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2894/5780] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:56.727927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:56.729571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:56.769604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:56.849537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88669f-eacf-48f6-a19b-787bbf6b5ba1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:56.854635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:56.856157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:56.856724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:56.857224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:56.874823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:56.877433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:56.912953 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2887/5781] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:13:57.518256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:57.520195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:57.534104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972bc40-d7cc-4217-b7e2-1d3a1a6baa93 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:57.545423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:57.546781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:57.547068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:57.547338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] PATH_INFO: `/v3/projects/d3fa6e8df3e944c29296068746ecb646` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:57.549116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fa6e8df3e944c29296068746ecb646)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:57.553005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:57.640403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:57.644777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fa6e8df3e944c29296068746ecb646', 'request_id': 'req-038f31ff-614d-41db-8be7-65d57a93dc0c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.656760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fa6e8df3e944c29296068746ecb646', 'request_id': 'req-038f31ff-614d-41db-8be7-65d57a93dc0c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.670704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fa6e8df3e944c29296068746ecb646', 'request_id': 'req-038f31ff-614d-41db-8be7-65d57a93dc0c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.702495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] The token cache is being invalidate because project d3fa6e8df3e944c29296068746ecb646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:57.703153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.703925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.706986 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2895/5782] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:57 2022] DELETE /identity/v3/projects/d3fa6e8df3e944c29296068746ecb646 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:57.712717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:57.726615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0915bd-4760-4109-b1b1-86dac83d4e9c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:57.863116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:57.864976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:57.865643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:57.866153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] PATH_INFO: `/v3/users/92136212a1c544c3aa9dddf2ef5ab94e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:57.869475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92136212a1c544c3aa9dddf2ef5ab94e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:57.872091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:57.979867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92136212a1c544c3aa9dddf2ef5ab94e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:57.998421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92136212a1c544c3aa9dddf2ef5ab94e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.035014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92136212a1c544c3aa9dddf2ef5ab94e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.038693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92136212a1c544c3aa9dddf2ef5ab94e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.039920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92136212a1c544c3aa9dddf2ef5ab94e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.059906 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2888/5783] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:57 2022] DELETE /identity/v3/users/92136212a1c544c3aa9dddf2ef5ab94e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:58.078512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:58.079964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:58.102430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f31ff-614d-41db-8be7-65d57a93dc0c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:58.197490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:58.198602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:58.199500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:58.199834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] PATH_INFO: `/v3/users/ec129d5641ef457c99014e8f95fcfb5d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:58.201680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec129d5641ef457c99014e8f95fcfb5d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:58.203669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:58.284465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec129d5641ef457c99014e8f95fcfb5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.285356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec129d5641ef457c99014e8f95fcfb5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.298010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec129d5641ef457c99014e8f95fcfb5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.316144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec129d5641ef457c99014e8f95fcfb5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.330803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec129d5641ef457c99014e8f95fcfb5d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:58.339801 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2896/5784] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:58 2022] DELETE /identity/v3/users/ec129d5641ef457c99014e8f95fcfb5d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:59.346198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:59.349013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:59.355953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:59.359011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:59.378902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457646e-a64f-465d-946d-84e177c616e1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:59.464273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:59.466647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:59.505419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:59.507950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.510297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.510853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] PATH_INFO: `/v3/projects/4e97b91d23b24e7aba5860e7d0bd062c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.512732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e97b91d23b24e7aba5860e7d0bd062c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:59.515616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:59.524883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bf1df-064e-4b78-8a26-f22604ab7907 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:59.531281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:59.532324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.532992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.533372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] PATH_INFO: `/v3/projects/276d2a14bc884187b6372b1846a53d53` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.535760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=276d2a14bc884187b6372b1846a53d53)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:59.540014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:59.580207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e97b91d23b24e7aba5860e7d0bd062c', 'request_id': 'req-3fa0576a-ec49-4fb6-a667-1fcc228b964b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.606787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e97b91d23b24e7aba5860e7d0bd062c', 'request_id': 'req-3fa0576a-ec49-4fb6-a667-1fcc228b964b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.616164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e97b91d23b24e7aba5860e7d0bd062c', 'request_id': 'req-3fa0576a-ec49-4fb6-a667-1fcc228b964b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.631589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] The token cache is being invalidate because project 4e97b91d23b24e7aba5860e7d0bd062c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:59.632027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.633370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.638102 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2889/5785] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:59 2022] DELETE /identity/v3/projects/4e97b91d23b24e7aba5860e7d0bd062c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:59.639343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:59.641446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:59.646143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276d2a14bc884187b6372b1846a53d53', 'request_id': 'req-be241d57-00cf-4f34-b0d2-903fb3b96a7c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.663008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276d2a14bc884187b6372b1846a53d53', 'request_id': 'req-be241d57-00cf-4f34-b0d2-903fb3b96a7c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.675689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276d2a14bc884187b6372b1846a53d53', 'request_id': 'req-be241d57-00cf-4f34-b0d2-903fb3b96a7c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.693078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] The token cache is being invalidate because project 276d2a14bc884187b6372b1846a53d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:13:59.693353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.695278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-be241d57-00cf-4f34-b0d2-903fb3b96a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.697995 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2897/5786] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:13:59 2022] DELETE /identity/v3/projects/276d2a14bc884187b6372b1846a53d53 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:13:59.705512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060511e-a5df-46d3-958a-2215351973d4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.705898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060511e-a5df-46d3-958a-2215351973d4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.706284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060511e-a5df-46d3-958a-2215351973d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.740765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0576a-ec49-4fb6-a667-1fcc228b964b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:59.754254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f060511e-a5df-46d3-958a-2215351973d4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:59.755954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f060511e-a5df-46d3-958a-2215351973d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:59.840401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:59.841441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.841732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.842056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] PATH_INFO: `/v3/users/a7221bfe15c64e0d9509b3b44ebcfab9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.843539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7221bfe15c64e0d9509b3b44ebcfab9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:59.846130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:59.861185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2898/5787] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:13:59.869503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.869503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.869807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.872296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:59.911248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:13:59.912871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:13:59.921048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7221bfe15c64e0d9509b3b44ebcfab9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.925612 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2899/5788] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:13:59.930389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:59.935846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7221bfe15c64e0d9509b3b44ebcfab9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.942227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ffa2c-d562-4bab-9a63-cb5d0d372e21 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:13:59.947636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:13:59.949493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:13:59.949788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:13:59.950063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:13:59.950820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:13:59.950931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7221bfe15c64e0d9509b3b44ebcfab9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.951171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:13:59.951763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7221bfe15c64e0d9509b3b44ebcfab9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.952511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7221bfe15c64e0d9509b3b44ebcfab9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:13:59.952908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:13:59.970357 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2890/5789] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:13:59 2022] DELETE /identity/v3/users/a7221bfe15c64e0d9509b3b44ebcfab9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:13:59.970608 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2900/5790] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:13:59.974036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:13:59.975374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:00.067967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcbca8-1f9d-4ac5-a285-f9cd54963380 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.074275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.075621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.076320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.077049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.077621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.079723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.115382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2891/5791] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:13:59 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:14:00.120008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.131138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dde611-c7b5-4f24-aee0-a00a3385b884 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.211304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.214093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:00.214927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.215871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.216896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.217373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.218267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.220607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.230497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:00.256868 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2901/5792] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:00 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:00.258720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.271759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be47a9-cb01-433b-ac3d-598f426c5e4e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.280602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.281635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.283525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.284012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.284780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.286418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.306780 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2902/5793] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:00.307709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.319762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eff990-11d9-491e-976e-388fef839a88 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.324926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.325686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.326005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.326654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.327056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.328940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.344546 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2903/5794] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:00.347835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.365436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61ce60-5f31-4aea-b49d-a352114ba28d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.372777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.373697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.374031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.374291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] PATH_INFO: `/v3/projects/1bacb76f83fb45c69709ef8b94703c35/users/f2ed48272da4483389d53ca7198924e3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.393902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bacb76f83fb45c69709ef8b94703c35, user_id=f2ed48272da4483389d53ca7198924e3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.396830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230f44-1983-4535-b4fc-7103cb653cf1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.403823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde4f85-c4bb-4f05-9dc6-7b79afc811e9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.416225 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2904/5795] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:00 2022] PUT /identity/v3/projects/1bacb76f83fb45c69709ef8b94703c35/users/f2ed48272da4483389d53ca7198924e3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:00.427021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.427628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.428065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.442792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:00.504672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] MFA Rules not processed for user `f2ed48272da4483389d53ca7198924e3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:00.505912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:00.551739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.552442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.558645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.558871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.562956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:00.587945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.593590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.602030 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2905/5796] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:00.603172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.606610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:00.612417 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2892/5797] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:00.613573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.751500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05978d-0f83-4f2b-911f-97b7521a6fe2 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.758152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.775641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.775942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.776360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.777150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.780715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.810499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3f329-23ce-4c8f-8a56-817d0ce5797b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:00.830655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:00.831852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:00.833761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:00.834221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] PATH_INFO: `/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:00.839080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704ed985f3434c0e9e97b3c1d4bd6064)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:00.846166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:00.880555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2893/5798] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:00 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:00.883697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:00.965294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:00.982321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704ed985f3434c0e9e97b3c1d4bd6064', 'request_id': 'req-354fba8b-73ac-421f-b521-baa73f463505'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:01.002983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704ed985f3434c0e9e97b3c1d4bd6064', 'request_id': 'req-354fba8b-73ac-421f-b521-baa73f463505'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:01.014356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704ed985f3434c0e9e97b3c1d4bd6064', 'request_id': 'req-354fba8b-73ac-421f-b521-baa73f463505'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:01.052273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] The token cache is being invalidate because project 704ed985f3434c0e9e97b3c1d4bd6064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:01.054037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:01.055475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-354fba8b-73ac-421f-b521-baa73f463505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:01.059531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2906/5799] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:00 2022] DELETE /identity/v3/projects/704ed985f3434c0e9e97b3c1d4bd6064 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:01.065627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a2d-1a3b-4d15-ab8f-c3cd47b4093b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.066972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a2d-1a3b-4d15-ab8f-c3cd47b4093b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.068823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a2d-1a3b-4d15-ab8f-c3cd47b4093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.099198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742ad78-580f-42ed-84d8-6c51a86cc135 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.112742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cf020a2d-1a3b-4d15-ab8f-c3cd47b4093b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:01.115695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf020a2d-1a3b-4d15-ab8f-c3cd47b4093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.212743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:01.277271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.278204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.278567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.278939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.279737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.282746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.300377 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2907/5800] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:01.305150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.305489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.307111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.329503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2894/5801] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:00 2022] POST /identity/v3/users => generated 293 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:01.339036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:01.341138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.343293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.347815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.351403 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2908/5802] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:01.355925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.368646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae7344-1d57-4439-8397-0ca64d3bb463 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.374004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.374751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.374965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.375636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.376505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:01.376868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.378504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.397731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2909/5803] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:01.398868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.405218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fa4b-bd6b-43df-b04f-6f3879d9df43 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.414449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca674b-0543-4857-b898-bdf9243d73be admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.424725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.424725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.424725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.424725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.425918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.427077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b6c8c-9fdf-4a10-b6d7-19b7b8822b22 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.439949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.440846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.441229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.441899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.442503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.446326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb27437-cbd3-4cfa-8876-5520c10811cc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.455392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2895/5804] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:01.457064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305ec4-062a-4efc-8736-c8694046e178 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.457358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305ec4-062a-4efc-8736-c8694046e178 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.457712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be305ec4-062a-4efc-8736-c8694046e178 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.459990 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2896/5805] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:14:01.461175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be305ec4-062a-4efc-8736-c8694046e178 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.476074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be305ec4-062a-4efc-8736-c8694046e178 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.483366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.484285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.484639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.484878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] PATH_INFO: `/v3/projects/dfed3befb4f74983b3df2afc3319a42a/users/74ddad24bea245e4b527423403593ca9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.501305 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2910/5806] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:01.503405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.503793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.504851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.507814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfed3befb4f74983b3df2afc3319a42a, user_id=74ddad24bea245e4b527423403593ca9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.511286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.533536 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2897/5807] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:01 2022] PUT /identity/v3/projects/dfed3befb4f74983b3df2afc3319a42a/users/74ddad24bea245e4b527423403593ca9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:01.534936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.554118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:01.555411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.632120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec916c0-555c-42ee-bd93-7802928c2575 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.637334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.638099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.638474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.638912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.639651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.641865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.664273 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2911/5808] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:01.666242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.670738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2898/5809] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:01.679437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.679611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9678-8bc9-491e-a903-685c9ba08635 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.686582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.687725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.688018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.688313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.689755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.691977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.694960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:01.699699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113638-fb5d-4076-ba96-5168e393cf1c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.706364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.707608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.708217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.708612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.709463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.711574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.712669 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2912/5810] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:01.714688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.718614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.727950 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2899/5811] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:01.728973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.740764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefdf46-6be5-4369-93e3-c9acb681ce12 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.744831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65ec6-65cd-4d0e-b5c3-272126bd7b41 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.746109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.747684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.748490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.749067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] PATH_INFO: `/v3/projects/dfed3befb4f74983b3df2afc3319a42a/users/74ddad24bea245e4b527423403593ca9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.751854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.752349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfed3befb4f74983b3df2afc3319a42a, user_id=74ddad24bea245e4b527423403593ca9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.752852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.753211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.753703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.757084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.770807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.770807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f25419-713e-48cf-9901-f92a015dc864 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.772966 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2900/5812] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:01 2022] PUT /identity/v3/projects/dfed3befb4f74983b3df2afc3319a42a/users/74ddad24bea245e4b527423403593ca9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:01.773918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.786793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2913/5813] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:01.789248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.791082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.791082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.847329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] MFA Rules not processed for user `74ddad24bea245e4b527423403593ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:01.848959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.912672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:01.931024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d6252-554c-4d74-81a2-fefa1613c8cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.938266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.939078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.940449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.942534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:01.943890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:01.945860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:01.964467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2901/5814] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:01.968456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.974594 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2914/5815] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:01.987088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:01.988695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:01.990571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475ae4-44b6-4fb1-86ff-641fec0b6e7f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:01.996226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:01.997474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:01.997999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:01.998547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] PATH_INFO: `/v3/projects/f14f834f94d74057abd079c04562b60e/users/441d9cda34564fca81f9aa538b70f00d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:02.022719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14f834f94d74057abd079c04562b60e, user_id=441d9cda34564fca81f9aa538b70f00d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:02.027684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a0a25-a2c8-4d03-a79f-ebcc6d5336d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:02.056413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2902/5816] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:01 2022] PUT /identity/v3/projects/f14f834f94d74057abd079c04562b60e/users/441d9cda34564fca81f9aa538b70f00d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:02.061669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:02.062317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:02.062889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:02.115147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:02.116416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:02.124836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fafbda-bfb5-40bb-b6a4-f5a8cc4b1b83 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:02.204817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:02.205806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:02.206181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:02.206552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:02.257864 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2903/5817] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:02.274814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:02.276361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:02.321489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:02.384774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:02.390605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:02.413952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b14db-5033-4459-bf4b-49ca96624760 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:02.421392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:02.422077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:02.422380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:02.423322 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2915/5818] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:02.434330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:02.462482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:02.473007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d886d-5f1b-4ba0-a2fa-32d982ebccc5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:02.512143 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2904/5819] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:03.176644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:03.195683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104a93-5a21-45e3-8908-5699388d2aee service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:03.211577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:03.212689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:03.212929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:03.213239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] PATH_INFO: `/v3/users/f2ed48272da4483389d53ca7198924e3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:03.214893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ed48272da4483389d53ca7198924e3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:03.217430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:03.352734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ed48272da4483389d53ca7198924e3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:03.354472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ed48272da4483389d53ca7198924e3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:03.380403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ed48272da4483389d53ca7198924e3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:03.399238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ed48272da4483389d53ca7198924e3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:03.408731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ed48272da4483389d53ca7198924e3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:03.417750 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2916/5820] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:03 2022] DELETE /identity/v3/users/f2ed48272da4483389d53ca7198924e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:03.422517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:03.424021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:03.424577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:03.445174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:03.446720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:03.530656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2905/5821] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:03.547673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:03.549630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:03.621103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60738c-308e-4cc0-9d2f-1457027b18ab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:03.626314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:03.627059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:03.627293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:03.627570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:03.659983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:03.661694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:03.674750 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2917/5822] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:03.777824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:03.780623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:03.808790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:03.945281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9c29-badc-4a63-bade-6bdc0ddafd5f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:03.955570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:03.957064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:03.958743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:03.959265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:03.963946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:04.055981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:04.057999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:04.075176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2906/5823] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:05.081345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:05.082968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:05.102033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a81ec-842e-4d9e-8af5-eb13ccb4733e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:05.108332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:05.124842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:05.126151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:05.126968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] PATH_INFO: `/v3/projects/1bacb76f83fb45c69709ef8b94703c35` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:05.143697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bacb76f83fb45c69709ef8b94703c35)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:05.151612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:05.234723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:05.237389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:05.255974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f43f-32b1-4495-b8be-9d7b133c08a2 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:05.261413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:05.268742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bacb76f83fb45c69709ef8b94703c35', 'request_id': 'req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.280524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bacb76f83fb45c69709ef8b94703c35', 'request_id': 'req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.288904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bacb76f83fb45c69709ef8b94703c35', 'request_id': 'req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.305763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] The token cache is being invalidate because project 1bacb76f83fb45c69709ef8b94703c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:05.306152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.308093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.314672 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2918/5824] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:05 2022] DELETE /identity/v3/projects/1bacb76f83fb45c69709ef8b94703c35 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:05.315565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:05.316983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:05.326380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:05.327597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:05.327942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:05.328491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] PATH_INFO: `/v3/users/c79c434dbfcd4eae8a1d6090974e0dbb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:05.329794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79c434dbfcd4eae8a1d6090974e0dbb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:05.331976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:05.380082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:05.387134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79c434dbfcd4eae8a1d6090974e0dbb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.394626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee6fbf-dcdb-45e3-af61-2455e12d3f2f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:05.399573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79c434dbfcd4eae8a1d6090974e0dbb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.401035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:05.401828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:05.402135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:05.402500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] PATH_INFO: `/v3/users/74ddad24bea245e4b527423403593ca9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:05.403920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ddad24bea245e4b527423403593ca9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:05.406618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:05.418279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79c434dbfcd4eae8a1d6090974e0dbb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.419049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79c434dbfcd4eae8a1d6090974e0dbb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.419655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79c434dbfcd4eae8a1d6090974e0dbb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.438495 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2907/5825] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:05 2022] DELETE /identity/v3/users/c79c434dbfcd4eae8a1d6090974e0dbb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:05.465896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ddad24bea245e4b527423403593ca9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.466917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ddad24bea245e4b527423403593ca9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.475781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ddad24bea245e4b527423403593ca9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.518131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ddad24bea245e4b527423403593ca9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.538197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ddad24bea245e4b527423403593ca9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.562426 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2919/5826] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:05 2022] DELETE /identity/v3/users/74ddad24bea245e4b527423403593ca9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:05.651390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:05.653017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:05.766862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1dac8-8e7b-4d47-b07e-1bf84adf925e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:05.870329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:05.871431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:05.871743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:05.872088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] PATH_INFO: `/v3/projects/95a5eb9d131249a1877c27389479afd2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:05.873637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a5eb9d131249a1877c27389479afd2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:05.875698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:05.942614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a5eb9d131249a1877c27389479afd2', 'request_id': 'req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.957924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a5eb9d131249a1877c27389479afd2', 'request_id': 'req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.977311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a5eb9d131249a1877c27389479afd2', 'request_id': 'req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:05.981367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:05.997958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] The token cache is being invalidate because project 95a5eb9d131249a1877c27389479afd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:05.998566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.000259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.004523 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2908/5827] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:05 2022] DELETE /identity/v3/projects/95a5eb9d131249a1877c27389479afd2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:06.006687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:06.008534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:06.023880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368708ce-d465-4786-87b7-3f48e217b7f1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:06.075013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:06.089065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:06.090367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:06.090809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:06.091152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] PATH_INFO: `/v3/users/6e277a300e4e4947b2e08d668daa9ed3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:06.093278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e277a300e4e4947b2e08d668daa9ed3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:06.095807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:06.155623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e277a300e4e4947b2e08d668daa9ed3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.156307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e277a300e4e4947b2e08d668daa9ed3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.168549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e277a300e4e4947b2e08d668daa9ed3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.183713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e277a300e4e4947b2e08d668daa9ed3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.191293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e277a300e4e4947b2e08d668daa9ed3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.200478 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2920/5828] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:06 2022] DELETE /identity/v3/users/6e277a300e4e4947b2e08d668daa9ed3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:06.562220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:06.569468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:06.596826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01f31-dcd3-4dbe-bd0d-30d513f022ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:06.712915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:06.713357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:06.713653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:06.713978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] PATH_INFO: `/v3/projects/113e8385615d430ca60af9afcc5a3e5b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:06.715922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113e8385615d430ca60af9afcc5a3e5b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:06.718277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:06.816230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113e8385615d430ca60af9afcc5a3e5b', 'request_id': 'req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.838432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113e8385615d430ca60af9afcc5a3e5b', 'request_id': 'req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.846476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113e8385615d430ca60af9afcc5a3e5b', 'request_id': 'req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.862119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] The token cache is being invalidate because project 113e8385615d430ca60af9afcc5a3e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:06.862407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.863102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bd7ea2a-a4e4-437b-9b69-c32a7bbf8ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:06.865821 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2909/5829] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:06 2022] DELETE /identity/v3/projects/113e8385615d430ca60af9afcc5a3e5b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:07.155902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.158407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:07.185734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eae80-ba19-4257-b66c-aaa04ff7bbdb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.291649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.292828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.293310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.293649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] PATH_INFO: `/v3/projects/dfed3befb4f74983b3df2afc3319a42a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.295484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfed3befb4f74983b3df2afc3319a42a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.297880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.400250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfed3befb4f74983b3df2afc3319a42a', 'request_id': 'req-0136cd09-eb25-40ea-bec2-70da711aa167'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:07.420078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfed3befb4f74983b3df2afc3319a42a', 'request_id': 'req-0136cd09-eb25-40ea-bec2-70da711aa167'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:07.436921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfed3befb4f74983b3df2afc3319a42a', 'request_id': 'req-0136cd09-eb25-40ea-bec2-70da711aa167'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:07.449797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:07.455812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] The token cache is being invalidate because project dfed3befb4f74983b3df2afc3319a42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:07.456687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:07.457640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0136cd09-eb25-40ea-bec2-70da711aa167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:07.459744 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2921/5830] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:07 2022] DELETE /identity/v3/projects/dfed3befb4f74983b3df2afc3319a42a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:07.467424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.467424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.467424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.488148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:07.489591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:07.563627 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2910/5831] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:07.571197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.571964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.572130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.593572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:07.594913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:07.609113 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2922/5832] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:07.610503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.635513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bcd1d-4272-46c1-b79d-41675e2bb15b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.647196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.647905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.648266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.648482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.649839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:07.650151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.651807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.678586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.689042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2911/5833] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:07.693721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e6b6a-970e-46bc-9c87-f1ac5c6ef9a0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.703516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.704218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.704546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.704828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.705546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.707520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.744644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2923/5834] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:07 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:07.748467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.763353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60a3f7-8083-40f7-ac39-bd9a511a5d72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.782937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:07.876111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.877081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.877351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.877630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.878429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.881504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.909979 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2912/5835] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:07 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:07.913277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.930458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256a0b-aa5b-43fe-8a5d-f4f3f019695b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.936956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.937751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.938148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.938644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.939505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.941858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.955758 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2924/5836] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:07.959568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:07.970899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e7f7-1801-4e53-8872-805e8721c413 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:07.976386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:07.977144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:07.977560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:07.977848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:07.978914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:07.980900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc458eb-9959-40c4-9e0e-cb96e8e47670 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:07.993625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2913/5837] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:07.997680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.010290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cca5d-2f98-4aae-844c-317290296575 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:08.020259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:08.021652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.021652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.021885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] PATH_INFO: `/v3/projects/bcf4c493874c47da8240c67057f52d03/users/939f00d70b2c4624b8b0330469133b2e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.040338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf4c493874c47da8240c67057f52d03, user_id=939f00d70b2c4624b8b0330469133b2e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:08.045210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:08.071421 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2925/5838] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:07 2022] PUT /identity/v3/projects/bcf4c493874c47da8240c67057f52d03/users/939f00d70b2c4624b8b0330469133b2e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:08.081981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.082309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.082555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.118409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] MFA Rules not processed for user `939f00d70b2c4624b8b0330469133b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:08.119654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:08.215013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2914/5839] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:08.219619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.291495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4029-6dc6-4576-8cbf-9b0ac5c92bb7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:08.299027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:08.299791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.300075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.301017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.301854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:08.304982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:08.378674 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2926/5840] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:08 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:08.382790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.402638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91726c0-f401-424d-b85b-af4bad8e8c8c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:08.533912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:08.534814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.535113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.535982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.536916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:08.539099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:08.593585 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2915/5841] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:08 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:08.596938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.616733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d215-f5cf-4dfb-b252-75efdc0f667c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:08.624833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:08.625436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.625719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.626041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.626781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:08.628701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:08.674046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2927/5842] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:08.674270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.694692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff2a3-bf9f-4c1b-adea-13d2338e6a2a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:08.706658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:08.708010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:08.708311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:08.712899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] PATH_INFO: `/v3/projects/fa8f240f3a7945dc930cb044fce4611f/users/3ec1c19001d54b8fb6bc22feac773e56/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:08.741781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:08.773899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8f240f3a7945dc930cb044fce4611f, user_id=3ec1c19001d54b8fb6bc22feac773e56, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:08.785002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:08.855853 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2916/5843] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:08 2022] PUT /identity/v3/projects/fa8f240f3a7945dc930cb044fce4611f/users/3ec1c19001d54b8fb6bc22feac773e56/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:08.856319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:08.868345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfb95-cd4f-445c-9ddd-2ff7c4704bc5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:09.066814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:09.067674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:09.068463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:09.068463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:09.069241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:09.071188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db84b8-1fa9-41ce-b26e-e13813420c5b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:09.108297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2928/5844] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:09.108784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:09.129029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70e72a-2635-4c86-9a85-1b727fdb4419 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:09.158780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:09.162612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:09.162911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:09.163194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] PATH_INFO: `/v3/projects/fa8f240f3a7945dc930cb044fce4611f/users/3ec1c19001d54b8fb6bc22feac773e56/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:09.169078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8f240f3a7945dc930cb044fce4611f, user_id=3ec1c19001d54b8fb6bc22feac773e56, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:09.176073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:09.198549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2917/5845] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:09 2022] PUT /identity/v3/projects/fa8f240f3a7945dc930cb044fce4611f/users/3ec1c19001d54b8fb6bc22feac773e56/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:09.218964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:09.219438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:09.219694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:09.238992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:09.292304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] MFA Rules not processed for user `3ec1c19001d54b8fb6bc22feac773e56`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:09.294177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:09.471428 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2929/5846] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:09.483546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:09.485975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:09.618865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a372-69dc-40ab-a53f-5f326b3d2755 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:09.623468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:09.624304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:09.624793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:09.625452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:09.638768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:09.641044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:09.655368 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2918/5847] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:09.770786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:09.783571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296cad5-3447-4e63-8d4f-ca0b1cb8adf9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:09.790356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:09.791046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:09.791338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:09.791622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:09.886437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:09.888570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe964811-3b23-4776-ac3e-7d0f0e6bb903 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:09.917319 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2930/5848] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:13.263439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:13.464538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741756d7-71df-4d1e-9a95-6eb02d171c30 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:13.481301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:13.485046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:13.485526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:13.485989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] PATH_INFO: `/v3/users/939f00d70b2c4624b8b0330469133b2e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:13.491657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=939f00d70b2c4624b8b0330469133b2e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:13.496196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:13.633528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939f00d70b2c4624b8b0330469133b2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:13.658716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939f00d70b2c4624b8b0330469133b2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:13.689570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939f00d70b2c4624b8b0330469133b2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:13.704459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939f00d70b2c4624b8b0330469133b2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:13.705309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939f00d70b2c4624b8b0330469133b2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:13.713846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:13.746672 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2919/5849] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:13 2022] DELETE /identity/v3/users/939f00d70b2c4624b8b0330469133b2e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:13.754611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:13.755183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:13.755183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:13.785893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:13.787595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:13.913873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2931/5850] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:13.939341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:13.941551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:14.057929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f0d3-47b6-416e-8028-a42312e1ce38 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:14.063439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:14.064150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:14.064467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:14.064764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:14.080124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:14.081690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:14.098419 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2920/5851] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:15.365907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:15.368012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:15.392291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82570e2-55dd-4aaf-b8a0-bbee37a4d10b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:15.397087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:15.398165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:15.398458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:15.398729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] PATH_INFO: `/v3/users/e18c0e3b16574a9d923a1159f08bbbd4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:15.399943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18c0e3b16574a9d923a1159f08bbbd4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:15.402196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:15.441164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:15.471953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18c0e3b16574a9d923a1159f08bbbd4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.472782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18c0e3b16574a9d923a1159f08bbbd4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.486213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18c0e3b16574a9d923a1159f08bbbd4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.504551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18c0e3b16574a9d923a1159f08bbbd4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.514433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18c0e3b16574a9d923a1159f08bbbd4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.522076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2932/5852] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:15 2022] DELETE /identity/v3/users/e18c0e3b16574a9d923a1159f08bbbd4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:15.680622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:15.685681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:15.717554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896ba6-20c3-4974-99f5-4f7fe42a9e14 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:15.888369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:15.889306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:15.889580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:15.890240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] PATH_INFO: `/v3/projects/bcf4c493874c47da8240c67057f52d03` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:15.895839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf4c493874c47da8240c67057f52d03)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:15.901680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:15.907032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:15.908747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:15.936343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0550a-0d5a-46ca-bdb0-ac5720a76343 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:15.954024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:15.955230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:15.955512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:15.955787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] PATH_INFO: `/v3/projects/4e4c7c00da2a44ada00ef3be3ffafb30` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:15.957556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4c7c00da2a44ada00ef3be3ffafb30)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:15.959835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:15.988180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf4c493874c47da8240c67057f52d03', 'request_id': 'req-3b1bd573-5bea-4983-9254-96a68eb21150'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:15.997480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf4c493874c47da8240c67057f52d03', 'request_id': 'req-3b1bd573-5bea-4983-9254-96a68eb21150'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.004655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf4c493874c47da8240c67057f52d03', 'request_id': 'req-3b1bd573-5bea-4983-9254-96a68eb21150'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.022681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] The token cache is being invalidate because project bcf4c493874c47da8240c67057f52d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:16.022980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.023905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.026478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2921/5853] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:15 2022] DELETE /identity/v3/projects/bcf4c493874c47da8240c67057f52d03 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:16.030344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.031793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4c7c00da2a44ada00ef3be3ffafb30', 'request_id': 'req-ec8ae292-44fe-4ace-8444-d964aebe9ee3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.032585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:16.042978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4c7c00da2a44ada00ef3be3ffafb30', 'request_id': 'req-ec8ae292-44fe-4ace-8444-d964aebe9ee3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.049877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4c7c00da2a44ada00ef3be3ffafb30', 'request_id': 'req-ec8ae292-44fe-4ace-8444-d964aebe9ee3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.064214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] The token cache is being invalidate because project 4e4c7c00da2a44ada00ef3be3ffafb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:16.065083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.065581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ec8ae292-44fe-4ace-8444-d964aebe9ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.071601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2933/5854] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:15 2022] DELETE /identity/v3/projects/4e4c7c00da2a44ada00ef3be3ffafb30 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:16.073707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca715-b250-4ad7-a0cf-028e286b0a3a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.074067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca715-b250-4ad7-a0cf-028e286b0a3a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.074416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca715-b250-4ad7-a0cf-028e286b0a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.092225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:16.100898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eb7ca715-b250-4ad7-a0cf-028e286b0a3a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:16.102693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb7ca715-b250-4ad7-a0cf-028e286b0a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:16.152539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd573-5bea-4983-9254-96a68eb21150 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.202305 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2934/5855] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:16.209170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.209467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.210232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.229462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.229836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.230218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.230498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] PATH_INFO: `/v3/users/3ec1c19001d54b8fb6bc22feac773e56` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.231881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec1c19001d54b8fb6bc22feac773e56)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.235034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.238059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:16.240173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:16.256703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2935/5856] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:16.260505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.276336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf296-3391-40ac-a6a8-9fc604beea24 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.283927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.284833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.284953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.285440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.286156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:16.286468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.288505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.312964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2936/5857] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:16.314422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec1c19001d54b8fb6bc22feac773e56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.316783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.326893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec1c19001d54b8fb6bc22feac773e56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.331503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604f81-ecfc-4262-a631-c2f584176d07 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.339613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.340804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.341362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.341839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.343602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.346796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.349834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:16.351890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec1c19001d54b8fb6bc22feac773e56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.353597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec1c19001d54b8fb6bc22feac773e56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.354518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec1c19001d54b8fb6bc22feac773e56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:16.372878 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2922/5858] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:16 2022] DELETE /identity/v3/users/3ec1c19001d54b8fb6bc22feac773e56 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:16.395514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2937/5859] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:16 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:16.400214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.402213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:16.501931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:16.511580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579aff-828e-48eb-8de4-f6b9666f2361 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.593344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.596188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.596400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.596733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.597469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.617973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.661971 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2923/5860] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:16 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:14:16.668914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.684102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe827c1-3eea-4830-b466-64daab462257 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.696564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.697274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.697562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.697842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.698575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.700282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.738092 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2938/5861] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:16.742238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.764115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e849d-975f-4cef-ab89-c66d7518b700 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.771185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.772280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.772763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.773211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.774103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.779119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe500d9-1e9b-4b6b-91bd-696bc1211fcc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.804939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2924/5862] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:16.812239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:16.848076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688492-521d-47fb-9d72-c303621c4966 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:16.856035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:16.858187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.858588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.859024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] PATH_INFO: `/v3/projects/19bc4d4b7a084a9994b64ccde8c9e254/users/3af9776accbe457cab8de3da006d1be4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.896358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bc4d4b7a084a9994b64ccde8c9e254, user_id=3af9776accbe457cab8de3da006d1be4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:16.899100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7d1ea-445b-47bc-be0f-1affd10e019f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:16.925534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2939/5863] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:16 2022] PUT /identity/v3/projects/19bc4d4b7a084a9994b64ccde8c9e254/users/3af9776accbe457cab8de3da006d1be4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:16.936413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:16.936752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:16.937028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:16.994444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] MFA Rules not processed for user `3af9776accbe457cab8de3da006d1be4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:16.996551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.141927 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2925/5864] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:17.152746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.153038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.153304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.187142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] MFA Rules not processed for user `3af9776accbe457cab8de3da006d1be4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.189008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.237585 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2940/5865] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:17.247302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:17.255509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.261923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:17.263539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.389380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b34b-d626-4d61-9234-b3ffee5ce4ee None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:17.402043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:17.406081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.407214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.408057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] PATH_INFO: `/v3/projects/fa8f240f3a7945dc930cb044fce4611f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.409904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8f240f3a7945dc930cb044fce4611f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:17.414294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:17.446202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265def-7ec6-4398-be08-0a3d2d50d91c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:17.463958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:17.463958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.464941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.465225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.472795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:17.485591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:17.489467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb73d4-60fa-4d53-8afe-3589942ec85f service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:17.502986 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2926/5866] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:17.503749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8f240f3a7945dc930cb044fce4611f', 'request_id': 'req-ea5e1bf7-375c-4812-9416-066c2fe5801f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:17.504549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9179d-17fe-4631-9291-6c0647df08bd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.504945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9179d-17fe-4631-9291-6c0647df08bd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.505402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9179d-17fe-4631-9291-6c0647df08bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.516650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8f240f3a7945dc930cb044fce4611f', 'request_id': 'req-ea5e1bf7-375c-4812-9416-066c2fe5801f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:17.530934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8f240f3a7945dc930cb044fce4611f', 'request_id': 'req-ea5e1bf7-375c-4812-9416-066c2fe5801f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:17.553327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] The token cache is being invalidate because project fa8f240f3a7945dc930cb044fce4611f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:17.553604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:17.555089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea5e1bf7-375c-4812-9416-066c2fe5801f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:17.557210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2941/5867] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:17 2022] DELETE /identity/v3/projects/fa8f240f3a7945dc930cb044fce4611f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:17.562721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498bf-bebe-459f-837b-e637fb0396fb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.563208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498bf-bebe-459f-837b-e637fb0396fb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.563690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498bf-bebe-459f-837b-e637fb0396fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.580658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fcf9179d-17fe-4631-9291-6c0647df08bd None None] MFA Rules not processed for user `441d9cda34564fca81f9aa538b70f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.583470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-05c498bf-bebe-459f-837b-e637fb0396fb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.584716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05c498bf-bebe-459f-837b-e637fb0396fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.585549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcf9179d-17fe-4631-9291-6c0647df08bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.616908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:17.664695 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2942/5868] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:17.671529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.671844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.672252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.697196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.698441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.710759 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2943/5869] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:17.715511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:17.733165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e968-1849-491e-b5c9-1a6bf3494e2c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:17.736033 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2927/5870] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:17.741056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:17.741824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.742107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.742442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.743299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:17.743681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:17.747551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.748249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.748249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.754646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:17.799926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] MFA Rules not processed for user `441d9cda34564fca81f9aa538b70f00d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.802009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.814807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2944/5871] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:17.820502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:17.835717 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2928/5872] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:17.838221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4d18-eebe-4b12-85a1-df546fd0041b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:17.845217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:17.847016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:17.848508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.851342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.854601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.854954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.855719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:17.865037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bdaa4-e603-445b-8ed3-71a49967f2ef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:17.929975 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2945/5873] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:17.934566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:17.934873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:17.935156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:17.981758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] MFA Rules not processed for user `3af9776accbe457cab8de3da006d1be4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:17.982999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:17.987046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42abc-dd10-43d4-a109-6434a76f3617 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.048352 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2946/5874] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:18.048352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.139974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.143059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.143629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.145784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.175657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:18.228293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b12523-4a3b-4316-be2c-8be530181da7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.243076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.243856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.244243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.244612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.246299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.249468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.254052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.256986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.276633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2929/5875] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:18.303338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2947/5876] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:18 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:18.307339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.324687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355d4b-da7c-47bc-a075-6879eef3fb40 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.338918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.340508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.341288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.342029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.344260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.348895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.365176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2930/5877] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:18.369337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.381897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5974d9-00ac-4cfb-8327-900946d64977 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.387473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.388168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.388488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.388770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.389492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.391167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cb2b9-a178-4f79-af3f-0e1a46853369 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.402816 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2948/5878] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:18.406921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.424473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1b3f-f5dd-4b82-8a0b-3e06d37fdd09 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.435972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.436925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.437209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.437486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] PATH_INFO: `/v3/projects/007de0b19ecf447f8440abad5c45a612/users/b5f0406af02c4aa4b3ea12a6bc95d38b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.475074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=007de0b19ecf447f8440abad5c45a612, user_id=b5f0406af02c4aa4b3ea12a6bc95d38b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.480874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.520943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2931/5879] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:18 2022] PUT /identity/v3/projects/007de0b19ecf447f8440abad5c45a612/users/b5f0406af02c4aa4b3ea12a6bc95d38b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:18.533488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.534066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.534617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.575307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] MFA Rules not processed for user `b5f0406af02c4aa4b3ea12a6bc95d38b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:18.576644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:18.582367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:18.696534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2949/5880] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:18.697765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.838251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673468-7925-4dfc-903d-5639b6acd4ad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:18.852347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:18.853663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:18.854174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:18.854550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:18.863527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:18.867854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:18.930682 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2932/5881] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:18 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:18.934946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:18.974174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e1bb3-5a70-4ab3-8811-5d1008c3b929 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.003191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.006553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:19.138193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.139054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.144776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.146539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.150603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.157512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.191272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e801-4912-4f74-831a-391a96d18d03 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.198853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.199852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.200520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.200956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.208043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:19.213472 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2950/5882] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:18 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:19.219754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.239931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.241956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.249464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3fe68-844a-459c-acda-be9dd8beb5d5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.260848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.261973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.264350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.264680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.266580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.268266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.269094 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2933/5883] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:19.320211 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2951/5884] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:19.324999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.346388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05858-c666-480d-b30e-33dfb3643130 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.351700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.352804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.353183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.353610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] PATH_INFO: `/v3/projects/899da878dc49414f80ab0e82eb4c151e/users/fbd46b7e65b7458db761bf3f1eb77a98/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.356843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:19.377564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=899da878dc49414f80ab0e82eb4c151e, user_id=fbd46b7e65b7458db761bf3f1eb77a98, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.380788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.415081 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2934/5885] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:19 2022] PUT /identity/v3/projects/899da878dc49414f80ab0e82eb4c151e/users/fbd46b7e65b7458db761bf3f1eb77a98/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:19.418506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.432155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3cecb-dbf4-4839-a35d-4b42584ae5d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.593086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.593783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.594065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.594339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.595424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.599117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f353f-307a-4e72-8aa5-d2aabf2da2d1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.626078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.641146 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2952/5886] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:19.641857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088be29-b9cb-4f12-a28c-4fd031f84e2e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:19.656174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:19.657236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.657579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.657925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] PATH_INFO: `/v3/projects/899da878dc49414f80ab0e82eb4c151e/users/fbd46b7e65b7458db761bf3f1eb77a98/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.666367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899da878dc49414f80ab0e82eb4c151e, user_id=fbd46b7e65b7458db761bf3f1eb77a98, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:19.669409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:19.705218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:19.705561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:19.706061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:19.708046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2935/5887] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:19 2022] PUT /identity/v3/projects/899da878dc49414f80ab0e82eb4c151e/users/fbd46b7e65b7458db761bf3f1eb77a98/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:19.770187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] MFA Rules not processed for user `fbd46b7e65b7458db761bf3f1eb77a98`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:19.771436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:19.783268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:19.940576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2953/5888] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:19.952874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:19.956185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:20.072731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb64de-b6af-4b51-9d63-ef6b0d4ac2f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:20.077304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:20.078962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:20.079360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:20.079709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:20.097848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:20.100669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:20.114061 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2936/5889] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:20.798714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:20.813501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789184-c287-49a5-afe8-f70ab7ccbbb3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:20.825860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd46b7e65b7458db761bf3f1eb77a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '899da878dc49414f80ab0e82eb4c151e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:20.826709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:20.828069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:20.828371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:20.830155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:20.830411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:20.837013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:20.879062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2954/5890] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:20.883617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:20.909293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992490c0-0ce6-4f85-83a8-bdefe2f2c844 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:20.929717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd46b7e65b7458db761bf3f1eb77a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '899da878dc49414f80ab0e82eb4c151e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:20.930593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:20.930888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:20.931169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:20.931863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:20.934453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:21.028158 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2937/5891] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:20 2022] POST /identity/v3/projects => generated 354 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:21.035672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:21.050947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26670-76d9-4515-ad62-f93791e9f61a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:21.218419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd46b7e65b7458db761bf3f1eb77a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '899da878dc49414f80ab0e82eb4c151e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:21.220597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:21.220992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:21.221373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:21.222219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:21.223386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:21.231305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:21.271961 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2955/5892] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:21.326758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:21.342515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab3725-a3fa-4fc4-8019-9acf6339328c tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:21.349849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd46b7e65b7458db761bf3f1eb77a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '899da878dc49414f80ab0e82eb4c151e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:21.352352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:21.352803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:21.353697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] PATH_INFO: `/v3/projects/ba29e84f845b42ceb0fd0f01a988acf0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:21.355964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba29e84f845b42ceb0fd0f01a988acf0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:21.361216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:21.462540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba29e84f845b42ceb0fd0f01a988acf0', 'request_id': 'req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:21.486314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba29e84f845b42ceb0fd0f01a988acf0', 'request_id': 'req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:21.525205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba29e84f845b42ceb0fd0f01a988acf0', 'request_id': 'req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:21.555006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] The token cache is being invalidate because project ba29e84f845b42ceb0fd0f01a988acf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:21.555908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:21.556925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b0a5dd41-af51-4fb9-bfae-1aa8e7db8499 tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:21.559740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2938/5893] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:21 2022] DELETE /identity/v3/projects/ba29e84f845b42ceb0fd0f01a988acf0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:21.996403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:21.998998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:22.171489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a1b7-7e2c-487a-a8ee-a465bc031a1a tempest-VolumeQuotaClassesTest-1608540842 tempest-VolumeQuotaClassesTest-1608540842-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:22.232585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:22.296330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:22.297353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:22.297640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:22.297979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] PATH_INFO: `/v3/users/b5f0406af02c4aa4b3ea12a6bc95d38b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:22.309084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f0406af02c4aa4b3ea12a6bc95d38b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:22.316921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:22.452066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f0406af02c4aa4b3ea12a6bc95d38b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:22.452825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f0406af02c4aa4b3ea12a6bc95d38b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:22.468105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f0406af02c4aa4b3ea12a6bc95d38b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:22.494805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f0406af02c4aa4b3ea12a6bc95d38b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:22.504140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f0406af02c4aa4b3ea12a6bc95d38b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:22.513297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2956/5894] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:21 2022] DELETE /identity/v3/users/b5f0406af02c4aa4b3ea12a6bc95d38b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:22.517994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:22.518498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:22.518583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:22.552523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:22.559975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:22.635691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:22.719937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2939/5895] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:22.733735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:22.735782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:22.902880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114358-9988-461e-82af-5d83c68859ce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:22.912187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:22.913583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:22.914083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:22.915265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:22.928928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:22.931685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:22.947127 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2957/5896] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:23.612993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:23.614874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:23.632542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce0a5b-cb3d-4ee6-a37f-02686edbf891 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:23.646178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:23.647232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:23.647614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:23.648335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] PATH_INFO: `/v3/projects/007de0b19ecf447f8440abad5c45a612` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:23.649922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=007de0b19ecf447f8440abad5c45a612)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:23.652063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:23.758271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007de0b19ecf447f8440abad5c45a612', 'request_id': 'req-135c3432-be77-480a-861f-e2d4d4ef7e3f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:23.778666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007de0b19ecf447f8440abad5c45a612', 'request_id': 'req-135c3432-be77-480a-861f-e2d4d4ef7e3f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:23.786372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007de0b19ecf447f8440abad5c45a612', 'request_id': 'req-135c3432-be77-480a-861f-e2d4d4ef7e3f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:23.804776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] The token cache is being invalidate because project 007de0b19ecf447f8440abad5c45a612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:23.805405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:23.806296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:23.808454 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2940/5897] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:23 2022] DELETE /identity/v3/projects/007de0b19ecf447f8440abad5c45a612 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:23.813087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:23.827477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c4cc-90f8-4ccb-8472-04d8a4ce3951 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:23.951393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:23.966465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:23.967523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:23.967750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:23.968623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] PATH_INFO: `/v3/users/fbd46b7e65b7458db761bf3f1eb77a98` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:23.974419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd46b7e65b7458db761bf3f1eb77a98)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:23.976411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:24.110240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd46b7e65b7458db761bf3f1eb77a98'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:24.113154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd46b7e65b7458db761bf3f1eb77a98'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:24.139326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd46b7e65b7458db761bf3f1eb77a98'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:24.186056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd46b7e65b7458db761bf3f1eb77a98'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:24.216631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01e8fef5-aa99-4340-8cb2-8691ab59a395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd46b7e65b7458db761bf3f1eb77a98'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:24.241436 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2958/5898] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:23 2022] DELETE /identity/v3/users/fbd46b7e65b7458db761bf3f1eb77a98 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:25.613934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:25.617121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:25.668781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3432-be77-480a-861f-e2d4d4ef7e3f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:25.842125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:25.843029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:25.843491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:25.843923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] PATH_INFO: `/v3/projects/899da878dc49414f80ab0e82eb4c151e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:25.846697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=899da878dc49414f80ab0e82eb4c151e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:25.851924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:25.952769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899da878dc49414f80ab0e82eb4c151e', 'request_id': 'req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:25.967323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899da878dc49414f80ab0e82eb4c151e', 'request_id': 'req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:25.971632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:25.981509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899da878dc49414f80ab0e82eb4c151e', 'request_id': 'req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:26.014558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] The token cache is being invalidate because project 899da878dc49414f80ab0e82eb4c151e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:26.014934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:26.015869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9fc2b4be-8f08-4535-ac3f-6e9bcac43a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:26.023012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2941/5899] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:25 2022] DELETE /identity/v3/projects/899da878dc49414f80ab0e82eb4c151e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:26.028185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.029203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.029645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.068600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:26.071331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:26.226061 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2959/5900] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:26.233767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.234057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.234344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.260395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:26.264023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:26.285985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.286548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2942/5901] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:26.300601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0ba7f-bbda-440a-b4f9-984e170eeb2e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.306417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.306981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.307372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.308214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.308644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:26.309015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.311436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.326988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2960/5902] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:14:26.331622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.343979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86190c-34f0-45b0-90d6-358afba81211 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.349082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.349759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.350091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.350324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.351041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.353898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.397818 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2943/5903] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:26 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:26.398193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.412902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b805f22-ad74-43f2-b9fa-a652a062b7f0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.618304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.619106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.619468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.619867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.620937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.625770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.643603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:26.668658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2961/5904] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:26 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:26.671724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.684706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215de8f8-6d23-46c3-aa3f-b551a197c9c5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.695307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.696859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.697537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.698135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.700146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.702179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.722634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2944/5905] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:26.723633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.743163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be564-13fe-49da-8fb0-eb173b0a3efc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.748868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.749610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.749930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.750212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.750990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.753107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bfe5e-ca8d-4e66-8935-4a47def1d183 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.806631 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2962/5906] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:26.807824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:26.824621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e078ba-5b00-4bf5-8c8f-2f4c02787e16 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:26.832002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:26.833070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.833482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.833657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] PATH_INFO: `/v3/projects/93b3cf3baa544bbbafdcee2979f7cb7d/users/eed95da6fa434a68914804dc1508af53/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.856489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b3cf3baa544bbbafdcee2979f7cb7d, user_id=eed95da6fa434a68914804dc1508af53, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:26.860013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:26.904067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:26.904227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2945/5907] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:26 2022] PUT /identity/v3/projects/93b3cf3baa544bbbafdcee2979f7cb7d/users/eed95da6fa434a68914804dc1508af53/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:26.904835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:26.905279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:26.960297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] MFA Rules not processed for user `eed95da6fa434a68914804dc1508af53`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:26.961668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.121235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2963/5908] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:27.126965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.300358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502134-d840-42fe-8292-37edfe2addf0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.308305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.309279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.309567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.310831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.311717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.314180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.380897 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2946/5909] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:27 2022] POST /identity/v3/projects => generated 389 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:27.384790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.397874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf966-8cef-4938-bffe-93f5ba07f230 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.499812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.500865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.501011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.501785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.501986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.504170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.550230 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2964/5910] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:27 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:27.551535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.574447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbf89-cef1-4334-ac45-eb50babdc487 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.581019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.581719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.582094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.582392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.583983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.586452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.602310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2947/5911] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:27.603824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.616716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcfa4-6dc6-43f9-862d-3a77e1a39a40 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.619993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.622310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.623316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.623847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.624307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.624627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] PATH_INFO: `/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7/users/0b3d7d8970f840188db5eaee49162cbe/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.641232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2078d2fbc34f8eb3636ee4360f22b7, user_id=0b3d7d8970f840188db5eaee49162cbe, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.642667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149930eb-19e9-44bf-86f0-e8030ee3ba0c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.644597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.647836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.648909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.649422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.649903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] PATH_INFO: `/v3/users/bdd7e638c15b4d678618405faf5ab217` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.651547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd7e638c15b4d678618405faf5ab217)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.653930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.672302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2965/5912] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:27 2022] PUT /identity/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7/users/0b3d7d8970f840188db5eaee49162cbe/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:27.677562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.716708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd7e638c15b4d678618405faf5ab217'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:27.743660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:27.748160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:27.756480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd7e638c15b4d678618405faf5ab217'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:27.782901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4165-99e1-40e5-a880-fc22406d4f5b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.785354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd7e638c15b4d678618405faf5ab217'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:27.786123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd7e638c15b4d678618405faf5ab217'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:27.786744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ab50f969-c26b-48c4-a754-ed15e112ee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd7e638c15b4d678618405faf5ab217'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:27.792153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.793056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.793438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.793853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.796546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.798740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.805053 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2948/5913] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:27 2022] DELETE /identity/v3/users/bdd7e638c15b4d678618405faf5ab217 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:27.809380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.809735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.810078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.832111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:27.832310 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2966/5914] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:27.837324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.837666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.840466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.866183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267401e-4438-4f8f-b5be-1505226b532b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:27.914338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2949/5915] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:27.924032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:27.925520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.931996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:27.933125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.933413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.933691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] PATH_INFO: `/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7/users/0b3d7d8970f840188db5eaee49162cbe/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.935981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2078d2fbc34f8eb3636ee4360f22b7, user_id=0b3d7d8970f840188db5eaee49162cbe, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:27.938914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23927-7504-4953-9477-d7bf40c4767b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:27.951718 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2967/5916] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:27 2022] PUT /identity/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7/users/0b3d7d8970f840188db5eaee49162cbe/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:27.962434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:27.963107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:27.963107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:27.992939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] MFA Rules not processed for user `0b3d7d8970f840188db5eaee49162cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:27.994134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:27.994836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035ad8-0a00-4e92-90af-a819c7f7be98 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.064246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.064971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.065257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.065581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.069727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2968/5917] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:28.082528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.084032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.132622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:28.159781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8890df3-5ce7-4549-a9ba-29cefae991d0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.160918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.162693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.163997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.164719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.164992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.165263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.172213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:28.179418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.181633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2950/5918] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:28.183306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.195488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2969/5919] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:28.524025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.535576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdece47-85dd-4e48-a2e5-eef0d44a5818 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.541231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.542407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.542676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.543056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] PATH_INFO: `/v3/users/eed95da6fa434a68914804dc1508af53` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.544332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed95da6fa434a68914804dc1508af53)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.546546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.554023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.555487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.570486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658c48-edf1-40c7-9db5-b634afe8ffd2 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.576004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.577105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.577388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.577710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] PATH_INFO: `/v3/projects/86420a14e24e4e12a2d2a6688c742bf7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.579089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86420a14e24e4e12a2d2a6688c742bf7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.581169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.623168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed95da6fa434a68914804dc1508af53'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.632280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed95da6fa434a68914804dc1508af53'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.634987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86420a14e24e4e12a2d2a6688c742bf7', 'request_id': 'req-f42110c9-0b20-4621-adaa-bb084ec5ef5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.642875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86420a14e24e4e12a2d2a6688c742bf7', 'request_id': 'req-f42110c9-0b20-4621-adaa-bb084ec5ef5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.645547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed95da6fa434a68914804dc1508af53'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.646224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed95da6fa434a68914804dc1508af53'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.646835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed95da6fa434a68914804dc1508af53'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.653033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86420a14e24e4e12a2d2a6688c742bf7', 'request_id': 'req-f42110c9-0b20-4621-adaa-bb084ec5ef5b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.659441 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2951/5920] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:28 2022] DELETE /identity/v3/users/eed95da6fa434a68914804dc1508af53 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:28.660486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.661804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.666199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] The token cache is being invalidate because project 86420a14e24e4e12a2d2a6688c742bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:28.666591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.667573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f42110c9-0b20-4621-adaa-bb084ec5ef5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.669698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2970/5921] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:28 2022] DELETE /identity/v3/projects/86420a14e24e4e12a2d2a6688c742bf7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:28.671024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.671503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.671859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.692200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:28.693628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.723264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b294163-2cd2-49b8-9a1b-8347a84160b7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.727332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.728060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.728440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.728790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.730720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.773994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2971/5922] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:28.774940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.776662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.790481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfc876-2e9c-437f-abee-d541735b6f7f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.796631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.797833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.798130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.798450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] PATH_INFO: `/v3/users/1deac9a20be14da3800c265ab521e049` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.799862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1deac9a20be14da3800c265ab521e049)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.801847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.815021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.820756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.820911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:28.833563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2952/5923] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:28.834358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:28.836117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.851902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc90e-f201-4f53-ad6b-ab30e3031b6f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:28.856292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:28.857480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:28.857616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:28.857883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:28.858929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1deac9a20be14da3800c265ab521e049'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.860458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1deac9a20be14da3800c265ab521e049'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.862867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:28.868817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1deac9a20be14da3800c265ab521e049'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.876717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:28.878337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:28.881644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1deac9a20be14da3800c265ab521e049'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.882801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:28.890600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2953/5924] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:28.892022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fe6bbe5e-b2e0-4a91-a4dc-825fec3c424c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1deac9a20be14da3800c265ab521e049'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:28.899021 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2972/5925] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:28 2022] DELETE /identity/v3/users/1deac9a20be14da3800c265ab521e049 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:29.092541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.094399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:29.108625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbe64-a6a0-4315-b1a8-bc81955f1a90 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.172560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.173607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.173901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.174179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] PATH_INFO: `/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.176006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe9ff8c7f3d41e9963a6020f1a557e2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.178940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.239659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'request_id': 'req-7f165f60-52ce-4be5-8895-371fb2012950'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.254386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'request_id': 'req-7f165f60-52ce-4be5-8895-371fb2012950'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.266318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe9ff8c7f3d41e9963a6020f1a557e2', 'request_id': 'req-7f165f60-52ce-4be5-8895-371fb2012950'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.302163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] The token cache is being invalidate because project efe9ff8c7f3d41e9963a6020f1a557e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:29.302548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.303937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7f165f60-52ce-4be5-8895-371fb2012950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.309284 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2954/5926] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:29 2022] DELETE /identity/v3/projects/efe9ff8c7f3d41e9963a6020f1a557e2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:29.311792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.312309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.312415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.337627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:29.339091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:29.426751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2973/5927] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:29.434934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.435229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.435531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.454497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:29.455770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:29.468276 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2955/5928] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:29.470868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.483185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4178d9a-fe50-4be8-b02a-ed1d57ed37e5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.491995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.492860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.493013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.493281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.494335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:29.494765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.496724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.513798 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2974/5929] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:29.517527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.533133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bacac-9295-49ec-8e35-74fe5b8e3acf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.539541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.540662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.540939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.541221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.542244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.544226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.589968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.592291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:29.643445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2956/5930] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:29 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:29.645135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.646523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd25fa-6d39-4f7c-9a0c-597d0fe74ed0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.756273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.758738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.759027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.759309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] PATH_INFO: `/v3/projects/93b3cf3baa544bbbafdcee2979f7cb7d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.760759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b3cf3baa544bbbafdcee2979f7cb7d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.761540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:29.762707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.790078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60375c0-1554-43ff-9b64-0141ea61acea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.796157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.797475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.797989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.798498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.799295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.805187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.842553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b3cf3baa544bbbafdcee2979f7cb7d', 'request_id': 'req-3bfffad6-c428-41a8-a73d-84b7b8582683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.845223 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2957/5931] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:29 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:29.849242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.858977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b3cf3baa544bbbafdcee2979f7cb7d', 'request_id': 'req-3bfffad6-c428-41a8-a73d-84b7b8582683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.861870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d4faa-b821-456c-bf32-6fb64a4d0656 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:29.869896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b3cf3baa544bbbafdcee2979f7cb7d', 'request_id': 'req-3bfffad6-c428-41a8-a73d-84b7b8582683'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.886759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] The token cache is being invalidate because project 93b3cf3baa544bbbafdcee2979f7cb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:29.887545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.888865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:29.891137 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2975/5932] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:29 2022] DELETE /identity/v3/projects/93b3cf3baa544bbbafdcee2979f7cb7d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:29.896063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.898036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:29.909379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:29.967508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:29.968944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:29.968944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:29.969137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:29.969793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:29.972227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:29.988043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2958/5933] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:29.989235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:29.991218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:30.002649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfffad6-c428-41a8-a73d-84b7b8582683 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:30.006488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f6dc6-0f52-433c-82c0-c661323c110f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:30.012226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:30.013126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.013501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.013880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.014957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:30.016403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:30.017174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:30.017303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.017561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.017859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] PATH_INFO: `/v3/users/0b3d7d8970f840188db5eaee49162cbe` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.019090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3d7d8970f840188db5eaee49162cbe)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:30.021067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:30.035227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2959/5934] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:30.036816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:30.049551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806602-ac18-415b-b66b-ddba101d851e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:30.055415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:30.056633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.056984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.057402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] PATH_INFO: `/v3/projects/c26a2815c2bf49849b953ed82ce22555/users/cb6de60313944100b42e9e5ac451677f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.074151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26a2815c2bf49849b953ed82ce22555, user_id=cb6de60313944100b42e9e5ac451677f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:30.077308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fe4a0-c09e-4448-8dbe-8ec3802192a9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:30.090550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3d7d8970f840188db5eaee49162cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:30.092795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3d7d8970f840188db5eaee49162cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:30.098998 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2960/5935] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:30 2022] PUT /identity/v3/projects/c26a2815c2bf49849b953ed82ce22555/users/cb6de60313944100b42e9e5ac451677f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:30.110910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.111217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.111562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.113361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3d7d8970f840188db5eaee49162cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:30.136041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3d7d8970f840188db5eaee49162cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:30.144643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] MFA Rules not processed for user `cb6de60313944100b42e9e5ac451677f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:30.145965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:30.146862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3d7d8970f840188db5eaee49162cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:30.156510 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2976/5936] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:29 2022] DELETE /identity/v3/users/0b3d7d8970f840188db5eaee49162cbe => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:30.233801 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2961/5937] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:30.255803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:30.257915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:30.338507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e40d-3660-4fea-a76b-f110206414ef admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:30.344015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:30.344728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.345084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.345431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.405335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:30.454617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:30.457312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573790e-e3e7-4829-a0d3-1f6ae910ab8d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:30.476091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2977/5938] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:30.774461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:30.776168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:30.840373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:30.897937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46faa55-9240-4c2d-8217-5083c0e88657 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:30.984993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:30.986612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:30.986956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:30.988081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] PATH_INFO: `/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:30.992069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2078d2fbc34f8eb3636ee4360f22b7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:30.994678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.115376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2078d2fbc34f8eb3636ee4360f22b7', 'request_id': 'req-843eabd4-00b8-4f40-bf37-bc9e56aee51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:31.125142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2078d2fbc34f8eb3636ee4360f22b7', 'request_id': 'req-843eabd4-00b8-4f40-bf37-bc9e56aee51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:31.132274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2078d2fbc34f8eb3636ee4360f22b7', 'request_id': 'req-843eabd4-00b8-4f40-bf37-bc9e56aee51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:31.161296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] The token cache is being invalidate because project bd2078d2fbc34f8eb3636ee4360f22b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:31.161799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:31.162653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-843eabd4-00b8-4f40-bf37-bc9e56aee51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:31.164723 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2962/5939] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:30 2022] DELETE /identity/v3/projects/bd2078d2fbc34f8eb3636ee4360f22b7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:31.170095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.170420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.170705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.203920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:31.205373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:31.312570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2978/5940] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:31.314500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.314682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.314960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.339980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:31.341539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:31.351702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2963/5941] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:31.356925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.367407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bf6ae-4f99-43ab-b065-c8de712b6e86 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.372179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.372887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.373139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.373446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.374173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:31.374478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.376079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.388563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2979/5942] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:31.393283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.404199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0b11-6644-424f-bf3f-651e91787b24 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.409035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.409697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.409990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.410262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.410965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.413102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.441087 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2964/5943] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:14:31.445432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.456290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba323e-0605-4e82-b00f-72060be6377a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.520563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.521259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.521546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.521828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.522534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.524478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.547244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2980/5944] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:31.551510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.562561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525c07d-b503-473e-99af-209b14e1dfbc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.567554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.568288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.568675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.569075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.569888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.571575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.583039 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2965/5945] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:31.587493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.602592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e3545-f891-4d04-90c2-38bbba7b4c9f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.609102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.609875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.610163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.610560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.612091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.614510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da48e2-e7c3-49ff-b5b1-5fb91fcf5ab9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.631449 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2981/5946] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:31.635464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.646681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cade3b-85c0-4ca3-b781-19cfa5737196 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.651787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.652732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.653093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.653434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] PATH_INFO: `/v3/projects/0e8a07c496724a57933c68f21c3ef0f6/users/53407f2b6ac44d288abf9ed4ab2a069f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.668353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8a07c496724a57933c68f21c3ef0f6, user_id=53407f2b6ac44d288abf9ed4ab2a069f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.671185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.680093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:31.685121 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2966/5947] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:31 2022] PUT /identity/v3/projects/0e8a07c496724a57933c68f21c3ef0f6/users/53407f2b6ac44d288abf9ed4ab2a069f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:31.697817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.698275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.698622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.728253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] MFA Rules not processed for user `53407f2b6ac44d288abf9ed4ab2a069f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:31.729589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:31.771894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:31.809807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2982/5948] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:31.814826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.880306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbacb9-c58b-4623-9307-eca567e3def1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:31.885892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:31.886572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:31.886862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:31.887145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:31.887861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:31.889887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:31.919410 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2967/5949] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:31.923411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:31.934950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63f212-4334-48b5-aa34-1d8bfb0fb5b3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.030917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.032001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.032841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.033307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.034041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.036052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.067964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2983/5950] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:31 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:32.072576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.088337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf12da-9ea5-4da2-b6fb-a49b1bd6d8cf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.099867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.100712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.101049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.101383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.102186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.109460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.142600 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2968/5951] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:32.146838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.163871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fd4af-b3a2-4da3-8daf-9ab5fc2727c8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.169645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.170735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.171135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.171443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] PATH_INFO: `/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c/users/458bc0045c3b4533a9241671db433d0d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.190131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564b915e44d4d0e94ef1dbfff7cb30c, user_id=458bc0045c3b4533a9241671db433d0d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.192983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.211333 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2984/5952] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:32 2022] PUT /identity/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c/users/458bc0045c3b4533a9241671db433d0d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:32.216140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.232200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4092-6c6b-4508-88cd-0d5cf2d6c642 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.307001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.307830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.308166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.308378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.309138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.310781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5179e-01ab-45cb-baa3-9365dd793784 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.334421 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2969/5953] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:32.338911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.350117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454ca8-1475-4c16-b572-c05a7b68265b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.357297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.358302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.358650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.358997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] PATH_INFO: `/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c/users/458bc0045c3b4533a9241671db433d0d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.361128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564b915e44d4d0e94ef1dbfff7cb30c, user_id=458bc0045c3b4533a9241671db433d0d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.363905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.375244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2985/5954] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:32 2022] PUT /identity/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c/users/458bc0045c3b4533a9241671db433d0d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:32.386713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.387006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.387305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.416055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] MFA Rules not processed for user `458bc0045c3b4533a9241671db433d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:32.418076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:32.483762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:32.497942 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2970/5955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:32.508828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.510565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:32.575365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257964-5da4-4628-90c9-934ce54855f8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.579432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.580131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.580590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.580876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.592264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.594845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.605713 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2986/5956] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:32.784780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:32.814966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921648d5-dca0-466e-a432-28f78ac6cd1e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:32.830748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:32.831427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:32.831712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:32.831991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:32.931600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:32.933307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932858-e24a-47d9-b5e3-765123956f6a service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:32.954349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2971/5957] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:39.302703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:39.342029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:39.399399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b0cc-0773-4173-9388-51ce0fa4db4b service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:39.404303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:39.405355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:39.405713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:39.406065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] PATH_INFO: `/v3/users/53407f2b6ac44d288abf9ed4ab2a069f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:39.407373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53407f2b6ac44d288abf9ed4ab2a069f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:39.409433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:39.469685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53407f2b6ac44d288abf9ed4ab2a069f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.470379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53407f2b6ac44d288abf9ed4ab2a069f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.480396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53407f2b6ac44d288abf9ed4ab2a069f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.497616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53407f2b6ac44d288abf9ed4ab2a069f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.520816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53407f2b6ac44d288abf9ed4ab2a069f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.534206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2987/5958] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:39 2022] DELETE /identity/v3/users/53407f2b6ac44d288abf9ed4ab2a069f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:39.538377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:39.539376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:39.539837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:39.559692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:39.561904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:39.634267 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2972/5959] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:39.647844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:39.649642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:39.716543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:39.718103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:39.730540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6e0ea-6c14-4ab1-82a8-d7a3161be1c6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:39.737136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:39.738673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:39.739143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:39.741256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] PATH_INFO: `/v3/users/cb6de60313944100b42e9e5ac451677f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:39.742908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6de60313944100b42e9e5ac451677f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:39.744970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:39.750317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a6318-c7aa-42f1-927e-37f847895e6f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:39.755026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:39.755878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:39.756580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:39.756858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:39.769408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:39.771665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e1e1f-90b0-4fab-9fb3-33703924567b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:39.791157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2988/5960] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:39.814592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6de60313944100b42e9e5ac451677f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.828674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6de60313944100b42e9e5ac451677f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.849515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6de60313944100b42e9e5ac451677f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.850351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6de60313944100b42e9e5ac451677f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.853272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6de60313944100b42e9e5ac451677f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:39.872607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2973/5961] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:39 2022] DELETE /identity/v3/users/cb6de60313944100b42e9e5ac451677f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:39.875480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:39.875861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:39.876170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:39.905980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:39.907483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:39.982984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:40.017002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2989/5962] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:40.039025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:40.040542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:40.065805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:40.194798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc3ec-7c40-40fa-a9e1-4b931f89ce70 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:40.209068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:40.210433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:40.210609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:40.210855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:40.227061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:40.229342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:40.250311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:40.251888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:40.269311 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2974/5963] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:40.281158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb59bd-3f76-4fbe-81db-bb309435afc8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:40.294846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:40.295843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:40.296126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:40.296502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] PATH_INFO: `/v3/projects/0e8a07c496724a57933c68f21c3ef0f6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:40.298152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8a07c496724a57933c68f21c3ef0f6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:40.302621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:40.396892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8a07c496724a57933c68f21c3ef0f6', 'request_id': 'req-6f7b973b-67dc-41f5-bc78-333f88c82850'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.406775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8a07c496724a57933c68f21c3ef0f6', 'request_id': 'req-6f7b973b-67dc-41f5-bc78-333f88c82850'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.412928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8a07c496724a57933c68f21c3ef0f6', 'request_id': 'req-6f7b973b-67dc-41f5-bc78-333f88c82850'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.428472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] The token cache is being invalidate because project 0e8a07c496724a57933c68f21c3ef0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:40.429028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.429693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.432037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2990/5964] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:40 2022] DELETE /identity/v3/projects/0e8a07c496724a57933c68f21c3ef0f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:40.435992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:40.446085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d7c5-50d1-4189-bd36-97d3820e1f7f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:40.519795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:40.520915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:40.521268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:40.521612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] PATH_INFO: `/v3/users/458bc0045c3b4533a9241671db433d0d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:40.522908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=458bc0045c3b4533a9241671db433d0d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:40.525055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:40.580588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458bc0045c3b4533a9241671db433d0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.591914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458bc0045c3b4533a9241671db433d0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.606440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458bc0045c3b4533a9241671db433d0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.607559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458bc0045c3b4533a9241671db433d0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.608368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ccef4e0d-a1ce-4b6d-a9ae-31d96b297605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458bc0045c3b4533a9241671db433d0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:40.625260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2975/5965] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:40 2022] DELETE /identity/v3/users/458bc0045c3b4533a9241671db433d0d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:40.968265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:40.970014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.009902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b973b-67dc-41f5-bc78-333f88c82850 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.088266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.089269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.089552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.089825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] PATH_INFO: `/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.091139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5564b915e44d4d0e94ef1dbfff7cb30c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.093834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.153466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5564b915e44d4d0e94ef1dbfff7cb30c', 'request_id': 'req-013a70c2-d00f-4308-80a0-bae9dfe06217'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.165673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5564b915e44d4d0e94ef1dbfff7cb30c', 'request_id': 'req-013a70c2-d00f-4308-80a0-bae9dfe06217'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.173975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5564b915e44d4d0e94ef1dbfff7cb30c', 'request_id': 'req-013a70c2-d00f-4308-80a0-bae9dfe06217'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.186757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] The token cache is being invalidate because project 5564b915e44d4d0e94ef1dbfff7cb30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:41.187050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.187722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.194981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2991/5966] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:40 2022] DELETE /identity/v3/projects/5564b915e44d4d0e94ef1dbfff7cb30c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:41.200123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261049-14a7-4f0c-a888-bf2c1765970f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.200444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261049-14a7-4f0c-a888-bf2c1765970f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.200731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261049-14a7-4f0c-a888-bf2c1765970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.220982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3b261049-14a7-4f0c-a888-bf2c1765970f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:41.222219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b261049-14a7-4f0c-a888-bf2c1765970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.270908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:41.311230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.312940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.326497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:41.329664 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2976/5967] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:41.341824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.342683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.342968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.364658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:41.366300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.375450 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2977/5968] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:41.379131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.392204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47ff67-ac00-4940-bf91-1705ad8c7154 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.405172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a70c2-d00f-4308-80a0-bae9dfe06217 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.410520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.411459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.411902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.412313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] PATH_INFO: `/v3/projects/c26a2815c2bf49849b953ed82ce22555` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.415030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26a2815c2bf49849b953ed82ce22555)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.417477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.418256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.418986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.419207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.420629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.421534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:41.421941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.435684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.452117 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2978/5969] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:14:41.455914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.477582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25b32-03f4-4784-9d19-9780ce71e19c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.485556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26a2815c2bf49849b953ed82ce22555', 'request_id': 'req-da2496af-b131-4c05-8dc2-7b8a6136d975'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.497300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26a2815c2bf49849b953ed82ce22555', 'request_id': 'req-da2496af-b131-4c05-8dc2-7b8a6136d975'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.504014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26a2815c2bf49849b953ed82ce22555', 'request_id': 'req-da2496af-b131-4c05-8dc2-7b8a6136d975'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.518005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] The token cache is being invalidate because project c26a2815c2bf49849b953ed82ce22555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:41.518297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.518963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-da2496af-b131-4c05-8dc2-7b8a6136d975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:41.524222 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2992/5970] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:41 2022] DELETE /identity/v3/projects/c26a2815c2bf49849b953ed82ce22555 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:41.526065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1818-7fef-45cd-98e5-6dbff7bfc65b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.526359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1818-7fef-45cd-98e5-6dbff7bfc65b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.526638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1818-7fef-45cd-98e5-6dbff7bfc65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.544329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.545040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.545552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.546895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.547998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.549900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0fdc1818-7fef-45cd-98e5-6dbff7bfc65b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:41.550045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.551133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fdc1818-7fef-45cd-98e5-6dbff7bfc65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.561635 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2993/5971] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:41.569340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe208-279b-48c4-8906-835af211d116 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.569632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe208-279b-48c4-8906-835af211d116 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.569920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe208-279b-48c4-8906-835af211d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.592250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fbafe208-279b-48c4-8906-835af211d116 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:41.593831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fbafe208-279b-48c4-8906-835af211d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.600467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2979/5972] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:14:41.604568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.606253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:41.606728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2994/5973] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:41.612496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafe208-279b-48c4-8906-835af211d116 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.629720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafe208-279b-48c4-8906-835af211d116 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.718560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.719249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.719583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.719855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.720769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:41.721342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.724800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.726738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb03d52-4cb5-4bf3-8451-316428e4aa88 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.733375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.734855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.735337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.735712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.738084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.740218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.745349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2995/5974] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:41.746843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.761909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96f05-fdaf-4a31-95d4-fab386ff34d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.769305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.770320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.770899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.771376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.772302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.774577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.775034 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2980/5975] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:41.779536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.791891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7ec4c-444b-44db-9c83-4e12e58b763d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.799541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.801033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.801410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.801833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.807486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:41.814795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.826410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.837811 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2996/5976] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:41.843549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.844598 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2981/5977] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:41.852257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:41.863194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456c51-a750-4bc9-b2d4-6860c76e337e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.875922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:41.949781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.951569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.952049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.952709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.955016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.956947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.961071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59c51-1834-4dd3-981e-9d56d6f1c466 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:41.967944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:41.968698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:41.968983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:41.969262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:41.970063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:41.972360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2982/5978] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:41.972527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:41.979495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.011421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa6bc-a2ea-4b63-adbd-c3f4f2e4dc58 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.012385 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2997/5979] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:41 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:42.018972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.020845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.022077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.022077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.022377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] PATH_INFO: `/v3/projects/5bd36ae8c0714d48bcd2fc8a0f15cc23/users/b71014e7e9bb4564a644bb0ce8c9ef42/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.032621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5090e80-a2c4-4db7-93ff-3d6f19ab07a8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.042818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.043427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.043707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.043987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.048532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.049677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd36ae8c0714d48bcd2fc8a0f15cc23, user_id=b71014e7e9bb4564a644bb0ce8c9ef42, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.050275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.053117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abcdfa-ffba-42b8-aa2a-f8e8d35b723e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.063213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2998/5980] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:42.066095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.075911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2983/5981] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:41 2022] PUT /identity/v3/projects/5bd36ae8c0714d48bcd2fc8a0f15cc23/users/b71014e7e9bb4564a644bb0ce8c9ef42/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:42.083570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f0c10-2034-4f0b-94b2-30924ac9e89d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.086916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.087270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.087550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.125671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] MFA Rules not processed for user `b71014e7e9bb4564a644bb0ce8c9ef42`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:42.126092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:42.171277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.172594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.173591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.173978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.174836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.178728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.191930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 2999/5982] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:42.196513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.209448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8fe36-fd7b-42e7-8817-7d10fd2afb77 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.215637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2984/5983] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:42.216647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.217810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.218301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.219967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.220835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] PATH_INFO: `/v3/projects/f5a248cf26414bd79e07f4ca594f52eb/users/0dd6d483780e4774a9f119bf6bde4e79/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.234555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c2e6-b6c1-4402-969a-90af0a1cd3c7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.240602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.241877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a248cf26414bd79e07f4ca594f52eb, user_id=0dd6d483780e4774a9f119bf6bde4e79, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.242138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.242505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.243369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.244358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.245589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82233c-7eb3-445f-9607-c7f704343388 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.246675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.266160 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3000/5984] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:42 2022] PUT /identity/v3/projects/f5a248cf26414bd79e07f4ca594f52eb/users/0dd6d483780e4774a9f119bf6bde4e79/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:42.276804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.277112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.277366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.286590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2985/5985] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:42.290772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.321594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] MFA Rules not processed for user `0dd6d483780e4774a9f119bf6bde4e79`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:42.322922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:42.366254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:42.374221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:42.379234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2002-16eb-4dcf-a227-ac0214e1dd09 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.397857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.400846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.401694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.402678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.403736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.406024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.422820 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3001/5986] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:42.433529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2986/5987] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:42 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:42.435720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.437295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:42.437975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.449676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df588-4c1d-4625-8da7-bb91f662fb73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.456063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.457938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.458234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.458657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.459415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.461527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.476100 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2987/5988] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:42.477790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.493582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada861a-b101-47eb-9b24-5de42c817fde admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.503315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.504394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.511466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.511466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] PATH_INFO: `/v3/projects/6d14df9ee7fb4c728a73b234206977e5/users/4356de0f18464e9999914e30e9ed3f0d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.535443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c080-fe70-4fcb-8995-061a91a67176 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.540106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d14df9ee7fb4c728a73b234206977e5, user_id=4356de0f18464e9999914e30e9ed3f0d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.542899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.544625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.544959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.545386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.545851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.560387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.562009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.573164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3002/5989] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:42.580924 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2988/5990] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:42 2022] PUT /identity/v3/projects/6d14df9ee7fb4c728a73b234206977e5/users/4356de0f18464e9999914e30e9ed3f0d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:42.585987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.607203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ab6-3535-4890-b020-eaf9388351f9 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.686405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.687269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.687571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.688100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.689159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.691026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76babc95-c5fa-44a0-be45-6442b3fcd772 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.708266 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3003/5991] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:42.709493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.744775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469887c-acd7-4321-b5b8-8c7e187d2354 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:42.755342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:42.756495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.756843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.757055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] PATH_INFO: `/v3/projects/6d14df9ee7fb4c728a73b234206977e5/users/4356de0f18464e9999914e30e9ed3f0d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.759501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d14df9ee7fb4c728a73b234206977e5, user_id=4356de0f18464e9999914e30e9ed3f0d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:42.763039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:42.774795 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2989/5992] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:42 2022] PUT /identity/v3/projects/6d14df9ee7fb4c728a73b234206977e5/users/4356de0f18464e9999914e30e9ed3f0d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:42.786493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:42.787069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:42.788078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:42.941758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] MFA Rules not processed for user `4356de0f18464e9999914e30e9ed3f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:42.944819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:42.957519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:42.962801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.088266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5465-0701-4edb-89e9-1b66c9047360 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:43.094344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:43.096252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:43.096834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:43.098625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] PATH_INFO: `/v3/users/48103c7f170a4a97a3aa0402a52428c2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:43.101207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48103c7f170a4a97a3aa0402a52428c2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:43.105300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:43.116119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:43.124844 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3004/5993] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:43.136015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:43.138413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.202867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48103c7f170a4a97a3aa0402a52428c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.212829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48103c7f170a4a97a3aa0402a52428c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.229229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b81716-1a4c-4fe3-9c87-1b6941c9c891 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:43.229559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48103c7f170a4a97a3aa0402a52428c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.230494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48103c7f170a4a97a3aa0402a52428c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.231217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48103c7f170a4a97a3aa0402a52428c2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.234387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:43.235956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:43.236584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:43.236954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:43.239712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.245371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2990/5994] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:42 2022] DELETE /identity/v3/users/48103c7f170a4a97a3aa0402a52428c2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:43.258386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:43.260196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:43.273457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3005/5995] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:43.317040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:43.323640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.346204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:43.443789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbb872-9eae-487f-bb1b-268a9cbe363d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:43.451629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:43.452379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:43.452759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:43.453638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:43.456214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.472320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:43.474437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:43.488173 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2991/5996] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:43.517079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:43.519556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:43.543572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d698dc-4f5c-4224-9f68-d45cf5b02e8a service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:43.631027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:43.631979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:43.632313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:43.632641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] PATH_INFO: `/v3/projects/094538b7d28d413fbea48441d35cad09` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:43.633862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094538b7d28d413fbea48441d35cad09)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:43.636116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:43.699547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094538b7d28d413fbea48441d35cad09', 'request_id': 'req-073b7e32-fdf6-4918-97f0-314ad27a2a86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.709247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094538b7d28d413fbea48441d35cad09', 'request_id': 'req-073b7e32-fdf6-4918-97f0-314ad27a2a86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.717368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094538b7d28d413fbea48441d35cad09', 'request_id': 'req-073b7e32-fdf6-4918-97f0-314ad27a2a86'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.734321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] The token cache is being invalidate because project 094538b7d28d413fbea48441d35cad09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:43.734656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.735394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.737254 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3006/5997] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:43 2022] DELETE /identity/v3/projects/094538b7d28d413fbea48441d35cad09 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:43.742760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:43.771018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d525865-20da-4731-8eb1-231babbc22ca service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:43.863851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:43.865837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:43.865837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:43.865837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] PATH_INFO: `/v3/users/35f94ba273864f8f82427b3e8f90773e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:43.866959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f94ba273864f8f82427b3e8f90773e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:43.868629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:43.919909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f94ba273864f8f82427b3e8f90773e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.933267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f94ba273864f8f82427b3e8f90773e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.952924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f94ba273864f8f82427b3e8f90773e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.953895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f94ba273864f8f82427b3e8f90773e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.954626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f94ba273864f8f82427b3e8f90773e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:43.975792 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2992/5998] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:43 2022] DELETE /identity/v3/users/35f94ba273864f8f82427b3e8f90773e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:44.119379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.123340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.147809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7e32-fdf6-4918-97f0-314ad27a2a86 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.204729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:44.246073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.248048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.257811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.259198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.259566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.261027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] PATH_INFO: `/v3/users/b71014e7e9bb4564a644bb0ce8c9ef42` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.264548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71014e7e9bb4564a644bb0ce8c9ef42)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.266187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.289674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:44.333065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71014e7e9bb4564a644bb0ce8c9ef42'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.333862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71014e7e9bb4564a644bb0ce8c9ef42'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.345039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71014e7e9bb4564a644bb0ce8c9ef42'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.364653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71014e7e9bb4564a644bb0ce8c9ef42'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.368501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a4eb-4c95-4d43-8d1a-d6e2d93549c7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.374210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.375450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.375963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.376647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] PATH_INFO: `/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.377525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-494d2013-5731-4ca1-9cdb-2ab5533226ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71014e7e9bb4564a644bb0ce8c9ef42'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.378390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c1d77097bd4689bc25eef1b61e4d4a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.380747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.386496 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3007/5999] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:44 2022] DELETE /identity/v3/users/b71014e7e9bb4564a644bb0ce8c9ef42 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:44.392090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.392390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.392818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.417486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:44.418739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.444901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c1d77097bd4689bc25eef1b61e4d4a', 'request_id': 'req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.457409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c1d77097bd4689bc25eef1b61e4d4a', 'request_id': 'req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.465547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c1d77097bd4689bc25eef1b61e4d4a', 'request_id': 'req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.481798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] The token cache is being invalidate because project f1c1d77097bd4689bc25eef1b61e4d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:44.482118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.482760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0cd8d5c9-268e-4ab4-8456-10cbd5ec4d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:44.485082 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2993/6000] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:44 2022] DELETE /identity/v3/projects/f1c1d77097bd4689bc25eef1b61e4d4a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:44.492316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ec08-f96c-4173-87b5-e6c9e140ce72 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.492891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ec08-f96c-4173-87b5-e6c9e140ce72 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.493550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ec08-f96c-4173-87b5-e6c9e140ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.518846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0af3ec08-f96c-4173-87b5-e6c9e140ce72 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:44.520229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0af3ec08-f96c-4173-87b5-e6c9e140ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.523260 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3008/6001] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:44.529318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.531089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.614290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2994/6002] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:44.615904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.616155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.616461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.617224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8850ac-c978-4ce2-8b6b-e3fbdb951377 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.623955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:44.648804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:44.650756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:44.664660 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2995/6003] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:44.665990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.678720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d4484-9170-4c5a-a84c-bce41bc6e34f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.683908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.684646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.684928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.685204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.685935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:44.686240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.687903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.693873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.694571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.694897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.695521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.708739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.710713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.715175 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2996/6004] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:44.721226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.726157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3009/6005] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:44.734391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573622-025a-4164-b79d-ef00c6d66127 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.739310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.740140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.740448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.740792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.741402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.743501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.775896 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2997/6006] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:44 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:44.780536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.820301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde155-a296-415c-984f-16bf720fff56 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.922137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.923052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.923174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.923393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.924233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.926232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:44.949464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3010/6007] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:44 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:44.953527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:44.959033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:44.972790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bdcea-edc1-4d63-853b-05c21c87d47c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:44.979529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:44.980287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:44.981513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:44.981922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:44.987533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:44.990451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.015906 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2998/6008] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:45.019997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:45.035730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520050-4b83-4013-b98e-59695aede0ff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:45.041554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:45.042235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.042467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.042674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.043412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:45.045514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad220d-3d66-4daf-9f5a-2446651283ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.060666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3011/6009] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:14:45.061697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:45.085555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fa228-4488-47be-b465-965a2579131a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:45.093342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:45.094941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.095456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.095749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] PATH_INFO: `/v3/projects/0a0dcb1380ad41328b6779588f0e91f6/users/1554f1d20e344432b617857d279f6d37/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.115535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0dcb1380ad41328b6779588f0e91f6, user_id=1554f1d20e344432b617857d279f6d37, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:45.118586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.140499 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 2999/6010] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:45 2022] PUT /identity/v3/projects/0a0dcb1380ad41328b6779588f0e91f6/users/1554f1d20e344432b617857d279f6d37/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:45.145738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.146133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.146516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.168444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:45.169850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:45.179310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:45.181884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:45.260328 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3012/6011] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:45.272124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd3da5-5306-4a65-982a-9631227f896d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:45.277410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:45.278524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.278655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.278906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] PATH_INFO: `/v3/projects/5bd36ae8c0714d48bcd2fc8a0f15cc23` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.280414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd36ae8c0714d48bcd2fc8a0f15cc23)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:45.280951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:45.282663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:45.282790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.335125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:45.338932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd36ae8c0714d48bcd2fc8a0f15cc23', 'request_id': 'req-7b909835-e385-40e9-8509-abccde14e31a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.349580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd36ae8c0714d48bcd2fc8a0f15cc23', 'request_id': 'req-7b909835-e385-40e9-8509-abccde14e31a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.358028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd36ae8c0714d48bcd2fc8a0f15cc23', 'request_id': 'req-7b909835-e385-40e9-8509-abccde14e31a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.369034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f68648-f89f-4724-bddb-3dd2bc63e9e3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:45.373161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] The token cache is being invalidate because project 5bd36ae8c0714d48bcd2fc8a0f15cc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:45.373460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.375352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.377347 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3000/6012] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:45 2022] DELETE /identity/v3/projects/5bd36ae8c0714d48bcd2fc8a0f15cc23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:45.382524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:45.384331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:45.435969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:45.436964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.437259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.437831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.441278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:45.464250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:45.469478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b909835-e385-40e9-8509-abccde14e31a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:45.476214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:45.477200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:45.477493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:45.477779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] PATH_INFO: `/v3/users/4356de0f18464e9999914e30e9ed3f0d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:45.479920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4356de0f18464e9999914e30e9ed3f0d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:45.482628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.532796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:45.534758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:45.550837 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3013/6013] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:45.554610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4356de0f18464e9999914e30e9ed3f0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.567112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4356de0f18464e9999914e30e9ed3f0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.583251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4356de0f18464e9999914e30e9ed3f0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.584008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4356de0f18464e9999914e30e9ed3f0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.585023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20da0cbf-c253-4627-bad4-0c4f1e6f866f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4356de0f18464e9999914e30e9ed3f0d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:45.607004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3001/6014] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:45 2022] DELETE /identity/v3/users/4356de0f18464e9999914e30e9ed3f0d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:46.126158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:46.138538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3acf-bf26-4760-8023-b4f3a9c73909 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:46.227264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:46.228290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.228690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.228986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] PATH_INFO: `/v3/projects/6d14df9ee7fb4c728a73b234206977e5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.230883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d14df9ee7fb4c728a73b234206977e5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:46.232924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:46.288759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:46.298384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d14df9ee7fb4c728a73b234206977e5', 'request_id': 'req-eb373d9f-bda8-4fb3-9869-8832de7979eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:46.313424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d14df9ee7fb4c728a73b234206977e5', 'request_id': 'req-eb373d9f-bda8-4fb3-9869-8832de7979eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:46.321851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d14df9ee7fb4c728a73b234206977e5', 'request_id': 'req-eb373d9f-bda8-4fb3-9869-8832de7979eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:46.365542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] The token cache is being invalidate because project 6d14df9ee7fb4c728a73b234206977e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:46.366160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:46.368777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:46.371216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3014/6015] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:46 2022] DELETE /identity/v3/projects/6d14df9ee7fb4c728a73b234206977e5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:46.376192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409107-ef11-4447-bb94-b05976923d21 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.376749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409107-ef11-4447-bb94-b05976923d21 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.376858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409107-ef11-4447-bb94-b05976923d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.416223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6d409107-ef11-4447-bb94-b05976923d21 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:46.420174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6d409107-ef11-4447-bb94-b05976923d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:46.435197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:46.436983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:46.597067 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3002/6016] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:46.607814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.608333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.608815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.621886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb373d9f-bda8-4fb3-9869-8832de7979eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:46.635130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:46.635973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.636262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.636596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.642993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:46.651307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:46.652817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:46.667107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:46.669611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:46.678738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3003/6017] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:46.682957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:46.692789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3015/6018] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:14:46.696310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059695e1-88e4-497d-bf0a-b413f50e2fd1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:46.710148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:46.710846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.711151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.711436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.712236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:46.712574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:46.714274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:46.748152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:46.752526 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3004/6019] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:14:46.785088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232764b3-2fd5-40ee-83e5-b4dcb19d190f service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:46.793330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:46.794055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:46.794350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:46.794742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:46.798113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:46.802617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:46.884452 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3016/6020] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:46 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:46.889576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:46.908868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383fee-4635-4e7a-8d27-b735acf7f200 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.032336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:47.050175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.051360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.051648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.051925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.052816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.057620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.102214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3005/6021] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:46 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:47.106292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.125795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810514-31ad-4767-8013-3b456d3d248e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.141090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.142729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.143733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.144837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.145848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.148989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.169606 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3017/6022] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:47.173409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.201420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180422b2-4497-4010-9007-78db8701f67e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.212064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.213525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.213926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.214457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.216369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.219921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7d600-c9ba-4b90-a5cd-e154d77b174f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.241254 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3006/6023] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:47.245085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.262221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae98a-2ca0-48a3-8ef7-9e6c8616c155 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.275388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.276729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.277021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.277305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] PATH_INFO: `/v3/projects/7450ab8c8c6344b6b12866ed132a7e4f/users/340578b5af064f32b0975586f32f924f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.309330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7450ab8c8c6344b6b12866ed132a7e4f, user_id=340578b5af064f32b0975586f32f924f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.313673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.333822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3018/6024] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:47 2022] PUT /identity/v3/projects/7450ab8c8c6344b6b12866ed132a7e4f/users/340578b5af064f32b0975586f32f924f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:47.344552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.344975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.345345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.384152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] MFA Rules not processed for user `340578b5af064f32b0975586f32f924f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:47.385881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:47.481649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3007/6025] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:47.486195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.566685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c9591-5c41-4785-bf03-b1f1dbd2cb1d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.572258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.573172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.573738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.573738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.574454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.576484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.579974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:47.610317 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3019/6026] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:47 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:47.611541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.628583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47e507-d5db-4b4b-8e48-ba4ffd49019f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.697580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.698846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.699224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.699791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.701325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.704514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.740128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3008/6027] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:47 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:47.742019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.758851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2732d46-3601-44ce-bed8-454e5c70c5c9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.765198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.765925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.766207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.766866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.767720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.769594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.785357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3020/6028] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:47.789597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.805909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f13f0-4424-4c3a-9c2c-34377cfcf7ef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.817984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.818843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.819127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.819500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] PATH_INFO: `/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f/users/a87b41ba2af04a98aab917afb678f113/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.843138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da23a67b1d341d4b0aadc9178ec0f3f, user_id=a87b41ba2af04a98aab917afb678f113, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.847359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:47.876644 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3009/6029] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:47 2022] PUT /identity/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f/users/a87b41ba2af04a98aab917afb678f113/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:47.878379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:47.893351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4113fc-c6b1-4d59-b475-e3233d6eb9c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:47.972723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:47.973433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:47.973718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:47.974005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:47.975365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:47.977233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6d7e9-afa0-4d3c-b4cb-018ac0efa417 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:48.001252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:48.002464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3021/6030] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:48.017982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaad7b-b540-49c7-a849-367a4a7e8335 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:48.047059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:48.048994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:48.049123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:48.049460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] PATH_INFO: `/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f/users/a87b41ba2af04a98aab917afb678f113/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:48.051934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da23a67b1d341d4b0aadc9178ec0f3f, user_id=a87b41ba2af04a98aab917afb678f113, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:48.054759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:48.066508 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3010/6031] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:48 2022] PUT /identity/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f/users/a87b41ba2af04a98aab917afb678f113/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:48.078040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:48.078564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:48.079052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:48.151048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] MFA Rules not processed for user `a87b41ba2af04a98aab917afb678f113`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:48.152807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:48.309023 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3022/6032] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:48.338635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:48.341444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:48.392724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:48.459795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be4956-7b23-45af-b830-51b8fea2d4f2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:48.469039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:48.469039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:48.469039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:48.469573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:48.484137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:48.485669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:48.497557 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3011/6033] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:48.680929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:48.696159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3b47-ab73-481f-b3ee-5bba25bafbc2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:48.710485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:48.712082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:48.712511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:48.712908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:48.838306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:48.854075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:48.856398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:48.872339 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3023/6034] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:49.383486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:49.481521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08311f5-3d63-4ead-8f75-6e38f8ff5906 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:49.487422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:49.488951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:49.489235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:49.489961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] PATH_INFO: `/v3/users/340578b5af064f32b0975586f32f924f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:49.490759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340578b5af064f32b0975586f32f924f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:49.494564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:49.529606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:49.531175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:49.547257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e291-42ed-4530-b15f-5b789994c31d service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:49.552954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:49.553948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:49.554273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:49.554646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] PATH_INFO: `/v3/users/441d9cda34564fca81f9aa538b70f00d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:49.555987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=441d9cda34564fca81f9aa538b70f00d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:49.558031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:49.587335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340578b5af064f32b0975586f32f924f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.600308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340578b5af064f32b0975586f32f924f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.614833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340578b5af064f32b0975586f32f924f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.615637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441d9cda34564fca81f9aa538b70f00d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.616236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340578b5af064f32b0975586f32f924f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.616452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441d9cda34564fca81f9aa538b70f00d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.617450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c42cbc9-ddd0-4569-85b0-54006aa3e044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340578b5af064f32b0975586f32f924f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.625863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441d9cda34564fca81f9aa538b70f00d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.637098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3012/6035] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:49 2022] DELETE /identity/v3/users/340578b5af064f32b0975586f32f924f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:49.641482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441d9cda34564fca81f9aa538b70f00d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.642624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:49.643071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:49.643572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:49.651379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441d9cda34564fca81f9aa538b70f00d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:49.661519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3024/6036] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:49 2022] DELETE /identity/v3/users/441d9cda34564fca81f9aa538b70f00d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:49.666920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:49.668161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:49.715197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:49.766127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3013/6037] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:49.778023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:49.779589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:49.901476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33675132-aff1-490d-b4bd-5f16ce92cfbe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:49.908884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:49.909573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:49.909847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:49.910123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:49.924637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:49.926199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4c176-8a44-4609-a331-4d5b9b5a63b8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:49.932620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:49.934873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:49.956181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3025/6038] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:49.962950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca20532-57a8-4ae2-8a44-dc71f07f9153 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:49.979421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:49.980326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:49.981899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:49.981899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] PATH_INFO: `/v3/projects/f14f834f94d74057abd079c04562b60e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:49.982568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14f834f94d74057abd079c04562b60e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:49.985092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.046428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14f834f94d74057abd079c04562b60e', 'request_id': 'req-fa54f454-7f8b-448b-a38d-f514ddb33038'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.057859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14f834f94d74057abd079c04562b60e', 'request_id': 'req-fa54f454-7f8b-448b-a38d-f514ddb33038'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.067546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14f834f94d74057abd079c04562b60e', 'request_id': 'req-fa54f454-7f8b-448b-a38d-f514ddb33038'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.082220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] The token cache is being invalidate because project f14f834f94d74057abd079c04562b60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:50.083379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.084797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fa54f454-7f8b-448b-a38d-f514ddb33038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.086663 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3014/6039] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:49 2022] DELETE /identity/v3/projects/f14f834f94d74057abd079c04562b60e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:50.092236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.092770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.093077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.114798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:50.116072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:50.220070 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3026/6040] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:50.229758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.230314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.230596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.303490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:50.305056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:50.318937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3015/6041] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:14:50.325504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.344994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16d0fa-4e22-415c-8670-934778732670 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.351149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.352906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.355762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:50.366386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.366779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.368052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.369961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:50.371192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.379770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.388172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e11c-c318-4d1f-8c95-a0639ead5797 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.389460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:50.403064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.404385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.405137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.405676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] PATH_INFO: `/v3/projects/7450ab8c8c6344b6b12866ed132a7e4f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.411085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7450ab8c8c6344b6b12866ed132a7e4f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.417792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.426821 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3027/6042] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:50.428094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.447641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f4e05-331e-4917-a74d-5ca3f67e948d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.454441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.455331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.455536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.455912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.456714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.461085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.514629 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3028/6043] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:50 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:50.515828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.518701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7450ab8c8c6344b6b12866ed132a7e4f', 'request_id': 'req-0fd4674b-1c9b-46ec-8404-99c96b72905c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.542459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7450ab8c8c6344b6b12866ed132a7e4f', 'request_id': 'req-0fd4674b-1c9b-46ec-8404-99c96b72905c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.555236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7450ab8c8c6344b6b12866ed132a7e4f', 'request_id': 'req-0fd4674b-1c9b-46ec-8404-99c96b72905c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.586889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] The token cache is being invalidate because project 7450ab8c8c6344b6b12866ed132a7e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:50.587753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.588714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.591439 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3016/6044] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:50 2022] DELETE /identity/v3/projects/7450ab8c8c6344b6b12866ed132a7e4f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:50.595760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.597905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:50.680997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce305e-999c-47e2-8f45-f266703c5709 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.698684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:50.701776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.702489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.702777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.707309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.708355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.712578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.740089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4674b-1c9b-46ec-8404-99c96b72905c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.752645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.753707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.753995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.754299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] PATH_INFO: `/v3/users/a87b41ba2af04a98aab917afb678f113` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.757547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87b41ba2af04a98aab917afb678f113)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.762398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.772748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3029/6045] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:50 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:50.778821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.785444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:50.839964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c94b-1201-4c22-b637-d0958850d83f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.842192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.843440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.844139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.844452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.848262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.851414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.874471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87b41ba2af04a98aab917afb678f113'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.877189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3030/6046] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:50.882688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.891013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87b41ba2af04a98aab917afb678f113'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.906690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46147e29-ef28-4f08-97a3-832347bf950f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:50.919466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87b41ba2af04a98aab917afb678f113'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.921875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87b41ba2af04a98aab917afb678f113'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.922116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:50.922826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:50.923112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:50.923393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:50.923749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87b41ba2af04a98aab917afb678f113'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:50.925034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:50.926670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eafaa6-3ed7-4b6d-9bc0-af09bb5ebd10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:50.960010 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3017/6047] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:50 2022] DELETE /identity/v3/users/a87b41ba2af04a98aab917afb678f113 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:50.965002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3031/6048] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:50.965479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:50.969174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:51.073502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe79c-ae5c-44da-bff0-b68af10b72ec admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:51.079485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:51.080586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:51.080970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:51.081412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] PATH_INFO: `/v3/projects/fe9b4f7c6bf847b98feca7f1340cd68d/users/58ca5a1327194ea6a6c6bba2810e2b25/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:51.119505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9b4f7c6bf847b98feca7f1340cd68d, user_id=58ca5a1327194ea6a6c6bba2810e2b25, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:51.126796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:51.161785 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3018/6049] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:50 2022] PUT /identity/v3/projects/fe9b4f7c6bf847b98feca7f1340cd68d/users/58ca5a1327194ea6a6c6bba2810e2b25/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:51.169660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:51.169886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:51.170170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:51.202057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:51.203158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:51.378648 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3032/6050] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:51.394541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:51.396903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:51.456005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:51.482824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29837fd-669d-41ff-81a8-9619879dfe41 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:51.490759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:51.491635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:51.491931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:51.492209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:51.513705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:51.515340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea76f51-e70a-41e4-96c8-4b198fbf51b1 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:51.534387 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3019/6051] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:51.651360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:51.653476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:51.679831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93823cb9-8209-4cd8-812c-e10dc674b63c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:51.689581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:51.692416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:51.693044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:51.693525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] PATH_INFO: `/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:51.695332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da23a67b1d341d4b0aadc9178ec0f3f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:51.716661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:51.826011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:51.840254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da23a67b1d341d4b0aadc9178ec0f3f', 'request_id': 'req-81504946-59cb-4617-b9bb-c47fe78dc08a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:51.853046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da23a67b1d341d4b0aadc9178ec0f3f', 'request_id': 'req-81504946-59cb-4617-b9bb-c47fe78dc08a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:51.862373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da23a67b1d341d4b0aadc9178ec0f3f', 'request_id': 'req-81504946-59cb-4617-b9bb-c47fe78dc08a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:51.876664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] The token cache is being invalidate because project 4da23a67b1d341d4b0aadc9178ec0f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:14:51.877259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:51.878150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-81504946-59cb-4617-b9bb-c47fe78dc08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:51.880552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3033/6052] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:14:51 2022] DELETE /identity/v3/projects/4da23a67b1d341d4b0aadc9178ec0f3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:51.885726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:51.886054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:51.886341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:51.931151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:51.932000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:52.065787 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3020/6053] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:52.067468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52456767-f576-4e81-9105-eff00564cea9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.067932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52456767-f576-4e81-9105-eff00564cea9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.068037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52456767-f576-4e81-9105-eff00564cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.108948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-52456767-f576-4e81-9105-eff00564cea9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:52.115431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52456767-f576-4e81-9105-eff00564cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:52.161031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3034/6054] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:52.165528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.183597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d7a-8c91-4de2-948c-206ae8797a80 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.199868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.200956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.201444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.201880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.203440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:14:52.204039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.207134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.229210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3021/6055] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:14:52.233889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52456767-f576-4e81-9105-eff00564cea9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.253838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52456767-f576-4e81-9105-eff00564cea9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.268244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.270778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.271339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.271809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.272774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.275358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.328045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.336966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3035/6056] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:14:52 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:52.349292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc49daa-7098-42d8-92cb-90417d7461ea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.437424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.438378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.438679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.439090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.439912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.442507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.470874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3022/6057] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:14:52 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:14:52.475344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.497772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c675-69c4-4791-9a97-d9628ba1abe9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.505201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.506197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.506593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.507100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.508005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.510524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.556040 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3036/6058] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:52.560258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.585397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501976-1513-40a7-a1ba-5425bd03006b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.590700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.591392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.591741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.592021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.595800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.595800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fc118-9ee3-4762-b3a4-7129351fb045 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.629650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3023/6059] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:14:52.633948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.645457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1c384-7b01-41fc-84c2-9c6c9f88fc26 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:52.651154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:52.652571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.653904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.654254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] PATH_INFO: `/v3/projects/6c29fd4309504c509cd9e3bff2729681/users/8219c458a3bc4c43aabdcd2ab810cca1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.713979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c29fd4309504c509cd9e3bff2729681, user_id=8219c458a3bc4c43aabdcd2ab810cca1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:52.716657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:52.742331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3037/6060] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:14:52 2022] PUT /identity/v3/projects/6c29fd4309504c509cd9e3bff2729681/users/8219c458a3bc4c43aabdcd2ab810cca1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:14:52.754121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b527-b648-4e0d-a8b2-ad99354d2946 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:52.754121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b527-b648-4e0d-a8b2-ad99354d2946 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:52.754368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b527-b648-4e0d-a8b2-ad99354d2946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:52.788762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cef4b527-b648-4e0d-a8b2-ad99354d2946 None None] MFA Rules not processed for user `8219c458a3bc4c43aabdcd2ab810cca1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:52.791809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cef4b527-b648-4e0d-a8b2-ad99354d2946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:52.871255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:52.944446 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3024/6061] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:52.954966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:52.956761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:53.104829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48b21-9390-4940-8252-c210008c9bba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:53.114352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:53.115251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:53.115544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:53.115821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:53.131929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:53.133500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c157185-3530-44b9-a1a2-d9fe0efff905 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:53.163357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3038/6062] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:53.967773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:53.968273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:53.968384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:54.033101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] MFA Rules not processed for user `1554f1d20e344432b617857d279f6d37`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:54.034778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:54.179040 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3025/6063] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:54.189428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:54.189841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:54.189991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:54.223652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] MFA Rules not processed for user `1554f1d20e344432b617857d279f6d37`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:54.225693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:54.236562 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3039/6064] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:54.262975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:54.265553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:54.391115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f77d75-a822-407d-bb51-738a4d62fdc6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:54.398358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:54.399175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:54.400008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:54.400366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:54.414232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:54.416037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f22c-fed6-481b-94ea-364c85d364a3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:54.430582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3026/6065] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:14:58.574853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:58.577177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:58.745158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:58.754175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac638f-b1dd-4bab-b089-e04a44b642b7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:58.767603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:58.771223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:58.771923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:58.772558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] PATH_INFO: `/v3/users/0dd6d483780e4774a9f119bf6bde4e79` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:58.775279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd6d483780e4774a9f119bf6bde4e79)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:58.783155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:58.938903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd6d483780e4774a9f119bf6bde4e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:58.940971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd6d483780e4774a9f119bf6bde4e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:58.965631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd6d483780e4774a9f119bf6bde4e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:59.011877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd6d483780e4774a9f119bf6bde4e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:59.047778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd6d483780e4774a9f119bf6bde4e79'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:14:59.056375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3040/6066] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:14:58 2022] DELETE /identity/v3/users/0dd6d483780e4774a9f119bf6bde4e79 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:14:59.060877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:59.061416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:59.061416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:59.109646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:14:59.114864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:59.350009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:59.385107 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3027/6067] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:14:59.424641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:14:59.428998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:14:59.623174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27de93-24f7-49ed-bac4-d1e4b0cf98c9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:14:59.634213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:14:59.636448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:14:59.637119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:14:59.638553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:14:59.663763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:14:59.667211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803a5c9-c677-4a68-979b-54a01d0075dd service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:14:59.694926 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3041/6068] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:00.325653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:00.328144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:00.351195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f32f2-6a74-4d2f-836a-7cd375a78020 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:00.364927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:00.367035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:00.367521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:00.369045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] PATH_INFO: `/v3/projects/f5a248cf26414bd79e07f4ca594f52eb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:00.373523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a248cf26414bd79e07f4ca594f52eb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:00.379396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:00.495277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a248cf26414bd79e07f4ca594f52eb', 'request_id': 'req-e4bb694a-1744-4227-b9f6-1c5cfadf597e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:00.511000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a248cf26414bd79e07f4ca594f52eb', 'request_id': 'req-e4bb694a-1744-4227-b9f6-1c5cfadf597e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:00.518081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a248cf26414bd79e07f4ca594f52eb', 'request_id': 'req-e4bb694a-1744-4227-b9f6-1c5cfadf597e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:00.557639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] The token cache is being invalidate because project f5a248cf26414bd79e07f4ca594f52eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:00.558161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:00.566196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e4bb694a-1744-4227-b9f6-1c5cfadf597e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:00.568973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3028/6069] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:00 2022] DELETE /identity/v3/projects/f5a248cf26414bd79e07f4ca594f52eb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:00.575028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:00.575321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:00.575785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:00.622106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:00.624718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:00.733101 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3042/6070] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:00.734758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:00.734964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:00.735305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:00.769275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:00.777257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:00.824185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3029/6071] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:00.833277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:00.847540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0324817-667c-4fd0-8ca3-4ab9501d8d73 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:00.853062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:00.853803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:00.858495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:00.858817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:00.860050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:00.864725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:00.866501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:00.892782 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3043/6072] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:00.897363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:00.909119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7891e-06b9-4c00-ba43-f2e77972d359 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:00.922915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:00.923602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:00.923883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:00.924156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:00.924915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:00.926830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:00.985984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3030/6073] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:00 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:00.990023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:01.013762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757e39-e54f-4e7f-bc2a-24115997e244 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:01.022877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:01.161111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:01.166277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:01.166842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:01.167563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:01.168564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:01.172340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:01.250143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3044/6074] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:00 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:01.251740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:01.279061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b61a-74f6-47db-911b-64b1c90f0a4a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:01.289955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:01.294377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:01.295703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:01.296052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:01.299406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:01.304078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:01.342877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3031/6075] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:01.347142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:01.375321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c57d1-f11e-47ec-891c-a8e69bbd08ba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:01.403659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:01.404673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:01.407062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:01.408118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:01.412623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:01.420223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7236f-4ee5-4735-83bd-1cae302572d6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:01.469668 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3045/6076] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:01.472370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:01.492709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6d06e-6103-405b-9d88-3a5d0fcb595d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:01.506518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:01.508285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:01.509514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:01.510036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] PATH_INFO: `/v3/projects/49cbc6e00232443ea014f96c3a5b82b0/users/b9b677f2f4174f3a8d84a210a3d14cc2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:01.551055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cbc6e00232443ea014f96c3a5b82b0, user_id=b9b677f2f4174f3a8d84a210a3d14cc2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:01.565934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:01.597331 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3032/6077] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:01 2022] PUT /identity/v3/projects/49cbc6e00232443ea014f96c3a5b82b0/users/b9b677f2f4174f3a8d84a210a3d14cc2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:01.608581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:01.608874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:01.609163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:01.685068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] MFA Rules not processed for user `b9b677f2f4174f3a8d84a210a3d14cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:01.686328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:01.899444 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3046/6078] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:01.935530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:01.937365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:02.056659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4339ca1-9d75-4f7d-a7ce-dac324163953 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:02.061253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:02.062076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.062476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.063006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.103978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:02.105790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51209068-1cc5-44a9-8b02-77238529774a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:02.145967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3033/6079] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:02.164111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:02.346848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f06cb-fab8-4385-b145-8d21452f4cff None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:02.354094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:02.356134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.356724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.357155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] PATH_INFO: `/v3/users/b9b677f2f4174f3a8d84a210a3d14cc2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.359300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b677f2f4174f3a8d84a210a3d14cc2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:02.373454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:02.424188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:02.478400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b677f2f4174f3a8d84a210a3d14cc2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.479266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b677f2f4174f3a8d84a210a3d14cc2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.514533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b677f2f4174f3a8d84a210a3d14cc2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.549002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b677f2f4174f3a8d84a210a3d14cc2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.575790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b677f2f4174f3a8d84a210a3d14cc2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.590707 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3047/6080] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:02 2022] DELETE /identity/v3/users/b9b677f2f4174f3a8d84a210a3d14cc2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:02.595313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.595826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.595911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.639129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:02.640726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:02.659440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:02.777917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:02.779304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:02.784659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3034/6081] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:02.786734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:02.788281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:02.795776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517d57-0a17-428c-8e3b-dc2ba55e17e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:02.807145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:02.807145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.807145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.808325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] PATH_INFO: `/v3/users/8219c458a3bc4c43aabdcd2ab810cca1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.809495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8219c458a3bc4c43aabdcd2ab810cca1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:02.812972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:02.877033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1de3-1eca-4711-99fc-42a83583313c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:02.881446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:02.882143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.882435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.882725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.893850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:02.896009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4af8b-5963-4a80-9c66-fe9ea2f6e121 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:02.896657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8219c458a3bc4c43aabdcd2ab810cca1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.897523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8219c458a3bc4c43aabdcd2ab810cca1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.910247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3035/6082] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:02.910935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8219c458a3bc4c43aabdcd2ab810cca1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.912633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.913055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.913325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:02.935076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8219c458a3bc4c43aabdcd2ab810cca1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.946579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] MFA Rules not processed for user `58ca5a1327194ea6a6c6bba2810e2b25`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:02.948024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:02.961324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4090d1e-38a8-47ad-b0ae-7705648585bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8219c458a3bc4c43aabdcd2ab810cca1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:02.975396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3048/6083] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:02 2022] DELETE /identity/v3/users/8219c458a3bc4c43aabdcd2ab810cca1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:02.979327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:02.979675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:02.980385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.008629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:03.009937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.072117 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3036/6084] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:03.086123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.088544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.116724 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3049/6085] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:03.130860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.132595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.153715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:03.241351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:03.282195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14124e-f88b-47c7-9855-cbf68bf7b887 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.299655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a3a80-5cb1-4874-97ef-3624f5c36336 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.306053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:03.308311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.308907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.309419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.331371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:03.333527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:03.347852 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3050/6086] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:03.349723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.352676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.370908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4a9e-cc2b-4637-aca4-acfc56e27f07 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.386837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:03.387742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.388026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.388301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] PATH_INFO: `/v3/projects/49cbc6e00232443ea014f96c3a5b82b0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.396774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cbc6e00232443ea014f96c3a5b82b0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:03.398839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:03.434753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:03.436393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.436716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.437001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.469665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cbc6e00232443ea014f96c3a5b82b0', 'request_id': 'req-d18ffb37-cedb-42fb-a410-73081250aee5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:03.488650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cbc6e00232443ea014f96c3a5b82b0', 'request_id': 'req-d18ffb37-cedb-42fb-a410-73081250aee5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:03.504609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cbc6e00232443ea014f96c3a5b82b0', 'request_id': 'req-d18ffb37-cedb-42fb-a410-73081250aee5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:03.556063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] The token cache is being invalidate because project 49cbc6e00232443ea014f96c3a5b82b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:03.556413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:03.559934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d18ffb37-cedb-42fb-a410-73081250aee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:03.560976 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3051/6087] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:03 2022] DELETE /identity/v3/projects/49cbc6e00232443ea014f96c3a5b82b0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:03.564581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:03.566755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.566951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.567219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.575986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc917301-a75c-4d67-a076-3b17e9b3b49c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:03.608658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3037/6088] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:03.612115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:03.612115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.717931 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3052/6089] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:03.725509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.726227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.726738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.754779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:03.757133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.767716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3038/6090] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:03.771848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.782836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e30ff-2199-48d2-bda0-e74df8470007 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.787950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:03.788749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.789187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.789524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.790902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:03.790902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:03.793420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:03.818100 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3053/6091] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:03.829777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.841409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bedb9-e094-4487-9c80-58c4c634f0f4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.849859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:03.850528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:03.850983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:03.851290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:03.852015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:03.854050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:03.886695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.893296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3039/6092] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:03 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:03.894451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:03.900979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:03.918279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33717353-692f-48c9-96a7-722207c5609c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:03.945939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:04.003124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:04.009965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623df18-df3c-4b13-8666-218081057a90 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.012486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.013416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.013701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.013977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] PATH_INFO: `/v3/projects/6c29fd4309504c509cd9e3bff2729681` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.015335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c29fd4309504c509cd9e3bff2729681)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.015992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.016870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.017162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.017284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.017467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.018124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.020620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.065560 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3040/6093] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:03 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:04.069778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.089704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c29fd4309504c509cd9e3bff2729681', 'request_id': 'req-b1736bb4-bc6e-4080-a516-3b438f70df25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:04.096727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52221b-0906-40df-8b76-5c3f519b4d37 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.111094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c29fd4309504c509cd9e3bff2729681', 'request_id': 'req-b1736bb4-bc6e-4080-a516-3b438f70df25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:04.118365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c29fd4309504c509cd9e3bff2729681', 'request_id': 'req-b1736bb4-bc6e-4080-a516-3b438f70df25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:04.133420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] The token cache is being invalidate because project 6c29fd4309504c509cd9e3bff2729681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:04.134397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:04.135228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1736bb4-bc6e-4080-a516-3b438f70df25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:04.137697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3054/6094] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:03 2022] DELETE /identity/v3/projects/6c29fd4309504c509cd9e3bff2729681 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:04.142834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352efde-f37a-4226-8e76-16d2470164a5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.142834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352efde-f37a-4226-8e76-16d2470164a5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.143100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352efde-f37a-4226-8e76-16d2470164a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.164493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7352efde-f37a-4226-8e76-16d2470164a5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:04.168837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7352efde-f37a-4226-8e76-16d2470164a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.170961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.171709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.172062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.172680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.173359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.175293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.180570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3055/6095] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:04.187368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.188274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.188607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.191408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3041/6096] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:04.195160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.197846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.209638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:04.211564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.212315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df477650-3f1a-4135-911a-35faeee7267b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.217965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.219552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.219552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.219793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.220678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.221636 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3056/6097] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:04.226023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.226924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.236745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb276781-72f8-4d62-9494-48972fb44e26 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.238100 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3042/6098] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:04.242124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.242523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.242817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.243260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.243549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.244348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:04.244690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.246328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.255162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7da3-bb4b-4030-a8dc-393e30144252 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.262432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.263682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.264194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.264804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] PATH_INFO: `/v3/projects/642c18b628764e4eb5d8dfd7c458342c/users/c2080ebdd0174f6988fd375f5860d6e1/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.276062 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3057/6099] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:04.277395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.292669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] RBAC: Authorizing `identity:create_grant(project_id=642c18b628764e4eb5d8dfd7c458342c, user_id=c2080ebdd0174f6988fd375f5860d6e1, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.294130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805542af-02d5-46ff-b848-7800d0d983d2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.295730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de105b75-e5ff-49ee-8020-3b2278de104e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.299763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.300626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.301054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.301481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.302541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.305037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.314017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3043/6100] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:04 2022] PUT /identity/v3/projects/642c18b628764e4eb5d8dfd7c458342c/users/c2080ebdd0174f6988fd375f5860d6e1/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:04.326170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.326487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.326928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.340239 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3058/6101] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:04.344719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.373548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] MFA Rules not processed for user `c2080ebdd0174f6988fd375f5860d6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:04.375032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.483678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3044/6102] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:04.487739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2a2c-5259-488a-8199-404d86ddfed8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.488842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.502298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e127b-7176-4883-9c30-5c1b5ae1018d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.502939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.503707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.503996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.504277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.505245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.507439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.509122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.509930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.510282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.511542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.512342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.515397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.521265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:04.543618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3059/6103] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:04.544944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.548026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.558330 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3045/6104] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:04.558330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.597125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:04.664455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc10e46-3a21-460d-aaf7-53dce3100427 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.695676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff243-2bc6-4c46-92eb-8ee6e1545c26 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.707144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.710271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.710686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.711659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.712817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.714729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.731334 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3046/6105] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:04.731334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.742500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a10ca-72a6-486b-915c-d27d6e20d705 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.754145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.754145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.754145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.754145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.754614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.754696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.756708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.766066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.766389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.766680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.779086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:04.793517 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3047/6106] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:04 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:04.794483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.818106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9cb6-447f-4769-a377-bc449926f548 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.834727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.835440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.835815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.836718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.837611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.840383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.866912 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3048/6107] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:04.868918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.883840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a24b-e195-48fb-903a-5dcaec8b4761 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.892976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.895040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.895942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.896314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:04.897477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.900519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.925973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3049/6108] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:04.929666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.933452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:04.937378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:04.953578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b56a-0bce-475f-81ed-de81afb4b07a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:04.976638 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3060/6109] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:04.977720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:04.982288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:04.983117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:04.983399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:04.983702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] PATH_INFO: `/v3/projects/5618e65880fd442faa4f9c254710ad00/users/aa7ce089aecd4bb7b9cbf57ec3432605/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.029801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0597c9-4f1e-48dc-a1de-79de7194270f service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.051842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.053255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.053550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.053861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] PATH_INFO: `/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e/users/15cd4ae1144346909ed9a85c6f982923/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.057836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5618e65880fd442faa4f9c254710ad00, user_id=aa7ce089aecd4bb7b9cbf57ec3432605, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.060805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b68ede-3a2b-4150-9565-782c24b03527 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.096588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3050/6110] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:04 2022] PUT /identity/v3/projects/5618e65880fd442faa4f9c254710ad00/users/aa7ce089aecd4bb7b9cbf57ec3432605/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:05.106522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5235ff338a44dfa1f4d02a5c4dc81e, user_id=15cd4ae1144346909ed9a85c6f982923, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.112405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.125711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.126083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.133519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.169012 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3061/6111] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:04 2022] PUT /identity/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e/users/15cd4ae1144346909ed9a85c6f982923/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:05.177478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.217378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] MFA Rules not processed for user `aa7ce089aecd4bb7b9cbf57ec3432605`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:05.220928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:05.286064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:05.332871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c4a7f-1d85-4bac-b06f-3e0c2756b353 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.348336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.349232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.349522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.349799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.350545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.352229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.392515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3062/6112] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:05.393680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.419682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45598bec-f5f6-4e36-9a64-2694216fc86a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.425234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3051/6113] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:05.428554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.431652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.435461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.436100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.436811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] PATH_INFO: `/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e/users/15cd4ae1144346909ed9a85c6f982923/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.442198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5235ff338a44dfa1f4d02a5c4dc81e, user_id=15cd4ae1144346909ed9a85c6f982923, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.453366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80d856-5a7c-4383-9e2e-29f2faeb4e7c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.469187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bdb3-b9b9-4656-80cf-54f101bcd523 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.485965 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3063/6114] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:05 2022] PUT /identity/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e/users/15cd4ae1144346909ed9a85c6f982923/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:05.500407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.502196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.502485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.552746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:05.559423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] MFA Rules not processed for user `15cd4ae1144346909ed9a85c6f982923`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:05.561270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:05.601648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.602338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.602618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.602896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.603910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.608373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.660052 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3052/6115] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:05 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:05.664501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.706436 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3064/6116] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:05.718959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.722257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:05.828974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff20d5-036a-4d5c-b5de-bd9cd0e97a6a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.841228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.844503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.844812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.845116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.847204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.850370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.863762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0e72-eb5b-4143-80fd-486167294f7d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.894728 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3053/6117] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:05 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:05.898688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.921074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f3e9-3af1-4b9f-9510-bc9c1253a169 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:05.934400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.935158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.935442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.935719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:05.937839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:05.941461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:05.972157 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3054/6118] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:05.976460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:05.990091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:05.991581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:05.991581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:05.991581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.004123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959c41-09bd-4ab6-81d4-eae52f61cbe5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:06.037959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:06.046793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:06.047879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:06.048178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:06.048494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.049248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:06.051384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:06.080181 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3055/6119] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:06.084678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:06.099371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892776-46a4-4c3c-9292-6fba39f9fcff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:06.102611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:06.104306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac551-1386-4b8f-b32d-d5c38e17ad15 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:06.114375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:06.115578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:06.115901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3065/6120] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:06.116200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:06.116683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] PATH_INFO: `/v3/projects/883e9a2a193a4e35acdfc8627034bc94/users/9f34a75fbf9540b59549557dd0cd262c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.146095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e9a2a193a4e35acdfc8627034bc94, user_id=9f34a75fbf9540b59549557dd0cd262c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:06.149297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:06.178918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3056/6121] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:06 2022] PUT /identity/v3/projects/883e9a2a193a4e35acdfc8627034bc94/users/9f34a75fbf9540b59549557dd0cd262c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:06.191731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:06.192022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:06.192300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.263778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] MFA Rules not processed for user `9f34a75fbf9540b59549557dd0cd262c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:06.283195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:06.491729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3066/6122] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:06.493676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:06.647684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b507e7-e84b-435b-8234-42bba5aea6ec admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:06.653535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:06.654698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:06.654995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:06.655426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.656620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:06.658779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:06.682615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:06.715464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3057/6123] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:06.721788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:06.771248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf4352-363f-4db2-bdd9-40c8eaa6435e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:06.977049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:06.979195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:06.980257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:06.982596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:06.983928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:06.988591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:07.054102 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3067/6124] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:06 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:07.055407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:07.093718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d801dd-743c-42c7-bef4-72ae79bcdd55 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:07.113506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:07.114657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:07.117437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:07.120157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:07.121168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:07.128565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:07.154772 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3058/6125] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:07.156549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:07.173134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc186-aa42-4088-bd0b-4c9162f35bd1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:07.194702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:07.196717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:07.197217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:07.197995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] PATH_INFO: `/v3/projects/6e33edd62d664c68b846dd2806342070/users/62e59a4e3a92456e862b779213ec8fb5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:07.250276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e33edd62d664c68b846dd2806342070, user_id=62e59a4e3a92456e862b779213ec8fb5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:07.253696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:07.316146 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3068/6126] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:07 2022] PUT /identity/v3/projects/6e33edd62d664c68b846dd2806342070/users/62e59a4e3a92456e862b779213ec8fb5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:07.320525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:07.359202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393499-9374-4675-ae8b-5c41c62270cb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:07.556336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:07.557400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:07.557711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:07.557981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:07.558786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:07.562092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb2df-04f9-47f2-933d-2f9824f93dfc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:07.591161 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3059/6127] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:07.596349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:07.612695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062435-0a58-44c4-9f47-6c2556a62d53 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:07.634259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:07.635293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:07.635588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:07.635867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] PATH_INFO: `/v3/projects/6e33edd62d664c68b846dd2806342070/users/62e59a4e3a92456e862b779213ec8fb5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:07.641290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e33edd62d664c68b846dd2806342070, user_id=62e59a4e3a92456e862b779213ec8fb5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:07.649688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:07.652465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:07.689771 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3069/6128] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:07 2022] PUT /identity/v3/projects/6e33edd62d664c68b846dd2806342070/users/62e59a4e3a92456e862b779213ec8fb5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:07.825532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:07.825820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:07.829794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:07.866326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] MFA Rules not processed for user `62e59a4e3a92456e862b779213ec8fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:07.868085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:07.987650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3060/6129] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:08.013112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:08.161073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc77e2-ce36-4687-8543-d3db6e198957 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:08.166562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:08.167683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:08.168490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:08.168990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:08.264484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:08.266960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:08.288930 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3070/6130] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:09.535625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:09.642762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099064d-6ae5-486d-a08c-2450c941b395 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:09.648770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:09.650267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:09.651600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:09.651830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] PATH_INFO: `/v3/users/c2080ebdd0174f6988fd375f5860d6e1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:09.653563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2080ebdd0174f6988fd375f5860d6e1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:09.655815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:09.659807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:09.777429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2080ebdd0174f6988fd375f5860d6e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:09.793899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2080ebdd0174f6988fd375f5860d6e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:09.823876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2080ebdd0174f6988fd375f5860d6e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:09.824678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2080ebdd0174f6988fd375f5860d6e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:09.825300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bf97d519-2e0f-43e5-b1f3-e3e8705af923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2080ebdd0174f6988fd375f5860d6e1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:09.852116 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3061/6131] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:09 2022] DELETE /identity/v3/users/c2080ebdd0174f6988fd375f5860d6e1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:09.858889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:09.860503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:09.871859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:09.872155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:09.874675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:09.897582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0205cb-2454-4d78-a426-0a50f9fccb7a service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:09.927179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:09.930849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.106609 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3062/6132] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:10.111605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:10.116313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:10.116636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:10.119331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] PATH_INFO: `/v3/users/3af9776accbe457cab8de3da006d1be4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:10.122857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af9776accbe457cab8de3da006d1be4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:10.127676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:10.131075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:10.133635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.255480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af9776accbe457cab8de3da006d1be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:10.257595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af9776accbe457cab8de3da006d1be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:10.260831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:10.277847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af9776accbe457cab8de3da006d1be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:10.314760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af9776accbe457cab8de3da006d1be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:10.323221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8b0b-d65b-43e4-980a-1102c7567b4a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:10.327628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:10.328672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:10.329166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:10.329662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:10.333205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af9776accbe457cab8de3da006d1be4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:10.350769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.351018 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3071/6133] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:09 2022] DELETE /identity/v3/users/3af9776accbe457cab8de3da006d1be4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:10.351473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:10.364797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.379972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:10.383262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64314e6f-1040-4107-85bf-959c0044720c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:10.408763 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3063/6134] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:10.412311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:10.412678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:10.413401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:10.445841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:10.450962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.478988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df2afd-baf8-4996-8132-c7703a964038 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:10.484581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:10.492513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:10.493255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:10.493818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:10.494098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:10.497111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.571819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3064/6135] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:10.595580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:10.597601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:10.600950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:10.603257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:10.633919 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3072/6136] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:10.718922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a11f1-f880-4a58-aba1-8af7e2d37a18 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:10.731150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:10.732229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:10.732813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:10.733471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:10.766555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:10.775205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:10.806781 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3065/6137] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:11.782970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:11.799937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa362-f335-4416-9a52-e7a48e4de81c service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:11.827171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:11.828193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:11.828193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:11.828474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:11.837456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:11.992614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:11.997771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:12.010080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:12.011664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:12.018350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb6f34-1fdd-4936-9d89-c8607b322c07 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:12.031551 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3073/6138] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:12.033570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:12.035442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:12.041994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:12.042892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:12.043177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:12.043457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] PATH_INFO: `/v3/projects/642c18b628764e4eb5d8dfd7c458342c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:12.044780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642c18b628764e4eb5d8dfd7c458342c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:12.046887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:12.062393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbd8b-cdaf-4d4d-badc-53061f5e899f service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:12.068627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:12.069710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:12.070091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:12.070465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] PATH_INFO: `/v3/users/58ca5a1327194ea6a6c6bba2810e2b25` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:12.072298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ca5a1327194ea6a6c6bba2810e2b25)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:12.074552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:12.090077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:12.169405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ca5a1327194ea6a6c6bba2810e2b25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.172845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ca5a1327194ea6a6c6bba2810e2b25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.187838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ca5a1327194ea6a6c6bba2810e2b25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.213554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ca5a1327194ea6a6c6bba2810e2b25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.230094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ca5a1327194ea6a6c6bba2810e2b25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.236094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642c18b628764e4eb5d8dfd7c458342c', 'request_id': 'req-9161d2f7-cac9-4967-aedd-571fb2135720'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.242936 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3074/6139] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:12 2022] DELETE /identity/v3/users/58ca5a1327194ea6a6c6bba2810e2b25 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:12.254929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642c18b628764e4eb5d8dfd7c458342c', 'request_id': 'req-9161d2f7-cac9-4967-aedd-571fb2135720'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.273564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642c18b628764e4eb5d8dfd7c458342c', 'request_id': 'req-9161d2f7-cac9-4967-aedd-571fb2135720'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.298405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] The token cache is being invalidate because project 642c18b628764e4eb5d8dfd7c458342c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:12.298811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.299661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.308015 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3066/6140] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:11 2022] DELETE /identity/v3/projects/642c18b628764e4eb5d8dfd7c458342c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:12.311822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:12.313376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:12.419632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100dde-7368-4b52-a9c7-cdb69e0791e6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:12.425529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:12.426413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:12.426703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:12.426977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] PATH_INFO: `/v3/users/15cd4ae1144346909ed9a85c6f982923` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:12.428463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cd4ae1144346909ed9a85c6f982923)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:12.430622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:12.520452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cd4ae1144346909ed9a85c6f982923'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.521783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cd4ae1144346909ed9a85c6f982923'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.537690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cd4ae1144346909ed9a85c6f982923'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.564215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cd4ae1144346909ed9a85c6f982923'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.575816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-025284a1-f8df-489c-b463-04f13427ee57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cd4ae1144346909ed9a85c6f982923'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.582206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:12.583463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:12.589850 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3075/6141] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:12 2022] DELETE /identity/v3/users/15cd4ae1144346909ed9a85c6f982923 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:12.682568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:12.707625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d2f7-cac9-4967-aedd-571fb2135720 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:12.838177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:12.839146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:12.839361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:12.839638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] PATH_INFO: `/v3/projects/19bc4d4b7a084a9994b64ccde8c9e254` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:12.840913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bc4d4b7a084a9994b64ccde8c9e254)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:12.843060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:12.932928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bc4d4b7a084a9994b64ccde8c9e254', 'request_id': 'req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.946885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bc4d4b7a084a9994b64ccde8c9e254', 'request_id': 'req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.957393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bc4d4b7a084a9994b64ccde8c9e254', 'request_id': 'req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.979525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] The token cache is being invalidate because project 19bc4d4b7a084a9994b64ccde8c9e254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:12.980266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.982571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:12.985805 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3067/6142] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:12 2022] DELETE /identity/v3/projects/19bc4d4b7a084a9994b64ccde8c9e254 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:12.992124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2be39-d7c4-4a3f-b540-dd8ad747a235 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:12.992678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2be39-d7c4-4a3f-b540-dd8ad747a235 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:12.992786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2be39-d7c4-4a3f-b540-dd8ad747a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:12.999133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.001983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.019274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:13.029696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-48b2be39-d7c4-4a3f-b540-dd8ad747a235 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:13.033426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-48b2be39-d7c4-4a3f-b540-dd8ad747a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.194302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1eb3-8599-43cb-b2eb-2bf15aeb5000 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:13.201748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:13.203297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.203797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.204392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] PATH_INFO: `/v3/projects/fe9b4f7c6bf847b98feca7f1340cd68d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.206276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9b4f7c6bf847b98feca7f1340cd68d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:13.209021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:13.220891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3076/6143] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:13.223101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.224107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.224519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.261423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:13.267702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.288586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:13.292519 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3077/6144] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:13.293693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.314260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1618c9a-f604-4ad7-a425-07c92887a2c1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:13.316777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9b4f7c6bf847b98feca7f1340cd68d', 'request_id': 'req-5f29147e-5f08-44e1-9866-4b80972676f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:13.331690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9b4f7c6bf847b98feca7f1340cd68d', 'request_id': 'req-5f29147e-5f08-44e1-9866-4b80972676f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:13.349948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9b4f7c6bf847b98feca7f1340cd68d', 'request_id': 'req-5f29147e-5f08-44e1-9866-4b80972676f0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:13.375856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] The token cache is being invalidate because project fe9b4f7c6bf847b98feca7f1340cd68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:13.376157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:13.376869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5f29147e-5f08-44e1-9866-4b80972676f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:13.379140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3068/6145] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:12 2022] DELETE /identity/v3/projects/fe9b4f7c6bf847b98feca7f1340cd68d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:13.383868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.384216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.384661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.421630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:13.422894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.450838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:13.451697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.452502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.452893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.453970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:13.454482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:13.456473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:13.481453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3078/6146] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:13.485405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.489972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.530971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d046a7-92b1-4173-a44b-f7dc1a433e48 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:13.545176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:13.546326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.546950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.548192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.550794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:13.553160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272e2ea-1862-457e-92f5-8c82f526bb89 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:13.623786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3079/6147] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:13 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:13.624954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3069/6148] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:13.626650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.627160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.627758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.629288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.644233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a919-4e4f-4029-affa-c3b31bc3058c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:13.679236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:13.681178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.822762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:13.825197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:13.826844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:13.827513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:13.838789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:13.849275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:13.917460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3070/6149] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:13 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:13.928458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.932538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:13.943564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3080/6150] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:13.955266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:13.987328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121597-8929-4e8c-a667-9e63c3c3d205 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.002860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6639c-993c-4c47-bbd8-18c686c2d28c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.013412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.017718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.019450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.020546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] PATH_INFO: `/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.024987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5235ff338a44dfa1f4d02a5c4dc81e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.032169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.042252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.042964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.043248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.043527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.044273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.045977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.090045 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3081/6151] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:14.091123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.100287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:14.144536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533579dc-bd42-4d97-956d-314f8ad8735e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.148286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:14.167365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5235ff338a44dfa1f4d02a5c4dc81e', 'request_id': 'req-3fd03383-039a-4513-8b63-6b95be324264'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:14.190562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5235ff338a44dfa1f4d02a5c4dc81e', 'request_id': 'req-3fd03383-039a-4513-8b63-6b95be324264'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:14.215596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5235ff338a44dfa1f4d02a5c4dc81e', 'request_id': 'req-3fd03383-039a-4513-8b63-6b95be324264'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:14.269646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] The token cache is being invalidate because project de5235ff338a44dfa1f4d02a5c4dc81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:14.269959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:14.270759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:14.275993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.277468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.277849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.278051 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3071/6152] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:13 2022] DELETE /identity/v3/projects/de5235ff338a44dfa1f4d02a5c4dc81e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:14.278302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.279143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:14.279543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.280557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.281446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518a951-d061-44e2-8a3d-bab0d2cb4065 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.284638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.299889 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3082/6153] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:14.299889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.299889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.299889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.322992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03383-039a-4513-8b63-6b95be324264 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.328854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.330186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.330476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.330754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.331596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.333978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.345455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:14.346995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.355866 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3072/6154] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:14.357101 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3083/6155] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:14.357444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.359170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.361231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.381819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c13476-0473-48fe-8b0a-c0452c519dff None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.384679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf8d1-ef18-4497-9cbb-502d0d9997ad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.388371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.389498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.389836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.390126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f/users/75597b592cd74155892958c5de989c57/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.392381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.393480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.394064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.394674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.395600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.398235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288a08d-abe8-4df2-aede-f7828308fcb1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.420190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14937708696448d9b414d5dbbe55377f, user_id=75597b592cd74155892958c5de989c57, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.423565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.444760 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3073/6156] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:14.446768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78ba4-51de-4d30-b2d4-3e73db550b46 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.447127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78ba4-51de-4d30-b2d4-3e73db550b46 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.447521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78ba4-51de-4d30-b2d4-3e73db550b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.458276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3084/6157] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:14 2022] PUT /identity/v3/projects/14937708696448d9b414d5dbbe55377f/users/75597b592cd74155892958c5de989c57/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:14.461303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.486759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8ad78ba4-51de-4d30-b2d4-3e73db550b46 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:14.488565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8ad78ba4-51de-4d30-b2d4-3e73db550b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.594237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3074/6158] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:14.595892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.596183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.596493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.604274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d4d72-ea90-4820-9817-abcd7561d01e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.609380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.610146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.610439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.610720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.611525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.613583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.626970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] MFA Rules not processed for user `75597b592cd74155892958c5de989c57`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:14.628486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.641206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3085/6159] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:14.644121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.665576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574551df-8680-4fb1-af0c-71425bc8b0f3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.674277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.675550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.676985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.677589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.678670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:14.679199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.684856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.706392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3086/6160] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:14.708141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.736770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae462b-1ab9-4492-a530-ed8f4d191c76 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.748516 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3075/6161] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:14.749539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.749707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.750527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.750814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.751089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.751837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.753517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.763553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6938a-8291-4430-9367-c3b08bc0638a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.768749 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3087/6162] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:14.769655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.775226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:14.778146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.779704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.779998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.780276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.781087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.783655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:14.834869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3076/6163] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:14 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:14.835746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:14.843856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:14.860511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:14.957326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0322-87c4-4b8c-95d9-7c4e4cf037a1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.961837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998aa60-4950-47bc-83f3-f52dbc5bb444 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:14.978353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:14.979066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:14.979513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:14.980246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:14.981036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:14.989717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.010573 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3077/6164] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:15.010573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.041553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe616a8-0d6e-4732-ab91-4b7df02581b5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.048581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.048795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.049061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.049339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.050037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.054818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.106092 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3078/6165] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:15 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:15.107248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.119368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc980-c22e-4a9c-9006-930e37ee54d8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.124870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.125785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.126067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.126347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] PATH_INFO: `/v3/projects/1df9f09e5c7c4f21aca1705769d3c84c/users/99a45af5dbf8442d9801f494b794e880/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.146367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.147697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.148144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.148613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.155255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df9f09e5c7c4f21aca1705769d3c84c, user_id=99a45af5dbf8442d9801f494b794e880, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.160966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.191412 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3079/6166] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:15 2022] PUT /identity/v3/projects/1df9f09e5c7c4f21aca1705769d3c84c/users/99a45af5dbf8442d9801f494b794e880/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:15.191978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.296490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.308761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed85bc1-6544-4602-920c-101b61b65c57 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.352576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3088/6167] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:15.357767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56875f5-d470-4c50-9445-53b3ef960afa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.359998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.360292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.360604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.373054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.376376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.377005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.377684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.378743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.380592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962ed-a8ea-4652-8120-ced34420d16f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.389633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:15.390272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:15.399393 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3080/6168] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:15.408840 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3089/6169] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:15.409772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.410945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.413364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.413985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.417721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3081/6170] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:15:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:15:15.422985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:15:15.437642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a6ad1-10e2-4271-83f0-3cd051a7248a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.450196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.451224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.456151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.458650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.460055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.465950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.495444 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3090/6171] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:15.496703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.501237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:15.540845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:15.592809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.703947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714390-705d-439a-80be-3ef8863cf9f5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.715094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75597b592cd74155892958c5de989c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14937708696448d9b414d5dbbe55377f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.716820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.717174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.717945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.720925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:15.722980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorizing `identity:get_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.733231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f59d2-4c1e-43a7-8637-1570407b5588 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.747967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.751259 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3082/6172] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:15:15 2022] GET /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 365 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:15.754486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.755358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.756301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.756842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.757321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.784900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad0574-776a-4d9c-8358-b2ba115d954d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.794709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.796718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4347-cdc0-4a1c-845f-3627298f6a6a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.800901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:15.811454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.811770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.812182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] PATH_INFO: `/v3/projects/8a3b3e78330c4082ae1e8659fe8f3282/users/395a7f3c67124a738eedb4d4eb834329/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.833057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3091/6173] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:15.837523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.838485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.840082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.845365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3b3e78330c4082ae1e8659fe8f3282, user_id=395a7f3c67124a738eedb4d4eb834329, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:15.849274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd8060-5731-4193-9bbc-9c108b0afdc4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:15.849506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3092/6174] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:15:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:15:15.857620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:15:15.874127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3083/6175] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:15 2022] PUT /identity/v3/projects/8a3b3e78330c4082ae1e8659fe8f3282/users/395a7f3c67124a738eedb4d4eb834329/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:15.889638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf029-b922-48b8-800a-8a329a6e6b1d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:15.890027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf029-b922-48b8-800a-8a329a6e6b1d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:15.890219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf029-b922-48b8-800a-8a329a6e6b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:15.896548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:15.922075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6b357-1230-45e7-a1a6-c50dae3be234 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:15.949993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e5cbf029-b922-48b8-800a-8a329a6e6b1d None None] MFA Rules not processed for user `395a7f3c67124a738eedb4d4eb834329`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:15.951895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e5cbf029-b922-48b8-800a-8a329a6e6b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:16.092806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75597b592cd74155892958c5de989c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14937708696448d9b414d5dbbe55377f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.095638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.096393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.096555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.099328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorizing `identity:get_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.104684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.123397 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3093/6176] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:15:15 2022] GET /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 365 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:16.146676 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3084/6177] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:16.158075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.227299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.227606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.228118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.231424 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3085/6178] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:15:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 21:15:16.247222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:15:16.249280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:16.275435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c366e-ac36-4043-8a79-77eaf83c01a5 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.288710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.289405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.291429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.291740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.292474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.294434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.362940 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3094/6179] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:16 2022] POST /identity/v3/projects => generated 391 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:16.367133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.425948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:16.447060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.473718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983214-99fb-4a7c-b974-b191d7874e4e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.515402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298430-6234-4df8-aed7-9eb13afe48e0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.521901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.523072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.523690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.524116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.525375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.527853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.563517 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3095/6180] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:16 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:16.564925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.583667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebcc8a-e980-44a0-8e38-846e07c08786 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.623225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.630479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.631056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.632762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.640164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.643027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333739-65f5-4261-8ddf-af47c1e69366 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.643353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75597b592cd74155892958c5de989c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14937708696448d9b414d5dbbe55377f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.644459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.644708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.644993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.646364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorizing `identity:get_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.647808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.652127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3086/6181] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:15:16 2022] GET /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 365 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:15:16.677080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:16.713589 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3096/6182] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:16.717125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.720581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.721307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.721849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.723948 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3097/6183] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:15:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:15:16.733117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:15:16.739797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff34334-7df5-402f-bebc-c21539b35484 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.755916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.756874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.757164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.757458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] PATH_INFO: `/v3/projects/ddfe02f2c9e2453fb781860901a8d94a/users/c8ee402d8ab444099f2a587268d12cfd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.819598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfe02f2c9e2453fb781860901a8d94a, user_id=c8ee402d8ab444099f2a587268d12cfd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.835056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.843128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.855079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df327-6200-4f12-898e-c07eabc8d0a8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:16.861195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75597b592cd74155892958c5de989c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14937708696448d9b414d5dbbe55377f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:16.862087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.862370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.862644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.865669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorizing `identity:get_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:16.865839 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3087/6184] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:16 2022] PUT /identity/v3/projects/ddfe02f2c9e2453fb781860901a8d94a/users/c8ee402d8ab444099f2a587268d12cfd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:16.867620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565facc-7dbe-4cca-8f55-e0aaa2a60070 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:16.869659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:16.874050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3098/6185] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:15:16 2022] GET /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 365 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:15:16.925998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:16.926299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:16.927154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:16.934253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3099/6186] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:15:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 21:15:16.951774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:15:17.047398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ee4c-d68c-4790-b8cb-e0f0b2c95d8c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.057628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.058348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.060630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.060933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.062925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.067893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.100174 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3088/6187] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:17.100174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.101013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.105942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.138414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284bc94-c56f-4e3f-9593-50de8a8c6d25 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.147470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.148383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.151184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.151481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] PATH_INFO: `/v3/users/aa7ce089aecd4bb7b9cbf57ec3432605` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.153761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7ce089aecd4bb7b9cbf57ec3432605)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.158374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.206278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756d0b-c95d-4144-a593-63477f677dbd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.218141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75597b592cd74155892958c5de989c57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14937708696448d9b414d5dbbe55377f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.220177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.222010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.223114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.227287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorizing `identity:get_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.233646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.239080 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3100/6188] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:15:16 2022] GET /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 365 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:15:17.240946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.253651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7ce089aecd4bb7b9cbf57ec3432605'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.268668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca51b-9113-415c-b4f4-5e34b42c52cc tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.275771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7ce089aecd4bb7b9cbf57ec3432605'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.285595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.296136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.298766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.299067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] PATH_INFO: `/v3/projects/ddfe02f2c9e2453fb781860901a8d94a/users/c8ee402d8ab444099f2a587268d12cfd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.303409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfe02f2c9e2453fb781860901a8d94a, user_id=c8ee402d8ab444099f2a587268d12cfd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.308489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7ce089aecd4bb7b9cbf57ec3432605'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.309392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7ce089aecd4bb7b9cbf57ec3432605'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.310272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7ce089aecd4bb7b9cbf57ec3432605'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.311923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:17.312854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f173b1-719a-4687-8967-f6f21f078e7d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.334830 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3089/6189] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:17 2022] DELETE /identity/v3/users/aa7ce089aecd4bb7b9cbf57ec3432605 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:17.334830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.336784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.343983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3101/6190] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:17 2022] PUT /identity/v3/projects/ddfe02f2c9e2453fb781860901a8d94a/users/c8ee402d8ab444099f2a587268d12cfd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:17.345559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2eae-0dea-4dc1-a430-57991357f6ef None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.346225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2eae-0dea-4dc1-a430-57991357f6ef None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.346817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2eae-0dea-4dc1-a430-57991357f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.371690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-de3f2eae-0dea-4dc1-a430-57991357f6ef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:17.373797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de3f2eae-0dea-4dc1-a430-57991357f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.391826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:17.464718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8e4f-27eb-4f07-b695-7a2ca6f86466 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.470355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.471256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.471542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.471864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] PATH_INFO: `/v3/users/75597b592cd74155892958c5de989c57` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.473186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75597b592cd74155892958c5de989c57)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.475126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.482784 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3102/6191] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:17.485116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee7dd-0b8f-49e4-9874-0a54864032d6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.485411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee7dd-0b8f-49e4-9874-0a54864032d6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.485693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee7dd-0b8f-49e4-9874-0a54864032d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.533444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f0fee7dd-0b8f-49e4-9874-0a54864032d6 None None] MFA Rules not processed for user `c8ee402d8ab444099f2a587268d12cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:17.534642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0fee7dd-0b8f-49e4-9874-0a54864032d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.562962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75597b592cd74155892958c5de989c57'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.576656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75597b592cd74155892958c5de989c57'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.591092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75597b592cd74155892958c5de989c57'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.594437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75597b592cd74155892958c5de989c57'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.597043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75597b592cd74155892958c5de989c57'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:17.644882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3090/6192] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:17 2022] DELETE /identity/v3/users/75597b592cd74155892958c5de989c57 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:17.645691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.649117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.653116 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3103/6193] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:17.655269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.655914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.656880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.693605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:17.695054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.784320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d3f9-90e4-4e1f-9eb6-87144b11d87b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:17.790015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:17.791225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:17.791995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:17.792908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:17.795534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.846856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:17.889462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3104/6194] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:17.891681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.894215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:17.951277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:17.957758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:17.979663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:17.991255 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3091/6195] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:17.992154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:17.995936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:18.013294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214615-0e81-443b-8137-a1df277ec881 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:18.023291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:18.025160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:18.025733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:18.026214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:18.029731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d246a-af0c-4377-bdce-26084ca560fa service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:18.041876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:18.045409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:18.046436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:18.047815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:18.073863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:18.076587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:18.106066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3092/6196] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:18.150707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:18.152884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:18.166112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3105/6197] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:18.228574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:18.231314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:18.252792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20246f1c-9689-4dc4-bf9f-7470a1b930cc service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:18.258128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:18.259611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:18.260245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:18.260869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:18.263496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:18.378908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:18.381445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:18.401687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3093/6198] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:19.709712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:19.711185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:19.743105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918f6d-f7f5-4338-8b41-2dc1ee970801 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:19.751006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:19.753290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:19.753986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:19.755585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] PATH_INFO: `/v3/projects/5618e65880fd442faa4f9c254710ad00` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:19.759659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5618e65880fd442faa4f9c254710ad00)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:19.762642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:19.843687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5618e65880fd442faa4f9c254710ad00', 'request_id': 'req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:19.856245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5618e65880fd442faa4f9c254710ad00', 'request_id': 'req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:19.866827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5618e65880fd442faa4f9c254710ad00', 'request_id': 'req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:19.887282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] The token cache is being invalidate because project 5618e65880fd442faa4f9c254710ad00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:19.887583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:19.889037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:19.891359 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3106/6199] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:19 2022] DELETE /identity/v3/projects/5618e65880fd442faa4f9c254710ad00 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:19.895481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:19.916129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbea9d-12b1-406d-aae8-f184a9882dbf service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:19.993252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:19.994191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:19.994471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:19.994746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] PATH_INFO: `/v3/users/9f34a75fbf9540b59549557dd0cd262c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:19.996661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f34a75fbf9540b59549557dd0cd262c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:19.997460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:19.998824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:20.004591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:20.021891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117fc3-9a6b-4795-a6d0-37ad654ce9ae admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:20.029695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:20.030971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.031671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.032190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] PATH_INFO: `/v3/projects/14937708696448d9b414d5dbbe55377f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.040893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14937708696448d9b414d5dbbe55377f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:20.044076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:20.080690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:20.083794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f34a75fbf9540b59549557dd0cd262c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.115359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f34a75fbf9540b59549557dd0cd262c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.165526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f34a75fbf9540b59549557dd0cd262c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.182813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f34a75fbf9540b59549557dd0cd262c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.184840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7fdedcb3-f114-4aae-88a6-ff849a8c9afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f34a75fbf9540b59549557dd0cd262c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.193050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14937708696448d9b414d5dbbe55377f', 'request_id': 'req-b5aac3a2-f81f-4a83-84f9-307ff79cf546'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.214159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14937708696448d9b414d5dbbe55377f', 'request_id': 'req-b5aac3a2-f81f-4a83-84f9-307ff79cf546'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.232162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14937708696448d9b414d5dbbe55377f', 'request_id': 'req-b5aac3a2-f81f-4a83-84f9-307ff79cf546'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.235437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3094/6200] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:19 2022] DELETE /identity/v3/users/9f34a75fbf9540b59549557dd0cd262c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:20.264738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:20.275564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] The token cache is being invalidate because project 14937708696448d9b414d5dbbe55377f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:20.275564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.277295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5aac3a2-f81f-4a83-84f9-307ff79cf546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:20.283943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3107/6201] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:19 2022] DELETE /identity/v3/projects/14937708696448d9b414d5dbbe55377f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:20.290140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.290140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.294610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.350601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:20.357034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:20.491103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.491382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.491735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.491852 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3095/6202] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:20.557634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:20.559107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:20.596533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3108/6203] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:20.600569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:20.613320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea85cf7-50c5-4ae2-a0a4-ad01a09c9776 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:20.624769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:20.625465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.627875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.628182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.631252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:20.631629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:20.636459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:20.662814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:20.663147 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3096/6204] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:15:20.678930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3218a-40ee-4ad0-a494-ef3c1c952795 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:20.690319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:20.691012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.691293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.691571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.692271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:20.696740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:20.754807 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3109/6205] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:20 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:20.756580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:20.772984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85b4e4-a22e-482a-ba2c-a349cbf5f7bd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:20.909661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:20.910669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:20.911135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:20.911562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:20.914204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:20.922967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:20.963577 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3097/6206] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:20 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:20.963878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:20.983370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c28a-8180-45d1-bb87-11fd4ade8195 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.005495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.006218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.006521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.007016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.009266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.010935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:21.035606 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3110/6207] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:21.039218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.053228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e890-5cfb-4202-8d85-bf403bc5e9ae admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.061804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.063159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.063720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.064253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.065301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.067557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497b7c-b8d5-45df-8a3f-72062844a085 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:21.089181 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3098/6208] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:21.094173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.124266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe17a3-0e3d-4c2d-b212-5367433df59e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.140184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.141378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.141819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.142351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] PATH_INFO: `/v3/projects/bb86bb4e97db468ba38cdd87b06fb0ee/users/200bf410e9ee4ebda25e787db0d3d9a3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.185856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb86bb4e97db468ba38cdd87b06fb0ee, user_id=200bf410e9ee4ebda25e787db0d3d9a3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.197519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:21.231933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3111/6209] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:21 2022] PUT /identity/v3/projects/bb86bb4e97db468ba38cdd87b06fb0ee/users/200bf410e9ee4ebda25e787db0d3d9a3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:21.238556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.238921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.239214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.282909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:21.284182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:21.307321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.309428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:21.348385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:21.442760 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3099/6210] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:21.485964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9725-05c9-4f9c-94e6-db66d0b565a8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.488061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.491008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:21.501372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.502503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.502963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.503581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] PATH_INFO: `/v3/projects/883e9a2a193a4e35acdfc8627034bc94` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.505456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] RBAC: Authorizing `identity:delete_project(project_id=883e9a2a193a4e35acdfc8627034bc94)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.507595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:21.604906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf76a-f44d-41dd-974f-0461bd27955a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.613954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.615514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.615854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.616166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.636778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.669437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:21.669907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883e9a2a193a4e35acdfc8627034bc94', 'request_id': 'req-45d4fc3e-74f5-4f60-98bc-711509a3928c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:21.690700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883e9a2a193a4e35acdfc8627034bc94', 'request_id': 'req-45d4fc3e-74f5-4f60-98bc-711509a3928c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:21.699119 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3100/6211] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:21.715270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883e9a2a193a4e35acdfc8627034bc94', 'request_id': 'req-45d4fc3e-74f5-4f60-98bc-711509a3928c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:21.746276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] The token cache is being invalidate because project 883e9a2a193a4e35acdfc8627034bc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:21.746276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:21.746276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:21.750642 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3112/6212] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:21 2022] DELETE /identity/v3/projects/883e9a2a193a4e35acdfc8627034bc94 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:21.755137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.768615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab6b0-009a-46a6-947e-6f695a9cfb4d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:21.853206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:21.854762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:21.942922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:21.951531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:21.952546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:21.952838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:21.953152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] PATH_INFO: `/v3/users/62e59a4e3a92456e862b779213ec8fb5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:21.955582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e59a4e3a92456e862b779213ec8fb5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:21.959814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:22.100855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e59a4e3a92456e862b779213ec8fb5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:22.108058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4fc3e-74f5-4f60-98bc-711509a3928c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:22.131081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e59a4e3a92456e862b779213ec8fb5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:22.132125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:22.135273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:22.135832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:22.136660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:22.144478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:22.171154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e59a4e3a92456e862b779213ec8fb5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:22.173476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e59a4e3a92456e862b779213ec8fb5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:22.175440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cc377aad-9a19-45fe-9609-73c051c2bbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e59a4e3a92456e862b779213ec8fb5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:22.187358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:22.204481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:22.207012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9ef2-3f2f-477c-9916-d146c2f33c4a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:22.220803 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3101/6213] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:21 2022] DELETE /identity/v3/users/62e59a4e3a92456e862b779213ec8fb5 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:22.237467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3113/6214] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:22.613120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:22.613417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:22.613789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:22.701036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] MFA Rules not processed for user `200bf410e9ee4ebda25e787db0d3d9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:22.705631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:22.858507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3102/6215] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:22.874566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:22.875427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:22.875427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:22.897699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] MFA Rules not processed for user `200bf410e9ee4ebda25e787db0d3d9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:22.899006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:22.909950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3114/6216] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:22.923309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:22.925158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.020864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:23.022723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.068780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c90d0-0193-4d8c-a548-95f62d087ccc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:23.075219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:23.076622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.077808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.077808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.089166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:23.090983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5945527-2550-4460-95b7-2ac5d68ec3a5 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:23.113658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3103/6217] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:23.238994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4f8e6-f091-4af0-ab85-831755fef82b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:23.253320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:23.254637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.255409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.255833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] PATH_INFO: `/v3/projects/6e33edd62d664c68b846dd2806342070` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.260219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e33edd62d664c68b846dd2806342070)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:23.263712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:23.398041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e33edd62d664c68b846dd2806342070', 'request_id': 'req-41f6216a-10af-4efd-8811-e855d6871716'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.429618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e33edd62d664c68b846dd2806342070', 'request_id': 'req-41f6216a-10af-4efd-8811-e855d6871716'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.452325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e33edd62d664c68b846dd2806342070', 'request_id': 'req-41f6216a-10af-4efd-8811-e855d6871716'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.479593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] The token cache is being invalidate because project 6e33edd62d664c68b846dd2806342070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:23.480696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.481902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.486085 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3115/6218] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:23 2022] DELETE /identity/v3/projects/6e33edd62d664c68b846dd2806342070 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:23.491215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70de2-9ee1-4ba2-ab69-9e999777aa17 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.491862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70de2-9ee1-4ba2-ab69-9e999777aa17 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.492360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70de2-9ee1-4ba2-ab69-9e999777aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.518629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0ec70de2-9ee1-4ba2-ab69-9e999777aa17 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:23.520706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0ec70de2-9ee1-4ba2-ab69-9e999777aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.537143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:23.538922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.645958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:23.651632 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3104/6219] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:23.660730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.661029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.661312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.677753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6216a-10af-4efd-8811-e855d6871716 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:23.678861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:23.685657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:23.687897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.688267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.688649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] PATH_INFO: `/v3/users/395a7f3c67124a738eedb4d4eb834329` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.690183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395a7f3c67124a738eedb4d4eb834329)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:23.692403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:23.694779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:23.696022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.721649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3105/6220] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:23.726383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:23.743328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428a75-2605-48cd-805a-25a81fa3cc00 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:23.761340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:23.762053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.762401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.762593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.763319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:23.763611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:23.765294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:23.767354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395a7f3c67124a738eedb4d4eb834329'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.768554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395a7f3c67124a738eedb4d4eb834329'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.781332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395a7f3c67124a738eedb4d4eb834329'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.796195 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3106/6221] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:23.800224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395a7f3c67124a738eedb4d4eb834329'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.801587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:23.803485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.809881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-588cdb2e-43bd-4a6d-91a3-95fa90487ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395a7f3c67124a738eedb4d4eb834329'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:23.826839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0ce7f-ca75-48d9-99e7-0677755bda16 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:23.827847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3116/6222] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:23 2022] DELETE /identity/v3/users/395a7f3c67124a738eedb4d4eb834329 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:23.832602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.833646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.835580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.859689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:23.861302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:23.928381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:23.929295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:23.929676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:23.930048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:23.931014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:23.933528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:23.957638 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3117/6223] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:23.971008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3107/6224] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:23 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:23.974924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:23.985767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95668348-bacf-49c3-a6c1-746b7f8729cc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.037970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:24.041240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:24.065640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.066632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.067106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.067540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.068530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.070927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.093521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:24.105347 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3118/6225] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:23 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:24.110332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:24.123829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0b210-cfb2-4f74-8393-9126aa751808 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.130279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.131576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.132076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.132773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.133926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.136939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.143281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668487f-9c38-4484-9cf3-bc47d3191384 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.147763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.148584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.149180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.149631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.152835 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3119/6226] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:24.157541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:24.170174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.171960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547eda-c829-4bb4-8111-d9e9d6866720 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.173532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d452085-256e-4384-b22e-edb3f02a2540 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.181818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.182918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.183409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.184017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.185186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.187167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.207675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3120/6227] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:24.211068 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3108/6228] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:24.212235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:24.234008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68abd6b-75d1-4b44-b921-caee0ea72b53 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.240391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.241552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.242294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.242294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] PATH_INFO: `/v3/projects/731db346121f4334bd2e30ba916e85be/users/83af31935cce49c5b97d9dd2a4774e73/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.259505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=731db346121f4334bd2e30ba916e85be, user_id=83af31935cce49c5b97d9dd2a4774e73, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.264624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.284701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3121/6229] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:24 2022] PUT /identity/v3/projects/731db346121f4334bd2e30ba916e85be/users/83af31935cce49c5b97d9dd2a4774e73/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:24.290932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.291415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.291880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.312580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:24.313865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:24.411449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3109/6230] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:24.463545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:24.473465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:24.584645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19cfb9-23b9-498c-b7b1-55ced575329b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:24.591653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:24.592563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:24.592857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:24.593194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:24.607717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:24.611159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:24.646389 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3122/6231] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:25.064000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:25.066909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:25.126022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2daca5-b1fb-4bd9-9794-1026af12b07a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:25.138646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:25.139981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:25.140465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:25.141139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] PATH_INFO: `/v3/users/200bf410e9ee4ebda25e787db0d3d9a3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:25.143539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=200bf410e9ee4ebda25e787db0d3d9a3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:25.149493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:25.189366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:25.279827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200bf410e9ee4ebda25e787db0d3d9a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.294394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200bf410e9ee4ebda25e787db0d3d9a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.319733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200bf410e9ee4ebda25e787db0d3d9a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.320592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200bf410e9ee4ebda25e787db0d3d9a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.321527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200bf410e9ee4ebda25e787db0d3d9a3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.379449 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3110/6232] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:25 2022] DELETE /identity/v3/users/200bf410e9ee4ebda25e787db0d3d9a3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:25.488778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:25.490783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:25.513142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f673a-c39f-4d93-a4a4-23bb09662681 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:25.672455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:25.680442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:25.681101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:25.681494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] PATH_INFO: `/v3/projects/8a3b3e78330c4082ae1e8659fe8f3282` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:25.683583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3b3e78330c4082ae1e8659fe8f3282)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:25.685694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:25.779844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3b3e78330c4082ae1e8659fe8f3282', 'request_id': 'req-91c80464-fe97-4f8f-a650-9beec92aa0ec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.799307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3b3e78330c4082ae1e8659fe8f3282', 'request_id': 'req-91c80464-fe97-4f8f-a650-9beec92aa0ec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.802400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:25.810134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3b3e78330c4082ae1e8659fe8f3282', 'request_id': 'req-91c80464-fe97-4f8f-a650-9beec92aa0ec'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.833546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] The token cache is being invalidate because project 8a3b3e78330c4082ae1e8659fe8f3282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:25.833798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.838598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-91c80464-fe97-4f8f-a650-9beec92aa0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:25.841736 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3123/6233] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:25 2022] DELETE /identity/v3/projects/8a3b3e78330c4082ae1e8659fe8f3282 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:25.845537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:25.847341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:25.869340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ea00-762a-4639-ae53-7b24524a29b8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:26.029388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:26.030319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:26.030605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:26.030877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] PATH_INFO: `/v3/users/c8ee402d8ab444099f2a587268d12cfd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:26.032240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ee402d8ab444099f2a587268d12cfd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:26.034228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:26.104241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ee402d8ab444099f2a587268d12cfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.116388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ee402d8ab444099f2a587268d12cfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.135547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ee402d8ab444099f2a587268d12cfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.137247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ee402d8ab444099f2a587268d12cfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.138580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ee402d8ab444099f2a587268d12cfd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.159149 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3111/6234] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:25 2022] DELETE /identity/v3/users/c8ee402d8ab444099f2a587268d12cfd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:26.509565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:26.518102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:26.520193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:26.566224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] MFA Rules not processed for user `83af31935cce49c5b97d9dd2a4774e73`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:26.567662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:26.659800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:26.661383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:26.668558 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3124/6235] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:26.682634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:26.685636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:26.686636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:26.782714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1122-8c0d-46ec-b797-62dfc98cd393 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:26.788969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:26.790223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:26.790672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:26.791102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] PATH_INFO: `/v3/projects/ddfe02f2c9e2453fb781860901a8d94a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:26.792625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfe02f2c9e2453fb781860901a8d94a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:26.794968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:26.829487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c7d3-8469-42f5-820e-2ddf67fed15c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:26.836825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:26.840333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:26.840663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:26.840955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:26.854471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:26.856127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc52e91-8b42-4c14-9fb0-617853ec6506 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:26.865788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3125/6236] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:26.866332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfe02f2c9e2453fb781860901a8d94a', 'request_id': 'req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.877438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfe02f2c9e2453fb781860901a8d94a', 'request_id': 'req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.885010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfe02f2c9e2453fb781860901a8d94a', 'request_id': 'req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.897341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] The token cache is being invalidate because project ddfe02f2c9e2453fb781860901a8d94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:26.897664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.898355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e64c10cf-f4a0-47a0-b68a-d0f2d47119af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:26.900075 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3112/6237] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:26 2022] DELETE /identity/v3/projects/ddfe02f2c9e2453fb781860901a8d94a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:26.905423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:26.906102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:26.906697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:26.928904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:26.930440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.029182 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3126/6238] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:27.039434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.040023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.045362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.069881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:27.071514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.082105 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3113/6239] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:27.087665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.100135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5366-dedb-4dd4-90f2-a873552b4b62 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.107007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.107694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.107978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.108256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.109034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:27.109483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.111122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.126783 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3127/6240] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:27.134762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.161370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a4275-f081-41c0-8425-f63af1d19d97 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.175834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.177365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.178157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.178650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.179952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.189765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.237872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3114/6241] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:27.242173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.253500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa002d1-1959-4908-a66a-25bffdcdc13d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.258257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:27.356304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.357125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.357421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.358358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.359153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.362003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.368548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.370454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.393021 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3128/6242] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/users => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:27.397440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.406301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d118588-5f8c-47d3-b657-46bf8887249c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.410714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1412-1c6b-4f0e-b264-c5e28baecd15 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.413570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.415265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.415857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.416288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] PATH_INFO: `/v3/projects/bb86bb4e97db468ba38cdd87b06fb0ee` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.417904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb86bb4e97db468ba38cdd87b06fb0ee)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.421155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.425306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.426713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.427011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.427346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.428479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.429798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.452538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3129/6243] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:27.466471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.484346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f91ae-652f-4f7b-9ef3-14fa79a849d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.489433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.490108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.490397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.490680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.491408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.493584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.508459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3130/6244] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:27.513827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.533956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb86bb4e97db468ba38cdd87b06fb0ee', 'request_id': 'req-05f2a822-010f-46bb-9af7-f63575551a74'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:27.538572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bef84-d822-465f-bf5e-65b8ab2732f9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.552840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb86bb4e97db468ba38cdd87b06fb0ee', 'request_id': 'req-05f2a822-010f-46bb-9af7-f63575551a74'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:27.563978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:27.566508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb86bb4e97db468ba38cdd87b06fb0ee', 'request_id': 'req-05f2a822-010f-46bb-9af7-f63575551a74'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:27.594755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] The token cache is being invalidate because project bb86bb4e97db468ba38cdd87b06fb0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:27.595421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:27.598192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05f2a822-010f-46bb-9af7-f63575551a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:27.601153 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3115/6245] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:27 2022] DELETE /identity/v3/projects/bb86bb4e97db468ba38cdd87b06fb0ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:27.610418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a85ad-8dd8-403a-bdda-4a4ced3506a4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.611339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a85ad-8dd8-403a-bdda-4a4ced3506a4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.611792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a85ad-8dd8-403a-bdda-4a4ced3506a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.614861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.616021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.616466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.616842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] PATH_INFO: `/v3/projects/a802a9436b9b434983af9ea0e92d58e6/users/b9a310bcaa2b4cc7a6497858b7e6d552/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.632975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-438a85ad-8dd8-403a-bdda-4a4ced3506a4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:27.634350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-438a85ad-8dd8-403a-bdda-4a4ced3506a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.636146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a802a9436b9b434983af9ea0e92d58e6, user_id=b9a310bcaa2b4cc7a6497858b7e6d552, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.640144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5916a-14c5-4154-892a-48dbeb4a543b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.650777 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3116/6246] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:27.654393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.654785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.655165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.662741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3131/6247] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:27 2022] PUT /identity/v3/projects/a802a9436b9b434983af9ea0e92d58e6/users/b9a310bcaa2b4cc7a6497858b7e6d552/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:27.673189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.673478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.674308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.680831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:27.682148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.718979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] MFA Rules not processed for user `b9a310bcaa2b4cc7a6497858b7e6d552`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:27.720470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.790007 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3117/6248] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:27.794510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.813337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3335a7f-733d-46d8-890e-c077d344b4d2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.822877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:27.828059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.828882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.829317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.829506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.831949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:27.832589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.834707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.861268 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3132/6249] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:27.864755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.866943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:27.869783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3118/6250] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:15:27.873860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.893254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ac78-70fd-45e0-aa6e-efde9206d641 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.894730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aede-2dee-4260-85be-925a4aa7b222 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:27.899039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.900077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.900491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.900771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.901577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.904377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.909357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:27.910063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:27.910355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:27.910627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:27.911339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:27.913349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:27.950658 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3133/6251] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/projects => generated 399 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:27.956696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:27.967127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3119/6252] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:27.971079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.081941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81464ce5-5b8f-4bea-882f-5c3270709ebd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.111606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfd4c0-f673-4d7d-8f64-4f274484b382 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.126337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.127490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.127995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.128493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.129398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.131553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.180114 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3120/6253] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:28.184153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.206517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb0655-d4d9-4557-bd14-fd8146dcbac8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.217629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.217629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.217629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.218135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.218974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.219125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.219704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.219979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.220268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.225466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.226024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.229112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.249212 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3121/6254] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:28.252920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.271783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07a563-2151-45a4-ac8b-784b99d1df1c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.283856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.284593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.285621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.285621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.287332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.287490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3134/6255] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:27 2022] POST /identity/v3/users => generated 306 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:28.288548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.291844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.318367 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3122/6256] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:28.322720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434342fa-6f97-45cd-8698-ef8d1e5ae8b7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.324109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.336221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.337027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.337666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.337958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.338707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.341124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.347469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de81b-ff8d-48a7-815e-2d556d486463 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.360708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.372700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.372700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.372700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] PATH_INFO: `/v3/projects/041615c7a84b47f88e21c6a4e19dd7ec/users/c845f86f1b6244f7a53996329294f2cd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.373178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3135/6257] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:28.379671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.396177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041615c7a84b47f88e21c6a4e19dd7ec, user_id=c845f86f1b6244f7a53996329294f2cd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.399102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85070-3999-4640-86f3-51a8f22b2263 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.401898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:28.404919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac181ea-0167-4899-bed7-28d28df97b29 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.413791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.418038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.418685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.419261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] PATH_INFO: `/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660/users/d2e6f9bf15124eaf86ef2824958bf727/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.421997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3123/6258] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:28 2022] PUT /identity/v3/projects/041615c7a84b47f88e21c6a4e19dd7ec/users/c845f86f1b6244f7a53996329294f2cd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:28.423848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.424232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.425174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.443783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bf2cec381b4f77a4d73f0ad4190660, user_id=d2e6f9bf15124eaf86ef2824958bf727, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.446264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] MFA Rules not processed for user `83af31935cce49c5b97d9dd2a4774e73`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:28.447593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:28.449086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00755-d3db-4e68-894e-733d040cc4b6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.475446 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3136/6259] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:28 2022] PUT /identity/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660/users/d2e6f9bf15124eaf86ef2824958bf727/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:28.478261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd3d14-09c6-4ccd-8475-1c75219d88fe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.479332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd3d14-09c6-4ccd-8475-1c75219d88fe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.479616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd3d14-09c6-4ccd-8475-1c75219d88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.524385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-accd3d14-09c6-4ccd-8475-1c75219d88fe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:28.529153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-accd3d14-09c6-4ccd-8475-1c75219d88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:28.543807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3124/6260] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:28.544746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.571979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:28.650702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d5e-139f-4a1c-a951-c8eeaff3f09d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.679690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3137/6261] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:28.682357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.682673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.682958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.729904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:28.731383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:28.766363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.767067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.767354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.767632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.768539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.770180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.797005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3125/6262] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:28.797972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.803885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:28.860374 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3138/6263] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:28.860374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:28.869297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bfc21-647b-49d3-b23a-ae51a05a4c1a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.875544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:28.877014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.877014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.877014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] PATH_INFO: `/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660/users/d2e6f9bf15124eaf86ef2824958bf727/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.879578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bf2cec381b4f77a4d73f0ad4190660, user_id=d2e6f9bf15124eaf86ef2824958bf727, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:28.882554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aabc6f-0702-408b-a2e9-99a151bdb419 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:28.918243 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3139/6264] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:28 2022] PUT /identity/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660/users/d2e6f9bf15124eaf86ef2824958bf727/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:28.924396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74e69-bfb2-4a53-8725-01a79b1fb8de None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:28.925451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74e69-bfb2-4a53-8725-01a79b1fb8de None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:28.925981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74e69-bfb2-4a53-8725-01a79b1fb8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:28.928717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:28.953326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9c77-2ff7-456d-84a2-e6efb1c80ba4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:28.970098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c5b74e69-bfb2-4a53-8725-01a79b1fb8de None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:28.974631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c5b74e69-bfb2-4a53-8725-01a79b1fb8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.077902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:29.081623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.081937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.082241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.091691 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3140/6265] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:29.093726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.094023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.094300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.127171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] MFA Rules not processed for user `d2e6f9bf15124eaf86ef2824958bf727`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:29.128406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.175702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:29.177380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:29.183103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:29.193064 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3126/6266] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:29.194079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:29.195464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.213487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fbdc6-2faf-4bcb-a9d9-af5cce73f8e7 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:29.219279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:29.220477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.220865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.221149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.223925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.226879 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3141/6267] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:29.227859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:29.229441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.245926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:29.247486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:29.260152 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3127/6268] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:29.261079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:29.262629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:29.368794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9cb0c-8083-498d-a639-a3f4f1685b0e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:29.377241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99293e8-63f6-4631-9d6b-ab722ea41c95 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:29.382757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:29.383750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.384236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:29.384706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.384954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.385086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.385256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.385656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.411256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:29.413605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:29.433822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3142/6269] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:29.436723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:29.438434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:29.470665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3128/6270] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:29.597630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:29.612775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67495657-8b3c-4a0a-ba8f-0babb658252e service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:29.618307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:29.619290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:29.619744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:29.620513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:29.762825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:29.764227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:29.788800 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3143/6271] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:31.944776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:31.947080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:32.098289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:32.171719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9717d-4ad6-4ee7-a2bd-ba4e755881c1 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:32.183319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:32.187269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:32.187585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:32.188944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:32.205427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:32.257553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:32.264517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:32.272041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:32.273461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:32.305341 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3129/6272] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:32.314996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753128-0191-4fd9-9682-fb3f2a2c6314 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:32.335802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:32.339864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:32.340165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:32.340503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] PATH_INFO: `/v3/users/6bcfb45bd9404205aefe7d1d2b33cd25` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:32.347812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bcfb45bd9404205aefe7d1d2b33cd25)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:32.349837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:32.501428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bcfb45bd9404205aefe7d1d2b33cd25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:32.502824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bcfb45bd9404205aefe7d1d2b33cd25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:32.522827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:32.527878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bcfb45bd9404205aefe7d1d2b33cd25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:32.561234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bcfb45bd9404205aefe7d1d2b33cd25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:32.577074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b260f74-1c55-45f7-972a-d0ae3f357201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bcfb45bd9404205aefe7d1d2b33cd25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:32.590514 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3144/6273] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:32 2022] DELETE /identity/v3/users/6bcfb45bd9404205aefe7d1d2b33cd25 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:33.386063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:33.404962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfdc16-7543-4404-b4da-d46a41c1105e service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:33.547284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:33.552412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:33.555703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:33.557447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] PATH_INFO: `/v3/projects/a5b521724c3d49069bb1aa8c2428b75c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:33.562550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b521724c3d49069bb1aa8c2428b75c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:33.569005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:33.747964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b521724c3d49069bb1aa8c2428b75c', 'request_id': 'req-18be7f72-547d-4136-975f-509b8fa1ef39'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:33.770436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b521724c3d49069bb1aa8c2428b75c', 'request_id': 'req-18be7f72-547d-4136-975f-509b8fa1ef39'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:33.789756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b521724c3d49069bb1aa8c2428b75c', 'request_id': 'req-18be7f72-547d-4136-975f-509b8fa1ef39'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:33.854485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] The token cache is being invalidate because project a5b521724c3d49069bb1aa8c2428b75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:33.855244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:33.859727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18be7f72-547d-4136-975f-509b8fa1ef39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:33.868732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3130/6274] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:33 2022] DELETE /identity/v3/projects/a5b521724c3d49069bb1aa8c2428b75c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:33.869716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:33.870178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:33.870302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:33.914979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:33.923247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:34.161466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3145/6275] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:34.171211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.171676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.171965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.230012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:34.233384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:34.255425 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3131/6276] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:34.260975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.282579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e495c-cb52-4b8d-a2ca-bf9307cef281 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.299300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.304650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.304973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.307468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.310041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:34.310716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:34.312038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:34.354872 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3146/6277] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:34.359415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.376252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f39a38-4f4f-4619-960c-4fac980dd4a9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.393131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.394007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.394159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.395153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.396688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:34.402457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:34.492633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3132/6278] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:34.497139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.519318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadbff7-8f94-4ede-8aed-5efdaa1cd32c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.677456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.678367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.678723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.679068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.680406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:34.682721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:34.731418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.733677 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3147/6279] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:34 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:34.747234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea271fb-b125-4181-b09c-b3545075931b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.761041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.761815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.762273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.762395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.763126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:34.772332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:34.801362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3133/6280] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:34.806730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.835457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c466728-44c1-4aa5-a498-302a8341e657 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.862718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.863772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.864245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.864784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:34.865778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:34.875928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348220-f3de-4892-afd8-b550a2b17d7e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:34.919468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:34.920169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3148/6281] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:34.941299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c4bb-7078-4cd5-b3d6-35d71a296ca5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:34.955125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:34.956075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:34.956360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:34.957399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] PATH_INFO: `/v3/projects/d32f25e6afd2425db488a9387869da19/users/3648405427d14f91a4bb44bd81f2195b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:35.014818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32f25e6afd2425db488a9387869da19, user_id=3648405427d14f91a4bb44bd81f2195b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:35.019854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:35.027850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:35.049555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3134/6282] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:34 2022] PUT /identity/v3/projects/d32f25e6afd2425db488a9387869da19/users/3648405427d14f91a4bb44bd81f2195b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:35.055159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:35.055861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:35.056382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:35.093574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:35.094723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:35.174502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:35.287053 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3149/6283] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:35.364610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:35.366594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:35.545766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cb611-64a2-46ad-a8ad-be52325a02f7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:35.555249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:35.556402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:35.556989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:35.557497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:35.577370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:35.582902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b335-689f-4745-b062-980ca11e378c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:35.646102 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3135/6284] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:35.653197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:35.655794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:35.672821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01e3f-8986-4569-9048-93c3d305ae26 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:35.679770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:35.680796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:35.681078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:35.681350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] PATH_INFO: `/v3/users/b9a310bcaa2b4cc7a6497858b7e6d552` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:35.682984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a310bcaa2b4cc7a6497858b7e6d552)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:35.685759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:35.775754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a310bcaa2b4cc7a6497858b7e6d552'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:35.776997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a310bcaa2b4cc7a6497858b7e6d552'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:35.807512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a310bcaa2b4cc7a6497858b7e6d552'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:35.833170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a310bcaa2b4cc7a6497858b7e6d552'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:35.845292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a310bcaa2b4cc7a6497858b7e6d552'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:35.866522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3150/6285] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:35 2022] DELETE /identity/v3/users/b9a310bcaa2b4cc7a6497858b7e6d552 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:35.871457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:35.871756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:35.872034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:35.918269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:35.923188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:36.052723 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3136/6286] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:36.103450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:36.105680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:36.220737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5015-39a1-452c-a4c4-f308fadcc326 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:36.225920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:36.226919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:36.227709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:36.228176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:36.240331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:36.242159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:36.255423 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3151/6287] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:38.309776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:38.313632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:38.336729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf25506-bdc9-4cf1-8143-b08ddc72e87a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:38.347318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:38.348379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:38.349573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:38.350379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] PATH_INFO: `/v3/projects/a802a9436b9b434983af9ea0e92d58e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:38.351874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a802a9436b9b434983af9ea0e92d58e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:38.354267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:38.446814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a802a9436b9b434983af9ea0e92d58e6', 'request_id': 'req-163d37ae-1961-4aad-99eb-2161a2aee3a4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.460621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a802a9436b9b434983af9ea0e92d58e6', 'request_id': 'req-163d37ae-1961-4aad-99eb-2161a2aee3a4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.469260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a802a9436b9b434983af9ea0e92d58e6', 'request_id': 'req-163d37ae-1961-4aad-99eb-2161a2aee3a4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.488739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] The token cache is being invalidate because project a802a9436b9b434983af9ea0e92d58e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:38.489608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.491149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.494380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3137/6288] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:38 2022] DELETE /identity/v3/projects/a802a9436b9b434983af9ea0e92d58e6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:38.498764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:38.510142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691fd27-767b-4a9d-8a55-8fb9ac1fb2fd service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:38.596587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:38.646292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:38.647728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:38.648221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:38.648721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] PATH_INFO: `/v3/users/d2e6f9bf15124eaf86ef2824958bf727` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:38.653489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e6f9bf15124eaf86ef2824958bf727)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:38.656346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:38.740665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e6f9bf15124eaf86ef2824958bf727'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.756215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e6f9bf15124eaf86ef2824958bf727'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.779026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e6f9bf15124eaf86ef2824958bf727'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.815863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e6f9bf15124eaf86ef2824958bf727'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.831269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a953404-0975-4e54-9a19-649184910518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e6f9bf15124eaf86ef2824958bf727'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:38.845082 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3152/6289] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:38 2022] DELETE /identity/v3/users/d2e6f9bf15124eaf86ef2824958bf727 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:40.034318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:40.037862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:40.070261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37ae-1961-4aad-99eb-2161a2aee3a4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:40.103214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:40.203141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:40.204718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:40.205361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:40.205999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] PATH_INFO: `/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:40.209666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bf2cec381b4f77a4d73f0ad4190660)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:40.212829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:40.331529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bf2cec381b4f77a4d73f0ad4190660', 'request_id': 'req-3d3fba13-04bc-4447-85ce-7264e36ffd25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:40.345419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bf2cec381b4f77a4d73f0ad4190660', 'request_id': 'req-3d3fba13-04bc-4447-85ce-7264e36ffd25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:40.356595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bf2cec381b4f77a4d73f0ad4190660', 'request_id': 'req-3d3fba13-04bc-4447-85ce-7264e36ffd25'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:40.386232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] The token cache is being invalidate because project e0bf2cec381b4f77a4d73f0ad4190660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:40.386739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:40.388306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d3fba13-04bc-4447-85ce-7264e36ffd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:40.395038 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3138/6290] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:40 2022] DELETE /identity/v3/projects/e0bf2cec381b4f77a4d73f0ad4190660 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:40.396118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:40.396643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:40.396830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:40.432703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:40.435734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:40.587964 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3153/6291] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:40.598287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:40.598685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:40.599412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:40.628898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:40.631867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:40.649488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:40.651257 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3139/6292] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:40.675080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1902dc5-fb9d-480c-853b-cb009ccf0161 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:40.694601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:40.697373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:40.699136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:40.700788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:40.701957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:40.703360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:40.706704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:40.776154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3154/6293] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:40.781151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:40.793971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646099f-5723-419b-8bec-e1bc323be328 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:40.815206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:40.828509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:40.828789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:40.829068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:40.829779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:40.831734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:40.888609 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3140/6294] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:40 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:40.892998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:40.908675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b509b6-30d1-42bc-aabe-5f7fd8ec9a07 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:41.063141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:41.092312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:41.094067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.094067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.100076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.100767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:41.104063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:41.157314 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3155/6295] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:40 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:41.158277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:41.188265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780478a-3938-4189-85fd-f9c877467f02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:41.197536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:41.198583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.204925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.206688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.207729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:41.214477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:41.250064 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3141/6296] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:41.255973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:41.287462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb607-06d6-4aae-8ae5-7112bb12335c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:41.294546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:41.295514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.295905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.296399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.297381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:41.313805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acdff3-2386-4587-83fc-f5ee4f4bdd83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:41.345765 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3156/6297] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:41.349774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:41.375945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d389-cfd8-4bcf-96c5-a76ca68adfa1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:41.407040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:41.408643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.409187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.409681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] PATH_INFO: `/v3/projects/a98586487afa4caf9bfcc3b2f9ec6b1e/users/7589db7eb2f14d0ca2c0292f6e3c1ee7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.448695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98586487afa4caf9bfcc3b2f9ec6b1e, user_id=7589db7eb2f14d0ca2c0292f6e3c1ee7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:41.479084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:41.508309 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3142/6298] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:41 2022] PUT /identity/v3/projects/a98586487afa4caf9bfcc3b2f9ec6b1e/users/7589db7eb2f14d0ca2c0292f6e3c1ee7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:41.521076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.522610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.523239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.587285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] MFA Rules not processed for user `7589db7eb2f14d0ca2c0292f6e3c1ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:41.589203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:41.826444 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3157/6299] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:41.830821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:41.927124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:41.952942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfed2e-41b2-4a86-8a28-101052697de2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:41.964273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:41.965787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:41.966817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:41.967305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:41.968435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:41.970779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:42.069370 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3143/6300] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:41 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:42.074352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:42.091716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba752-5cba-4513-b892-59ef91f2ad4f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:42.291358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:42.292243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.292656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.293033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.293848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:42.296583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:42.353803 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3158/6301] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:42 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:42.357818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:42.379801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7c227-d674-4e73-bb4f-fb7bf24f7f71 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:42.387308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:42.397010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.398041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.398526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.399612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:42.401893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:42.424408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3144/6302] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:42.428364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:42.441342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f45e-525c-4137-a2e7-2ddbadc84eef admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:42.451797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:42.454407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.454901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.455422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.456338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:42.458216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffe48f-022a-45e4-a00a-20ca13e98c4e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:42.482490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3159/6303] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:15:42.486629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:42.501218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350a2a2-c633-42aa-bebd-84f5bd4401b5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:42.507077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:42.509173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.510713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.511190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] PATH_INFO: `/v3/projects/939a5c750d4f4c7792f7a82e3cdc2add/users/c7984ca33ce54e71bb4c123094f27399/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.532678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939a5c750d4f4c7792f7a82e3cdc2add, user_id=c7984ca33ce54e71bb4c123094f27399, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:42.536892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:42.586402 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3145/6304] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:42 2022] PUT /identity/v3/projects/939a5c750d4f4c7792f7a82e3cdc2add/users/c7984ca33ce54e71bb4c123094f27399/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:42.602887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.604805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.605259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.687294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] MFA Rules not processed for user `c7984ca33ce54e71bb4c123094f27399`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:42.688741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:42.804532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:42.885846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:42.889752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3160/6305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:42.967341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe815-78ef-48e0-b5f8-f4faedc920d1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:42.983151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:42.985083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:42.985083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:42.985083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:42.985403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:42.992109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.061973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:43.079635 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3146/6306] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:42 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:43.084348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eb3ff-0103-4904-800d-c5938885e485 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:43.318982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:43.319963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.320656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.320844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.321654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:43.323989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.383170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3161/6307] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:43 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:43.385354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:43.408759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22600c0-22dc-4e44-a71a-c57dc4f0d4ec admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:43.419009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:43.425147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.425839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.426332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.427308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:43.429356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.456354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3147/6308] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:43.457610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:43.475933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654430-6dc6-4d25-b234-7f64ad6a1292 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:43.499913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:43.503899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.504267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.504584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] PATH_INFO: `/v3/projects/86d94a2d0b4545c492e687163a5c7814/users/e3d02d9aca6646ddb450031589530525/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.547970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d94a2d0b4545c492e687163a5c7814, user_id=e3d02d9aca6646ddb450031589530525, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:43.550862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.579388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3162/6309] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:43 2022] PUT /identity/v3/projects/86d94a2d0b4545c492e687163a5c7814/users/e3d02d9aca6646ddb450031589530525/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:43.583298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:43.598755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de75e6-b0a7-402b-8bb9-4a3bd10078b8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:43.677937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:43.679087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.679732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.680371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.681414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:43.684182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3df509-2934-4c29-a4f2-ce37d7dd8cd7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.703248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:43.712872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3148/6310] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:43.717889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0c88-0a1d-4dcc-a995-f21ffb9bf955 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:43.729451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:43.730340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.730610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.731745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] PATH_INFO: `/v3/projects/86d94a2d0b4545c492e687163a5c7814/users/e3d02d9aca6646ddb450031589530525/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.734150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d94a2d0b4545c492e687163a5c7814, user_id=e3d02d9aca6646ddb450031589530525, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:43.738919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:43.764615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:43.766960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:43.767478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:43.774621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3163/6311] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:43 2022] PUT /identity/v3/projects/86d94a2d0b4545c492e687163a5c7814/users/e3d02d9aca6646ddb450031589530525/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:43.784782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:43.806166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] MFA Rules not processed for user `e3d02d9aca6646ddb450031589530525`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:43.809378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:44.005120 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3149/6312] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:44.024546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:44.027774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:44.175241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc6fe-55ca-432d-8cc9-ef7fa45d5aca admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:44.180570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:44.181415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:44.181720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:44.182192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:44.198268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:44.206978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ffa8f-df72-42d6-b1a9-5e87dae53564 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:44.248755 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3164/6313] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:44.320914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:44.322405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:44.338710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c335637-fca5-4bf9-8e28-f4e5b44bcc7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:44.344692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:44.346602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:44.346602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:44.346602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:44.472720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:44.475869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72b76-4976-4076-9354-2728ae04ae3b service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:44.532997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3150/6314] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:46.728541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:46.729034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:46.729172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:46.796215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] MFA Rules not processed for user `3648405427d14f91a4bb44bd81f2195b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:46.798389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:46.852737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:47.048267 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3165/6315] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:47.106733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ea2e-daa1-4879-931c-673164ae1b25 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:47.107631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ea2e-daa1-4879-931c-673164ae1b25 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:47.108204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ea2e-daa1-4879-931c-673164ae1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:47.140220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b942ea2e-daa1-4879-931c-673164ae1b25 None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:47.141586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b942ea2e-daa1-4879-931c-673164ae1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:47.149721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:47.151299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:47.381011 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3151/6316] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:47.465550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb4565-7930-42e6-b888-8fdc3ed536b6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:47.478295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:47.478996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:47.479283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:47.479565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:47.492947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:47.494678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272cb9-6dba-40f3-8a99-69c5ee7040b9 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:47.514960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3166/6317] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:47.548682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:47.548984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:47.549274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:47.568417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964371-b733-4072-8133-6616e1a52231 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:47.568741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964371-b733-4072-8133-6616e1a52231 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:47.569119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964371-b733-4072-8133-6616e1a52231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:47.592320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] MFA Rules not processed for user `1554f1d20e344432b617857d279f6d37`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:47.593674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:47.622978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-47964371-b733-4072-8133-6616e1a52231 None None] MFA Rules not processed for user `aa2aaa29e0dd479283202bd6575b4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:47.626158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-47964371-b733-4072-8133-6616e1a52231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:47.633313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:47.678066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3152/6318] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:47.786403 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3167/6319] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:15:48.539424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:48.723779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c446-ee40-40a8-ab48-02e16fdaa584 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:48.749152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:48.750413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:48.751246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:48.751778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] PATH_INFO: `/v3/users/7589db7eb2f14d0ca2c0292f6e3c1ee7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:48.755222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7589db7eb2f14d0ca2c0292f6e3c1ee7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:48.772070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:48.888899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7589db7eb2f14d0ca2c0292f6e3c1ee7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:48.902909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7589db7eb2f14d0ca2c0292f6e3c1ee7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:48.922257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7589db7eb2f14d0ca2c0292f6e3c1ee7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:48.923040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7589db7eb2f14d0ca2c0292f6e3c1ee7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:48.923781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7589db7eb2f14d0ca2c0292f6e3c1ee7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:48.944102 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3153/6320] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:48 2022] DELETE /identity/v3/users/7589db7eb2f14d0ca2c0292f6e3c1ee7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:48.946097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb4034-632f-4df0-afb0-c87ce41f3d37 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:48.946571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb4034-632f-4df0-afb0-c87ce41f3d37 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:48.946571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb4034-632f-4df0-afb0-c87ce41f3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:48.976073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-affb4034-632f-4df0-afb0-c87ce41f3d37 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:48.977796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-affb4034-632f-4df0-afb0-c87ce41f3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:49.048327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:49.080131 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3168/6321] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:49.225803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:49.230352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:49.298883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:49.299406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:49.299918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:49.380269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] MFA Rules not processed for user `c845f86f1b6244f7a53996329294f2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:49.384578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:49.414264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964631-67fd-47ba-bb1d-7f3bbf481482 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:49.428685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:49.429399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:49.430845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:49.431141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:49.463531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:49.465287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:49.497703 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3154/6322] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:49.555864 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3169/6323] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:50.606755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:50.609432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:50.628720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:50.637557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3064a-17d5-45c5-9331-f96bd30be426 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:50.647173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:50.648639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:50.662462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:50.665481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] PATH_INFO: `/v3/projects/a98586487afa4caf9bfcc3b2f9ec6b1e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:50.668068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98586487afa4caf9bfcc3b2f9ec6b1e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:50.680628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:50.808692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98586487afa4caf9bfcc3b2f9ec6b1e', 'request_id': 'req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:50.848616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98586487afa4caf9bfcc3b2f9ec6b1e', 'request_id': 'req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:50.853678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:50.855820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:50.890306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98586487afa4caf9bfcc3b2f9ec6b1e', 'request_id': 'req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:50.948454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] The token cache is being invalidate because project a98586487afa4caf9bfcc3b2f9ec6b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:50.948777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:50.952889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:50.968012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3155/6324] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:50 2022] DELETE /identity/v3/projects/a98586487afa4caf9bfcc3b2f9ec6b1e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:50.973360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:50.975973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:51.140868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd406-81a4-40f3-b0b4-78c3cfeaae3a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:51.224594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a51cd-c0f2-4416-9013-1b6c7f7d42fb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:51.232812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:51.234135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:51.234500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:51.234812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] PATH_INFO: `/v3/users/c7984ca33ce54e71bb4c123094f27399` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:51.236375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7984ca33ce54e71bb4c123094f27399)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:51.239154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:51.314844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:51.318549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:51.319132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:51.319681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:51.332533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:51.366081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7984ca33ce54e71bb4c123094f27399'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:51.384638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7984ca33ce54e71bb4c123094f27399'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:51.404229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:51.437301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7984ca33ce54e71bb4c123094f27399'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:51.440161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7984ca33ce54e71bb4c123094f27399'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:51.441531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7984ca33ce54e71bb4c123094f27399'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:51.523275 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3156/6325] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:50 2022] DELETE /identity/v3/users/c7984ca33ce54e71bb4c123094f27399 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:15:51.569258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:51.577916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:51.619606 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3170/6326] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:15:52.933886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:52.937942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:52.947590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:53.071016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540ee6-3bec-4e79-a6a8-f0666cecc464 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:53.099193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:53.100885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:53.101184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:53.101542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] PATH_INFO: `/v3/projects/939a5c750d4f4c7792f7a82e3cdc2add` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:53.109227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939a5c750d4f4c7792f7a82e3cdc2add)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:53.111242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:53.269118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939a5c750d4f4c7792f7a82e3cdc2add', 'request_id': 'req-1c254e61-6a27-407f-bbaa-8307bede0670'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.306090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939a5c750d4f4c7792f7a82e3cdc2add', 'request_id': 'req-1c254e61-6a27-407f-bbaa-8307bede0670'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.314327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939a5c750d4f4c7792f7a82e3cdc2add', 'request_id': 'req-1c254e61-6a27-407f-bbaa-8307bede0670'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.364416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] The token cache is being invalidate because project 939a5c750d4f4c7792f7a82e3cdc2add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:53.364802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.367092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1c254e61-6a27-407f-bbaa-8307bede0670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.373208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:53.383231 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3157/6327] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:52 2022] DELETE /identity/v3/projects/939a5c750d4f4c7792f7a82e3cdc2add => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:53.389693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594e50-dfb2-447b-83f1-76f640e7426c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:53.492628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:53.493838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:53.494259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:53.494664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] PATH_INFO: `/v3/users/e3d02d9aca6646ddb450031589530525` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:53.497030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d02d9aca6646ddb450031589530525)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:53.502312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:53.579285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d02d9aca6646ddb450031589530525'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.580117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d02d9aca6646ddb450031589530525'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.592764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d02d9aca6646ddb450031589530525'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.614602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d02d9aca6646ddb450031589530525'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.643681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d02d9aca6646ddb450031589530525'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:53.669253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3171/6328] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:15:53 2022] DELETE /identity/v3/users/e3d02d9aca6646ddb450031589530525 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:54.555835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b07b-0afc-4c57-b60e-fede78e8db59 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:54.556820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b07b-0afc-4c57-b60e-fede78e8db59 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:54.557324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b07b-0afc-4c57-b60e-fede78e8db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:54.587403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-00e9b07b-0afc-4c57-b60e-fede78e8db59 None None] MFA Rules not processed for user `3648405427d14f91a4bb44bd81f2195b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:54.589052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-00e9b07b-0afc-4c57-b60e-fede78e8db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:54.731381 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3158/6329] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:55.011418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:55.013219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:55.087543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:55.163372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b87035-ff7a-4697-859c-ba2c138234cd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:55.178598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:55.179398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.179731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.180008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] PATH_INFO: `/v3/projects/86d94a2d0b4545c492e687163a5c7814` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.181679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d94a2d0b4545c492e687163a5c7814)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:55.184617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:55.281842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d94a2d0b4545c492e687163a5c7814', 'request_id': 'req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:55.304091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d94a2d0b4545c492e687163a5c7814', 'request_id': 'req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:55.310959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d94a2d0b4545c492e687163a5c7814', 'request_id': 'req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:55.347243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] The token cache is being invalidate because project 86d94a2d0b4545c492e687163a5c7814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:15:55.347621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:55.358195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c4c1af8c-e2f9-4c21-af2d-d86aaa8e515a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:15:55.365162 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3172/6330] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:15:55 2022] DELETE /identity/v3/projects/86d94a2d0b4545c492e687163a5c7814 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:55.368758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.369258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.369689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.423525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:55.428638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:55.503803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:55.547086 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3159/6331] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:55.556914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.557450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.557888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.588214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:55.589695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:55.613742 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3173/6332] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:55.615619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:55.629845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219991a-52b6-4d53-a3d3-a0e4cfdc55c5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:55.637172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:55.638338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.642918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.644144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.645043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:15:55.646537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:55.648582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:55.700898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3160/6333] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:15:55.701132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:55.713552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25edc6-52ba-43fe-9e92-69377672b90a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:55.729815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:55.730502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.730778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.731057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.731826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:55.733704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:55.773748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3174/6334] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:15:55 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:15:55.777608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:55.789212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324e9c5-db71-49f7-aaab-90e060f2a144 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:55.913830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:55.914619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:55.914921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:55.915190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:55.916140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:55.918579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:55.997772 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3161/6335] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:15:55 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:15:56.003136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:56.025699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c559-cb12-4c19-8c7e-ea63250f25d4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:56.040207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:56.042429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:56.043607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:56.044148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:56.045298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:56.047621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:56.097183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3175/6336] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:56.100114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:56.138506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a2ae-06dc-4aef-944a-f785b7f22a61 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:56.157010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:56.159129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:56.159530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:56.160130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:56.161191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:56.163470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6d275-15ca-4bcd-9f2f-579e6901dcc5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:56.185514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:56.185732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3162/6337] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:15:56.197217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb33e-7945-4db1-aff6-58a453baa596 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:56.218024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:56.219024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:56.219310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:56.219591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] PATH_INFO: `/v3/projects/6caa4b4f47e642d1829351aabc3013ad/users/9a039cb4e66f4397b9248c3a40407b9c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:56.254514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caa4b4f47e642d1829351aabc3013ad, user_id=9a039cb4e66f4397b9248c3a40407b9c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:56.257609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:56.288498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3176/6338] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:15:56 2022] PUT /identity/v3/projects/6caa4b4f47e642d1829351aabc3013ad/users/9a039cb4e66f4397b9248c3a40407b9c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:15:56.295852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69eaa2-cfb2-4f9e-a742-7e86e474b443 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:56.296925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69eaa2-cfb2-4f9e-a742-7e86e474b443 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:56.297328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69eaa2-cfb2-4f9e-a742-7e86e474b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:56.340902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0d69eaa2-cfb2-4f9e-a742-7e86e474b443 None None] MFA Rules not processed for user `9a039cb4e66f4397b9248c3a40407b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:56.343193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d69eaa2-cfb2-4f9e-a742-7e86e474b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:56.466164 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3163/6339] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:15:56.474530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:15:56.477406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:56.619233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcff6a-0694-4424-a55c-8ce3ffa369d4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:15:56.631847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:15:56.632933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:56.633330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:56.633738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:56.658755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:15:56.660974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:15:56.695543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3177/6340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:15:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:15:59.053012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022b0f-5403-480c-84d7-6a5cd955d532 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:15:59.053562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022b0f-5403-480c-84d7-6a5cd955d532 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:15:59.053562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022b0f-5403-480c-84d7-6a5cd955d532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:15:59.086213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-de022b0f-5403-480c-84d7-6a5cd955d532 None None] MFA Rules not processed for user `c845f86f1b6244f7a53996329294f2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:15:59.087462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de022b0f-5403-480c-84d7-6a5cd955d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:15:59.143349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:59.182315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3164/6341] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:03.209669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:03.215412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:03.304629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42430-053a-46cb-a7eb-f380f3a2c38a service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:03.315211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:03.320024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:03.320602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:03.321538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] PATH_INFO: `/v3/users/9a039cb4e66f4397b9248c3a40407b9c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:03.323710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a039cb4e66f4397b9248c3a40407b9c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:03.327537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:03.439419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a039cb4e66f4397b9248c3a40407b9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:03.440332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a039cb4e66f4397b9248c3a40407b9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:03.481694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a039cb4e66f4397b9248c3a40407b9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:03.521477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a039cb4e66f4397b9248c3a40407b9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:03.544314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a039cb4e66f4397b9248c3a40407b9c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:03.556853 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3178/6342] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:16:03 2022] DELETE /identity/v3/users/9a039cb4e66f4397b9248c3a40407b9c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:03.558976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:03.559479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:03.559589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:03.588285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:03.589765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:03.705073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3165/6343] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:03.732552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:03.733953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:03.836747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651e46-90f7-46a6-8af7-b1dba2361acd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:03.840966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:03.842160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:03.842555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:03.843010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:03.858070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:03.860893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3ad3-bada-4419-9bdb-72f9df1fabc7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:03.876522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3179/6344] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:05.654847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:05.656672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:05.679435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a5c9-bc4f-4956-81e5-7e88e3b91dc4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:05.692818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:05.694066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:05.694066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:05.694277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] PATH_INFO: `/v3/projects/6caa4b4f47e642d1829351aabc3013ad` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:05.698455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caa4b4f47e642d1829351aabc3013ad)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:05.700414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:05.892676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caa4b4f47e642d1829351aabc3013ad', 'request_id': 'req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:05.921265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caa4b4f47e642d1829351aabc3013ad', 'request_id': 'req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:05.944302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caa4b4f47e642d1829351aabc3013ad', 'request_id': 'req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:05.970676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] The token cache is being invalidate because project 6caa4b4f47e642d1829351aabc3013ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:16:05.970980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:05.976725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6ed6f9ec-b168-4b63-9064-9aa979c06e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:05.979295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3166/6345] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:16:05 2022] DELETE /identity/v3/projects/6caa4b4f47e642d1829351aabc3013ad => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:05.984877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:05.985672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:05.986149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.020088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:06.021430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:06.058102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:06.144961 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3180/6346] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:06.152856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.153153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.153442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.182369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:06.183691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:06.202896 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3167/6347] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:06.206859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.218383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c73e-cd3d-4957-abe8-7636f3456242 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.225132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.226051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.226354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.226631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.227389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:16:06.227692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.229363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.246297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3181/6348] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:16:06.250469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.261923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fcbda-8b8e-46ec-b7bb-7f34508cce2b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.267266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.268036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.268598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.268953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.269735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.273232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.316775 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3168/6349] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:06.321326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.343728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba5426-b5dc-4103-92fc-4f315b64fd44 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.460965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.462819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.464857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.465462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.466466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.471200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.503963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3182/6350] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:06.508485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.523939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ebae-8ef6-4e22-8cb0-7b3a3902791e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.532885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.533806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.534093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.534431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.535164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.536990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.552642 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3169/6351] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:06.554270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.566701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662459f-4b56-403a-89b7-7e966fa1d6e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.576275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.577443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.577443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.577708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.578301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.580405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b240ffe-341e-495a-98d8-c464b17471e0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.592665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3183/6352] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:06.598283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.609998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928dda-e54e-4e8e-b3b6-1e5e72b70ad3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.615150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.616077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.616366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.616759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] PATH_INFO: `/v3/projects/bc7e7c9bc65542bc9e14b330b2f19358/users/69eb803c29c14eff8177149538c8e4ef/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.637345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7e7c9bc65542bc9e14b330b2f19358, user_id=69eb803c29c14eff8177149538c8e4ef, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.640053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ebffa-2625-4b21-8076-76ece01ff664 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.651244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:06.664807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3170/6353] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:06 2022] PUT /identity/v3/projects/bc7e7c9bc65542bc9e14b330b2f19358/users/69eb803c29c14eff8177149538c8e4ef/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:06.669142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.669644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.669860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.706722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] MFA Rules not processed for user `69eb803c29c14eff8177149538c8e4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:06.707441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:06.815113 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3184/6354] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:16:06.817051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.827728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e6dc-b094-4105-9bbd-5902a46dc227 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.828015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e6dc-b094-4105-9bbd-5902a46dc227 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.831066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e6dc-b094-4105-9bbd-5902a46dc227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.842093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:06.856968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b109e6dc-b094-4105-9bbd-5902a46dc227 None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:06.858174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b109e6dc-b094-4105-9bbd-5902a46dc227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:06.898431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6e72-8ae4-40f3-a9b0-c635a9319850 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:06.903621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:06.904825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.905113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.905430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.906414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:06.909927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:06.949577 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3171/6355] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:06.954333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:06.955554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:06.955923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:06.957729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3185/6356] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:16:06.959565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:06.984277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] MFA Rules not processed for user `83af31935cce49c5b97d9dd2a4774e73`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:06.985760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:07.051269 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3172/6357] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 25 21:16:07.058718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55377d1-06a9-47d4-aec6-ff572b4d5f67 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.063955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.064846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.065195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.065539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.066300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.068294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.095414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3186/6358] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:16:06 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:07.099360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:07.111091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15d86-8c0c-444c-9308-02eabcff7307 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.117534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.118333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.118626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.118901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.119758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.121453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.138954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3173/6359] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:07.143671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:07.155721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c97f22-38ec-42cb-bed6-83193432aa4d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.161451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.162446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.162739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.163064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] PATH_INFO: `/v3/projects/f960fa41ee394de2994f8d6a61b594b5/users/cbf6e5bc5b09404f812db75e22040b2f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.180927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f960fa41ee394de2994f8d6a61b594b5, user_id=cbf6e5bc5b09404f812db75e22040b2f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.189146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.207172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3187/6360] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:07 2022] PUT /identity/v3/projects/f960fa41ee394de2994f8d6a61b594b5/users/cbf6e5bc5b09404f812db75e22040b2f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:07.211653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:07.224927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08801f-d018-4101-9fb5-3a80fc695c73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.290096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.291804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.292339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.292653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.293864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.295065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e871de-e9b3-4115-98fa-b94d8aa42eb4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.306291 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3174/6361] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:16:07.310566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:07.322892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671f0a8-e3b5-4e25-ba48-24e3d82ee7a4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.327832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.329388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.329388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.329388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] PATH_INFO: `/v3/projects/f960fa41ee394de2994f8d6a61b594b5/users/cbf6e5bc5b09404f812db75e22040b2f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.331316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f960fa41ee394de2994f8d6a61b594b5, user_id=cbf6e5bc5b09404f812db75e22040b2f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.334405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.346203 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3188/6362] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:07 2022] PUT /identity/v3/projects/f960fa41ee394de2994f8d6a61b594b5/users/cbf6e5bc5b09404f812db75e22040b2f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:16:07.357090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.357460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.357746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.390464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] MFA Rules not processed for user `cbf6e5bc5b09404f812db75e22040b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:07.391895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:07.421451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:07.475756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3175/6363] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:07.486901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:07.488624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:07.559915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264990b0-fb43-45f7-b4a4-9a2284dbff8f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:07.563853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:07.574872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:07.575191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:07.575416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:07.588656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:07.677640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:07.679620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a26b1-0ac1-4989-abff-5230621aa312 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:07.692789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3189/6364] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:10.671872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:10.779556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee6a84-febc-4d74-9c32-42175408cdc3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:10.784345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:10.785929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:10.786216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:10.786548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] PATH_INFO: `/v3/users/69eb803c29c14eff8177149538c8e4ef` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:10.788946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69eb803c29c14eff8177149538c8e4ef)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:10.792200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:10.874810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69eb803c29c14eff8177149538c8e4ef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:10.895257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69eb803c29c14eff8177149538c8e4ef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:10.921037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69eb803c29c14eff8177149538c8e4ef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:10.923808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69eb803c29c14eff8177149538c8e4ef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:10.924983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69eb803c29c14eff8177149538c8e4ef'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:10.964204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3176/6365] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:16:10 2022] DELETE /identity/v3/users/69eb803c29c14eff8177149538c8e4ef => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:10.968764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:10.969259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:10.969380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:11.007557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:11.008847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:11.114295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3190/6366] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:11.153833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:11.156069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:11.223136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:11.247314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589609c-8e50-4bfa-be58-e37b15e75d30 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:11.252730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:11.253684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:11.254202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:11.254666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:11.268768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:11.271038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:11.286334 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3177/6367] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:12.319595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:12.321396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:12.344079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d2661-53b7-4bde-af42-6a86ce827527 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:12.348374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:12.349215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:12.349593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:12.349884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] PATH_INFO: `/v3/projects/bc7e7c9bc65542bc9e14b330b2f19358` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:12.351826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7e7c9bc65542bc9e14b330b2f19358)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:12.354966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:12.443836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7e7c9bc65542bc9e14b330b2f19358', 'request_id': 'req-0530fb29-f8f3-4de8-9810-c922c8ef375e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.453408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7e7c9bc65542bc9e14b330b2f19358', 'request_id': 'req-0530fb29-f8f3-4de8-9810-c922c8ef375e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.475197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7e7c9bc65542bc9e14b330b2f19358', 'request_id': 'req-0530fb29-f8f3-4de8-9810-c922c8ef375e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.493925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] The token cache is being invalidate because project bc7e7c9bc65542bc9e14b330b2f19358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:16:12.494642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.495541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.503390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:12.503861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3191/6368] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:16:12 2022] DELETE /identity/v3/projects/bc7e7c9bc65542bc9e14b330b2f19358 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:12.518126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe71f-9beb-4d23-812d-5d4f2bb98479 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:12.646966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:12.648318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:12.648650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:12.648933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] PATH_INFO: `/v3/users/cbf6e5bc5b09404f812db75e22040b2f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:12.650514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf6e5bc5b09404f812db75e22040b2f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:12.653536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:12.730950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf6e5bc5b09404f812db75e22040b2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.746456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf6e5bc5b09404f812db75e22040b2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.772050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf6e5bc5b09404f812db75e22040b2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.773102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf6e5bc5b09404f812db75e22040b2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.773895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-78848dfe-8b94-433d-9b55-a4b40e57ff65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf6e5bc5b09404f812db75e22040b2f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:12.793406 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3178/6369] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:16:12 2022] DELETE /identity/v3/users/cbf6e5bc5b09404f812db75e22040b2f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:16:13.591191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:13.592989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:13.614696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530fb29-f8f3-4de8-9810-c922c8ef375e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:13.663285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:13.704417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:13.705361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:13.705647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:13.706244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] PATH_INFO: `/v3/projects/f960fa41ee394de2994f8d6a61b594b5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:13.707651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f960fa41ee394de2994f8d6a61b594b5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:13.710325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:13.779721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f960fa41ee394de2994f8d6a61b594b5', 'request_id': 'req-837d1799-231b-49d7-8e17-4dfd9d569a17'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:13.788874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f960fa41ee394de2994f8d6a61b594b5', 'request_id': 'req-837d1799-231b-49d7-8e17-4dfd9d569a17'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:13.794955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f960fa41ee394de2994f8d6a61b594b5', 'request_id': 'req-837d1799-231b-49d7-8e17-4dfd9d569a17'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:13.810849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] The token cache is being invalidate because project f960fa41ee394de2994f8d6a61b594b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:16:13.811295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:13.812058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-837d1799-231b-49d7-8e17-4dfd9d569a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:13.813805 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3192/6370] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:16:13 2022] DELETE /identity/v3/projects/f960fa41ee394de2994f8d6a61b594b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:16:13.819036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8284-8138-4593-a293-095e3f150477 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:13.819674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8284-8138-4593-a293-095e3f150477 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:13.819674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8284-8138-4593-a293-095e3f150477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:13.849848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-875e8284-8138-4593-a293-095e3f150477 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:13.851493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-875e8284-8138-4593-a293-095e3f150477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:13.912028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3179/6371] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:13.920033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:13.920321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:13.920633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:13.945669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:13.947637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:13.961512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3193/6372] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:13.961743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8284-8138-4593-a293-095e3f150477 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:13.966466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:13.974807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8284-8138-4593-a293-095e3f150477 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:13.985442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:13.986340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:13.986898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:13.987296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:13.988244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:16:13.988998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:13.991485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.005203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3180/6373] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:16:14.009816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.021196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096dbd8-793b-4897-b669-3c5daaef48e4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.027177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.027471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.027761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.028056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.028826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.030769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.075822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3194/6374] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:16:14 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:14.076991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.092917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec370-f0f5-42a8-8dbc-5cafe00c908e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.157381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.158569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.158859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.159136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.159831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.161803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.183403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3181/6375] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:16:14 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:14.189500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.202009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4adce-0956-402a-a567-58d575990abd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.209415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.210858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.211386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.211909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.212888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.214972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.231835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.236568 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3195/6376] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:14.244046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1b8bc-b4fd-48d9-832d-e0aef8904158 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.249242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.249931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.250213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.250487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.251213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.252992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e2d8-9d6f-4fa7-9eca-6b0caf359a3d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.264469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3182/6377] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:14.269600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.282070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfee17-7a5a-4b37-b645-aa63f6db08cd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.288303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.289280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.289568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.289848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] PATH_INFO: `/v3/projects/7af7ae98dd68466f9721e6cbbf0c6197/users/4785c7cebb344c5a97ad6f701cbc3acb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.306575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af7ae98dd68466f9721e6cbbf0c6197, user_id=4785c7cebb344c5a97ad6f701cbc3acb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.311610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.347485 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3196/6378] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:14 2022] PUT /identity/v3/projects/7af7ae98dd68466f9721e6cbbf0c6197/users/4785c7cebb344c5a97ad6f701cbc3acb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:14.359470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8313f-a9fe-4246-871f-282bd8930348 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.359764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8313f-a9fe-4246-871f-282bd8930348 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.360777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8313f-a9fe-4246-871f-282bd8930348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.402837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-83c8313f-a9fe-4246-871f-282bd8930348 None None] MFA Rules not processed for user `4785c7cebb344c5a97ad6f701cbc3acb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:14.404340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-83c8313f-a9fe-4246-871f-282bd8930348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:14.500866 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3183/6379] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:14.520096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:14.522198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:14.624020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5cc0-a7e0-49d3-94ce-1d1bcab93be2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:14.627961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:14.628792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:14.629072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:14.629345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:14.639835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:14.641710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9a967-62a5-403a-8d3b-1c6cd2e32024 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:14.651809 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3197/6380] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:24.492656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:24.647640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:27.205030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:27.205587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:27.205587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:27.227138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:27.228379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:27.304380 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3184/6381] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:30.430345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:30.431758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:30.432209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:30.461774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:30.463737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:30.549845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3198/6382] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:30.596620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:30.598054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:30.679560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8fd37-4fa4-4b6d-b5df-a2d6fff83c8a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:30.685544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:30.686212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:30.686497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:30.686780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:30.697513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:30.699174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568913-6769-4711-a30e-07f02ca6409f service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:30.708989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3185/6383] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:16:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:38.566637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:38.665495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42b8f5-8cb0-49e7-87b3-4340ff74d5fb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:38.673675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:38.674858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:38.675316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:38.675987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] PATH_INFO: `/v3/users/4785c7cebb344c5a97ad6f701cbc3acb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:38.677607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4785c7cebb344c5a97ad6f701cbc3acb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:38.680396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:38.765969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4785c7cebb344c5a97ad6f701cbc3acb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:38.766609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4785c7cebb344c5a97ad6f701cbc3acb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:38.783805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4785c7cebb344c5a97ad6f701cbc3acb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:38.802173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4785c7cebb344c5a97ad6f701cbc3acb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:38.811099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4785c7cebb344c5a97ad6f701cbc3acb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:38.820730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3199/6384] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:16:38 2022] DELETE /identity/v3/users/4785c7cebb344c5a97ad6f701cbc3acb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:38.826976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:38.827594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:38.827781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:38.849744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:38.851371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:38.922057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3186/6385] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:38.931928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:38.933593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:38.975755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:39.067210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87ac5-9a08-4ef4-bfab-4d7a70c4121a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:39.071375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:39.072310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:39.072674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:39.073130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:39.087678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:39.089715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e74ab-a571-4f8f-8bc8-b26c86e6b2a1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:39.105181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3200/6386] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:39.721907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:39.723408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:39.746778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099133-7db8-49c7-8e74-8b824b3c7379 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:39.756742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:39.758500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:39.758865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:39.759394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] PATH_INFO: `/v3/projects/7af7ae98dd68466f9721e6cbbf0c6197` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:39.760966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af7ae98dd68466f9721e6cbbf0c6197)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:39.764897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:39.793484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:39.834408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af7ae98dd68466f9721e6cbbf0c6197', 'request_id': 'req-475e385d-70c2-44c3-8f04-84519d1ca187'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:39.845500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af7ae98dd68466f9721e6cbbf0c6197', 'request_id': 'req-475e385d-70c2-44c3-8f04-84519d1ca187'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:39.855111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af7ae98dd68466f9721e6cbbf0c6197', 'request_id': 'req-475e385d-70c2-44c3-8f04-84519d1ca187'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:39.880586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] The token cache is being invalidate because project 7af7ae98dd68466f9721e6cbbf0c6197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:16:39.881724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:39.884927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-475e385d-70c2-44c3-8f04-84519d1ca187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:39.887372 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3187/6387] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:16:39 2022] DELETE /identity/v3/projects/7af7ae98dd68466f9721e6cbbf0c6197 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:39.892762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:39.893326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:39.893451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:39.918198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:39.919545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:40.009130 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3201/6388] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:16:40.017269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.020252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.020894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.050379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:40.052327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:40.063706 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3188/6389] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:40.068461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.082856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35cca9-8ccf-40de-9ce3-5679ee6ad293 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.096139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.096878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.097161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.097443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.098189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:16:40.098916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.101413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.118424 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3202/6390] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:16:40.122731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.141050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31f62-434b-4219-bae3-7e2fa4a9fe00 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.146898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.147595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.147880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.148162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.148915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.150910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.212882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3189/6391] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:16:40 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:40.217355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.237101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db469c-c5ee-48e2-a9a0-9f5d8908d95b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.316114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.317246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.318212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.318527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.319397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.321771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.347174 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3203/6392] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:16:40 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:40.350868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.362653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21171-4e33-46f4-80ea-31b990591d45 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.368714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.369671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.370035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.370675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.371645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.373847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.387192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3190/6393] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:16:40.391329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.404955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae5e7-6a33-4865-ad71-925fb927bf29 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.410158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.412443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.413399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.414007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.416906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.420783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea4ab8-b7bf-42f9-b035-f4c206d4233a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.436149 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3204/6394] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:40.440263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.452062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bed95-b9dd-455d-8997-208fe2743646 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.463736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.464775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.465061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.465340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] PATH_INFO: `/v3/projects/15f9fd4b47d743aa9ba0081392ed3fc5/users/f6d2a50d421e4b28a78565f06bb6d3a0/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.487359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f9fd4b47d743aa9ba0081392ed3fc5, user_id=f6d2a50d421e4b28a78565f06bb6d3a0, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.490300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.508112 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3191/6395] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:40 2022] PUT /identity/v3/projects/15f9fd4b47d743aa9ba0081392ed3fc5/users/f6d2a50d421e4b28a78565f06bb6d3a0/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:40.519527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d317af-0553-42b7-a926-6e1006c24aaf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.519819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d317af-0553-42b7-a926-6e1006c24aaf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.520105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d317af-0553-42b7-a926-6e1006c24aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.551881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-42d317af-0553-42b7-a926-6e1006c24aaf None None] MFA Rules not processed for user `f6d2a50d421e4b28a78565f06bb6d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:40.553812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-42d317af-0553-42b7-a926-6e1006c24aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:40.571830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:40.651955 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3205/6396] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:40.663387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:40.665435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:40.762927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067200a-2dec-45ad-9bdb-7e6b08e23e9d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:40.771713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:40.772289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:40.772627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:40.772920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:40.783017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:40.784543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8162-a006-4ff6-8c84-7a10a2647a7b service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:40.797607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3192/6397] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:42.465006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:42.465606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:42.466076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:42.520145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] MFA Rules not processed for user `f6d2a50d421e4b28a78565f06bb6d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:42.524085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:42.559765 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3206/6398] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:43.798343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed735-74e5-4801-9a44-ac200da8675a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:43.798999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed735-74e5-4801-9a44-ac200da8675a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:43.798999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed735-74e5-4801-9a44-ac200da8675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:43.826900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a97ed735-74e5-4801-9a44-ac200da8675a None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:43.828603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a97ed735-74e5-4801-9a44-ac200da8675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:43.912530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:43.959487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3193/6399] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:49.571191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:49.577328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:49.700650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9583920-d11c-453a-a5d5-2def017add2e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:49.710858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:49.711881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:49.712460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:49.713081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:49.715961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:49.763255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:49.766634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510b1db-b6f8-47cd-a52c-f15df7beae34 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:49.809158 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3207/6400] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:50.533424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:50.534091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:50.534091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:50.536012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3194/6401] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:16:50.564838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:50.565143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:50.565504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:50.596809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:50.598835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:50.736602 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3208/6402] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:50.764687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:50.766534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:50.817839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f791c1-e4ca-40bc-857f-31a0a5e10f12 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:50.858153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:50.858849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:50.859136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:50.859424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:50.886070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:50.887726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:50.932791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3195/6403] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:51.326123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:51.354738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:51.356289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:51.362145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9352b-c3b7-4dd5-b97d-77ad94a9efb2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:51.378979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:51.382630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:51.382895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7243-e148-4e38-9303-0f0eaea378d0 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:51.384514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:51.385376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:51.390625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:51.402507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:51.404297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:51.404297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:51.404297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:51.409926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:51.573386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:51.641586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:51.643253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:51.659460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:51.660990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce1e7e-53ac-48f4-b61a-d8c736a0a1a0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:51.678695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3196/6404] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:16:51.688711 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3209/6405] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:53.393392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:53.406201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5748-e649-4668-8b32-90a36169c92e service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:53.416918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:53.417914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:53.418391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:53.418853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:53.426484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:53.525146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:53.526657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:53.580553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3197/6406] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:55.195154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:55.195795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:55.195795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:55.228894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:55.230258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:55.316332 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3210/6407] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:55.331649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:55.334002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:55.433617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dff7b-81a7-4a1e-8ea7-6945a8896557 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:55.438889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:55.439657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:55.440002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:55.440301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:55.448747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:55.450568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:55.460462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3198/6408] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:16:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:57.491082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:57.511030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f3d2e-6737-4664-9c95-c37d2f7218a4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:57.538035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:57.538813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:57.539530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:57.539868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:57.544373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:57.563019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:57.565219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:57.572023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:57.576151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:57.585110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3211/6409] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:16:57.636113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:57.672094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c15e5-a23a-459f-8f80-518b93f572d0 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:57.677544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:57.678674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:57.679021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:57.679510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] PATH_INFO: `/v3/users/83af31935cce49c5b97d9dd2a4774e73` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:57.681069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83af31935cce49c5b97d9dd2a4774e73)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:57.683328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:57.739432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83af31935cce49c5b97d9dd2a4774e73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:57.748667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83af31935cce49c5b97d9dd2a4774e73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:57.761427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83af31935cce49c5b97d9dd2a4774e73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:57.762102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83af31935cce49c5b97d9dd2a4774e73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:57.762745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8f0374f6-2bf4-4b40-a8d6-ebcc6149b9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83af31935cce49c5b97d9dd2a4774e73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:57.780501 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3199/6410] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:16:57 2022] DELETE /identity/v3/users/83af31935cce49c5b97d9dd2a4774e73 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:57.965734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:57.979439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac025-ae01-4614-a4c3-efc36a4b3ef3 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.041576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.042455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.042739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.043015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] PATH_INFO: `/v3/projects/731db346121f4334bd2e30ba916e85be` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.044279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731db346121f4334bd2e30ba916e85be)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.046240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.097815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731db346121f4334bd2e30ba916e85be', 'request_id': 'req-5560a0b2-6c50-4d74-8904-0f49fb589f62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:58.106011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731db346121f4334bd2e30ba916e85be', 'request_id': 'req-5560a0b2-6c50-4d74-8904-0f49fb589f62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:58.112114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731db346121f4334bd2e30ba916e85be', 'request_id': 'req-5560a0b2-6c50-4d74-8904-0f49fb589f62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:58.113485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:58.125800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] The token cache is being invalidate because project 731db346121f4334bd2e30ba916e85be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:16:58.126088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:58.126734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5560a0b2-6c50-4d74-8904-0f49fb589f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:16:58.128296 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3212/6411] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:16:57 2022] DELETE /identity/v3/projects/731db346121f4334bd2e30ba916e85be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:58.133433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.133745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.134014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.152468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:58.153709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:58.226497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3200/6412] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:58.234110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.234403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.234686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.254177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:58.255409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:58.263780 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3213/6413] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:58.268144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.278038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23c522-bdd2-4d02-a5f8-99da682a2836 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.282730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.283424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.283700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.283972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.284738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:16:58.285043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.286746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.299636 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3201/6414] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:16:58.310623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.322839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede69ad-d752-4426-b64a-6f1f09030c6b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.327982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.328886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.329169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.329447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.330290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.332410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.368713 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3214/6415] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:16:58 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:16:58.369695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.382566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c6e2-5127-4f44-a641-a8df5e8e2bb4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.447304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:58.473013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.473840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.474674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.475083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.475987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.478385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.509194 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3202/6416] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:16:58 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:16:58.510582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.522219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8775b6-08f5-4a77-9583-2527a46a1ab3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.527817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.528565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.528857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.529140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.529883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.531561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.543195 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3215/6417] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:16:58.547415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.558386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277865cf-7e65-466b-8536-6abf451730bd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.563304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.563994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.564275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.564605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.565339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.566974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c358df-2e22-45a6-9508-5be0e2331110 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.578355 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3203/6418] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:16:58.582564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.594719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811c6-0dea-4648-8cea-0f93c27f7a38 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.603276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.604239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.604560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.604905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] PATH_INFO: `/v3/projects/1852fd4df3a24542bbd8ecb990222b0f/users/44144ee1bc6c4013a4f2097b46b3ac39/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.623345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1852fd4df3a24542bbd8ecb990222b0f, user_id=44144ee1bc6c4013a4f2097b46b3ac39, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.626826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.644933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3216/6419] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:16:58 2022] PUT /identity/v3/projects/1852fd4df3a24542bbd8ecb990222b0f/users/44144ee1bc6c4013a4f2097b46b3ac39/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:16:58.655557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3795c-8080-47c6-9923-d433a819f48c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.656037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3795c-8080-47c6-9923-d433a819f48c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.656451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3795c-8080-47c6-9923-d433a819f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.690107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-13a3795c-8080-47c6-9923-d433a819f48c None None] MFA Rules not processed for user `44144ee1bc6c4013a4f2097b46b3ac39`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:16:58.692036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13a3795c-8080-47c6-9923-d433a819f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:58.793833 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3204/6420] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:16:58.812467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:16:58.815203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:16:58.901374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445e02-b016-4c4e-badb-f8aef5a13f1f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:16:58.908013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:16:58.908901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:16:58.909056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:16:58.909327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:16:58.920358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:16:58.921842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:16:58.932466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3217/6421] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:00.819894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e099-03ff-4d66-a9c9-fff2f5fee0f5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:00.821060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e099-03ff-4d66-a9c9-fff2f5fee0f5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:00.821475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e099-03ff-4d66-a9c9-fff2f5fee0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:00.852690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af93e099-03ff-4d66-a9c9-fff2f5fee0f5 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:00.854193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af93e099-03ff-4d66-a9c9-fff2f5fee0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:00.949226 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3205/6422] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:00.958751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:00.960482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:01.038594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdaa4-ef52-4d29-bebc-a9ba1f37cd43 service glance] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:01.044855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:01.045529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:01.045811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:01.046092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:01.055286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:01.056936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:01.065440 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3218/6423] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:17:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:01.727152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f370600-5e3f-4175-b610-90510d827483 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:01.727443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f370600-5e3f-4175-b610-90510d827483 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:01.727730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f370600-5e3f-4175-b610-90510d827483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:01.753911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5f370600-5e3f-4175-b610-90510d827483 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:01.755961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5f370600-5e3f-4175-b610-90510d827483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:01.766260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3206/6424] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:01.783812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:01.801944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078089e-5284-4255-b6e6-4b81bd09c825 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:01.808969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:01.812966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:01.813653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:01.813946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:01.832083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:01.834102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:01.842636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:01.845413 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3219/6425] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:02.131098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc8042-dda0-497a-a901-21346327c7a1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:02.132591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc8042-dda0-497a-a901-21346327c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:02.133099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc8042-dda0-497a-a901-21346327c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:02.170984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-48cc8042-dda0-497a-a901-21346327c7a1 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:02.173458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48cc8042-dda0-497a-a901-21346327c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:02.203606 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3207/6426] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:02.208846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:02.227089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227b6f5-463f-45cb-a1e1-59473e5f782d service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:02.241685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:02.242918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:02.243389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:02.243685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:02.254982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:02.257111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6286bc-b640-4c64-9934-6c407b85276d service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:02.267641 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3220/6427] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:02.337210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:02.337989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:02.338997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:02.371688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] MFA Rules not processed for user `3648405427d14f91a4bb44bd81f2195b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:02.373296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:02.417871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:02.467778 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3208/6428] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:02.831422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:02.831906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:02.832522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:02.859068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:02.860755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:02.869611 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3221/6429] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:02.884221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:02.903185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8fa8-7ed7-4fc2-9d66-457e79199575 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:02.912107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:02.913675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:02.914410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:02.914877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:02.925932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:02.928723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:02.939793 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3209/6430] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:04.734321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:04.736958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:04.869215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1b2a-6bec-4019-b771-6988e2d73fa9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:04.873982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:04.875153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:04.875642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:04.876089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] PATH_INFO: `/v3/users/1554f1d20e344432b617857d279f6d37` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:04.877592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1554f1d20e344432b617857d279f6d37)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:04.879741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:04.944628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1554f1d20e344432b617857d279f6d37'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:04.945369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1554f1d20e344432b617857d279f6d37'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:04.956937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1554f1d20e344432b617857d279f6d37'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:04.972615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1554f1d20e344432b617857d279f6d37'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:04.979925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d581a97-139d-4c77-ba56-f12a4ea41867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1554f1d20e344432b617857d279f6d37'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:04.989642 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3222/6431] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:04 2022] DELETE /identity/v3/users/1554f1d20e344432b617857d279f6d37 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:05.185249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.201573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f404-6277-49e3-93a1-968f5c90cb8a service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.270973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.271812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.272098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.272374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] PATH_INFO: `/v3/projects/0a0dcb1380ad41328b6779588f0e91f6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.273605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0dcb1380ad41328b6779588f0e91f6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.275547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.333227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0dcb1380ad41328b6779588f0e91f6', 'request_id': 'req-e7a9214d-a150-4ee5-99cb-48511858ff17'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.342491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0dcb1380ad41328b6779588f0e91f6', 'request_id': 'req-e7a9214d-a150-4ee5-99cb-48511858ff17'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.348161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0dcb1380ad41328b6779588f0e91f6', 'request_id': 'req-e7a9214d-a150-4ee5-99cb-48511858ff17'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.360585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] The token cache is being invalidate because project 0a0dcb1380ad41328b6779588f0e91f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:05.360699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.361458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e7a9214d-a150-4ee5-99cb-48511858ff17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.363179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3210/6432] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:05 2022] DELETE /identity/v3/projects/0a0dcb1380ad41328b6779588f0e91f6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:05.372638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.373030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.373525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.394334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:05.395463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:05.449373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:05.459840 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3223/6433] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:05.467884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.468217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.468467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.488068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:05.489326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:05.498640 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3211/6434] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:05.503140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.514081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9109a-b311-4c96-878e-1cdfaf996043 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.518925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.519673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.520036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.520962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.521326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:05.521633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.523356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.535692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3224/6435] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:05.540150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.550089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be2f7-aa12-4e8e-85f9-b4cda837e008 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.555282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.556016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.556298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.556662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.557529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.559453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.586952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3212/6436] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:05.591237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.601949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad7162-54ab-4832-a323-84e90766277f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.628329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.630192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:05.660413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.661241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.661673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.662045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.662759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.664748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.667011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:05.687422 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3225/6437] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:05.697583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.712902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b82e-2199-4c26-b6c9-f6dc1c044e05 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.713881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534314-3eaf-4d26-9705-f34b680d64cc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.718013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.719029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.719254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.719587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] PATH_INFO: `/v3/users/f6d2a50d421e4b28a78565f06bb6d3a0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.720302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.721058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.721187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d2a50d421e4b28a78565f06bb6d3a0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.721947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.722232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.722959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.723081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.724798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.749575 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3226/6438] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:05.750832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.762684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fa657-1fa2-4f2d-af37-1bf7e790a6d6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.768366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.769077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.769354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.769640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.770371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.772304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.781012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d2a50d421e4b28a78565f06bb6d3a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.784859 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3227/6439] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:05.789739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:05.790971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d2a50d421e4b28a78565f06bb6d3a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.803125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2c53-3f72-4f06-b47c-e75dc1a67e83 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:05.814841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:05.817817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.818243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.818664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] PATH_INFO: `/v3/projects/dce3ea30a91f4da88114c0b46f0da072/users/a1f25cae32934f7292dd0d658a9e613b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.821419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d2a50d421e4b28a78565f06bb6d3a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.822600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d2a50d421e4b28a78565f06bb6d3a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.824025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-756d4c82-ebd2-4f17-a039-9901cfea5b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d2a50d421e4b28a78565f06bb6d3a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:05.843044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce3ea30a91f4da88114c0b46f0da072, user_id=a1f25cae32934f7292dd0d658a9e613b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:05.845842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec955d89-658f-4368-9e89-7d21d7b3bfc9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:05.852770 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3213/6440] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:05 2022] DELETE /identity/v3/users/f6d2a50d421e4b28a78565f06bb6d3a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:05.857790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.858331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.859301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.875806 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3228/6441] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:05 2022] PUT /identity/v3/projects/dce3ea30a91f4da88114c0b46f0da072/users/a1f25cae32934f7292dd0d658a9e613b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:05.877980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:05.878278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:05.878553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:05.883197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:05.884535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:05.910238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] MFA Rules not processed for user `a1f25cae32934f7292dd0d658a9e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:05.911605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:05.976729 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3214/6442] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:06.003389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.006049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.100775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3229/6443] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:06.115796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.119801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.148609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238031-cbe9-41b7-acb2-6eea5fef0a4b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.151298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc36a-5375-415e-af79-e331ed3df4dd None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.156494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.158285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.159057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.159362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.159626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.159742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.160103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.161665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.162650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.164701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.184822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:06.188576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.190792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.204822 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3215/6444] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:06.209684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:06.220017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3230/6445] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:06.233559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.255887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c17d-9128-4ed6-ad9d-705d1bd15ce7 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.338392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.339628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.340095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.340585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.341484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.343873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.381918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3216/6446] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:06.383546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.395726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842eb10-4893-42e7-9b88-871dbecb4075 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.400844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.401734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.401967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.402321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.403128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.405554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.422884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3231/6447] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:06.425102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.437180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61dcc-eaad-443d-9e1c-e47a7aa2313f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.441725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.442728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.443011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.443285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] PATH_INFO: `/v3/projects/fb086b0ed81d409086ee88560ffdc496/users/d3b6e414a30846c1aa9ad33502a25128/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.463073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb086b0ed81d409086ee88560ffdc496, user_id=d3b6e414a30846c1aa9ad33502a25128, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.463353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.466054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.466193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.484849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015b59-4004-4d50-bc6a-c42080966a9d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.488028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3217/6448] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:06 2022] PUT /identity/v3/projects/fb086b0ed81d409086ee88560ffdc496/users/d3b6e414a30846c1aa9ad33502a25128/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:06.491976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.569627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.570680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.570974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.571278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] PATH_INFO: `/v3/projects/15f9fd4b47d743aa9ba0081392ed3fc5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.577360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f9fd4b47d743aa9ba0081392ed3fc5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.577360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.591357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59c35e-2317-4c32-88dc-57fb93b47afb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.603461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.604180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.604492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.604917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.605790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.607854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.629166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3218/6449] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:06.630316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.646196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f4f1d-a833-4a9a-a851-9cdd20b9b782 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:06.660629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f9fd4b47d743aa9ba0081392ed3fc5', 'request_id': 'req-69f4c63f-a9f5-45ce-9b64-2dbec806701f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:06.689551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f9fd4b47d743aa9ba0081392ed3fc5', 'request_id': 'req-69f4c63f-a9f5-45ce-9b64-2dbec806701f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:06.700220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f9fd4b47d743aa9ba0081392ed3fc5', 'request_id': 'req-69f4c63f-a9f5-45ce-9b64-2dbec806701f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:06.734582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] The token cache is being invalidate because project 15f9fd4b47d743aa9ba0081392ed3fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:06.734868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:06.735707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-69f4c63f-a9f5-45ce-9b64-2dbec806701f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:06.740539 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3232/6450] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:06 2022] DELETE /identity/v3/projects/15f9fd4b47d743aa9ba0081392ed3fc5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:06.742508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3ade-c3d8-46b2-8d7c-a0a146ace785 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.742876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3ade-c3d8-46b2-8d7c-a0a146ace785 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.743247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3ade-c3d8-46b2-8d7c-a0a146ace785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.747709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:06.765163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:06.766169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.766520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.766870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] PATH_INFO: `/v3/projects/fb086b0ed81d409086ee88560ffdc496/users/d3b6e414a30846c1aa9ad33502a25128/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.769220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb086b0ed81d409086ee88560ffdc496, user_id=d3b6e414a30846c1aa9ad33502a25128, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:06.772102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebad0a-c909-4121-b4fd-f9b8fe30b77c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:06.774647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3e5d3ade-c3d8-46b2-8d7c-a0a146ace785 None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:06.775857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e5d3ade-c3d8-46b2-8d7c-a0a146ace785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.788368 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3219/6451] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:06 2022] PUT /identity/v3/projects/fb086b0ed81d409086ee88560ffdc496/users/d3b6e414a30846c1aa9ad33502a25128/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:06.798047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56185b-7993-44ae-94c7-9ace6b263a3a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.798047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56185b-7993-44ae-94c7-9ace6b263a3a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.798047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56185b-7993-44ae-94c7-9ace6b263a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.829057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7c56185b-7993-44ae-94c7-9ace6b263a3a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:06.830529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7c56185b-7993-44ae-94c7-9ace6b263a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.863906 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3233/6452] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:06.866106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.866509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.866890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.902561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] MFA Rules not processed for user `d3b6e414a30846c1aa9ad33502a25128`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:06.904317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.912829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3220/6453] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:06.920792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:06.921559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:06.922027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:06.924833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:06.953767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:06.956568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:06.973777 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3221/6454] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:06.977917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:06.996948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933d0f2-90d7-43b7-9376-8689e54a58b4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.007095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.007244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.007440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.007716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.008533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:07.008844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.012123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.028740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3222/6455] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:07.032964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.042795 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3234/6456] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:07.046060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a6e7-2e80-4d70-b0df-c5f4f574f461 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.047772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.051700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.052545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.052894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.053808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.054572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.056630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.057663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028d65-9a6a-4174-ae19-f5bc39ff437c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.063730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.064337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.064768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.065117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.066072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.068328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.091967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3223/6457] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:07 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:07.094031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.120962 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3235/6458] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:07 2022] POST /identity/v3/projects => generated 357 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:07.123807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.196724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc657df-4262-4eaa-9de5-235803e1e18d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.216704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d8d6a-1e6f-468f-927e-7eaec5fe1b4a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.222169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.223589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.224048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.224461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-83797928` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.226122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=a4cddc5e857b497895a3ba555ec32191, value=tempest-tag-83797928)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.229706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.271563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:07.280031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.280946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.281451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.281923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.282796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.285564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.308437 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-83797928. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:17:07.308437 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:17:07.308437 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:07.314842 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3236/6459] 10.222.0.39 () {60 vars in 1326 bytes} [Sat Jun 25 21:17:07 2022] PUT /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-83797928 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 289 bytes (2 switches on core 0) Jun 25 21:17:07.320598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.334108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5a00d-0a23-402f-9a1a-40e77fb03882 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.340477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.341730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.341730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.342281 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3224/6460] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:07 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:07.347504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-83797928` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.348665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.360295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b63245-f35b-4038-8df0-6ab87634b161 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.365785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.365963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=a4cddc5e857b497895a3ba555ec32191, value=tempest-tag-83797928)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.366694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.367065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.367437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.368256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.368486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.370062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.385203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3225/6461] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:17:07.387256 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3237/6462] 10.222.0.39 () {58 vars in 1307 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-83797928 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:07.391233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.391396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.403166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24b34-261a-4919-bb97-12bcadfa5a97 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.408622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d77d7-804c-4eba-b8a5-5288d79ad5fe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.409760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.410843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.411272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.411603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.413992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=a4cddc5e857b497895a3ba555ec32191)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.416257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.416884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.418486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.418953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.419868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.421285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.423117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.438633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3226/6463] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:07.442860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:07.444884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.458783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1a31-1b7e-4ce2-904c-8bdd0e1c01ab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.466242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.467264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.467571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.467916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] PATH_INFO: `/v3/projects/5a7efe5a3d7f4380b6e1ee40d4628ea8/users/871c269a6b15425d8b79a6c653c56402/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.483345 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3238/6464] 10.222.0.39 () {60 vars in 1264 bytes} [Sat Jun 25 21:17:07 2022] PUT /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags => generated 139 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:07.485261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.486628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7efe5a3d7f4380b6e1ee40d4628ea8, user_id=871c269a6b15425d8b79a6c653c56402, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.489263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd4a87-fcdf-4a2c-b2d7-ec48243b20c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.498126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045636c-b09b-4f43-b1dd-5389dc9914e8 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.506724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.507727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3227/6465] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:07 2022] PUT /identity/v3/projects/5a7efe5a3d7f4380b6e1ee40d4628ea8/users/871c269a6b15425d8b79a6c653c56402/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:07.509061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.509415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.509784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.512998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.513391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.513742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.524671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=a4cddc5e857b497895a3ba555ec32191)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.526971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.538924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3239/6466] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags => generated 139 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:07.540074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:07.541436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:07.542923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.554393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5d68d-2c67-4871-9473-2d97b9dd699d tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.618620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3228/6467] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:07.628963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.631485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:07.640202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.641555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.642074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.642713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-80135757` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.644476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=a4cddc5e857b497895a3ba555ec32191, value=tempest-tag-80135757)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.647252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.702991 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-80135757. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:17:07.702991 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:17:07.702991 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:07.713744 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3240/6468] 10.222.0.39 () {58 vars in 1310 bytes} [Sat Jun 25 21:17:07 2022] DELETE /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-80135757 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:07.715004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.715420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6b749-c4e7-4159-8a68-47216a86d28a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.725224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.726860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.727426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.727915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.729800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021670e-28d3-4f94-a9ad-c367765ed29c tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.736044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.737149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.737871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.737871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-80135757` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.740988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.743237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.755670 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3229/6469] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:17:07.758365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=a4cddc5e857b497895a3ba555ec32191, value=tempest-tag-80135757)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.761145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Could not find project tag: tempest-tag-80135757.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-80135757. Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jun 25 21:17:07.789302 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-80135757. Jun 25 21:17:07.791680 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:07.794129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3241/6470] 10.222.0.39 () {58 vars in 1307 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags/tempest-tag-80135757 => generated 105 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:07.797133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.825025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf2fe-e15e-49a4-a36e-d372db13136d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.831626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.833959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.833959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.833959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.836137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=a4cddc5e857b497895a3ba555ec32191)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.840053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.911491 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3230/6471] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:17:07 2022] DELETE /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:07.914826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.929178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb4994-9238-49b4-98ca-70eef6a8896a tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.938114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:07.939131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:07.939478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:07.939788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:07.959638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=a4cddc5e857b497895a3ba555ec32191)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:07.961965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:07.975268 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3242/6472] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:17:07 2022] GET /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191/tags => generated 66 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:17:07.979221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:07.992831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c48e7d-b4e0-4f20-b535-471cc3eb2d33 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:07.999573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b6e414a30846c1aa9ad33502a25128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb086b0ed81d409086ee88560ffdc496', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:08.000671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:08.001189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:08.001539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] PATH_INFO: `/v3/projects/a4cddc5e857b497895a3ba555ec32191` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:08.002860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4cddc5e857b497895a3ba555ec32191)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:08.005008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:08.007057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:08.072933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cddc5e857b497895a3ba555ec32191', 'request_id': 'req-92bbd96f-3296-4f17-891e-9a998884bd7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.089920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cddc5e857b497895a3ba555ec32191', 'request_id': 'req-92bbd96f-3296-4f17-891e-9a998884bd7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.098558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cddc5e857b497895a3ba555ec32191', 'request_id': 'req-92bbd96f-3296-4f17-891e-9a998884bd7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.133501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] The token cache is being invalidate because project a4cddc5e857b497895a3ba555ec32191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:08.133995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.134641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-92bbd96f-3296-4f17-891e-9a998884bd7b tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.141307 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3231/6473] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:07 2022] DELETE /identity/v3/projects/a4cddc5e857b497895a3ba555ec32191 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:08.142270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:08.144938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:08.160594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7d4f-9638-487e-b1b4-eb3bc28965f9 tempest-IdentityV3ProjectTagsTest-1619951304 tempest-IdentityV3ProjectTagsTest-1619951304-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:08.246178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:08.284805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:08.285983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:08.286714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:08.287315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] PATH_INFO: `/v3/users/a1f25cae32934f7292dd0d658a9e613b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:08.289214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f25cae32934f7292dd0d658a9e613b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:08.292365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:08.380800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f25cae32934f7292dd0d658a9e613b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.381801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f25cae32934f7292dd0d658a9e613b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.406877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f25cae32934f7292dd0d658a9e613b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.428509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f25cae32934f7292dd0d658a9e613b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.437338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f25cae32934f7292dd0d658a9e613b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:08.453259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3243/6474] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:08 2022] DELETE /identity/v3/users/a1f25cae32934f7292dd0d658a9e613b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:08.456851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:08.458253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:08.458801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:08.499338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:08.501612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:08.657752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3232/6475] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:08.664844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:08.667065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:08.782919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f8fe-cb85-470d-8896-e881e08cd42f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:08.788169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:08.789255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:08.789583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:08.790199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:08.815443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:08.821083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:08.841731 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3244/6476] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:17:09.230505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:09.232453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:09.256737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8e1ea-d1f9-43a0-af5f-7e772e296038 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:09.276365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:09.277672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:09.278167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:09.278520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] PATH_INFO: `/v3/projects/dce3ea30a91f4da88114c0b46f0da072` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:09.280770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce3ea30a91f4da88114c0b46f0da072)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:09.282973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:09.367898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce3ea30a91f4da88114c0b46f0da072', 'request_id': 'req-b804a00b-d13d-4b38-95fa-44b732650739'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.378050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce3ea30a91f4da88114c0b46f0da072', 'request_id': 'req-b804a00b-d13d-4b38-95fa-44b732650739'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.385651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce3ea30a91f4da88114c0b46f0da072', 'request_id': 'req-b804a00b-d13d-4b38-95fa-44b732650739'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.400914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] The token cache is being invalidate because project dce3ea30a91f4da88114c0b46f0da072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:09.401873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.403293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.405558 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3233/6477] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:09 2022] DELETE /identity/v3/projects/dce3ea30a91f4da88114c0b46f0da072 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:09.410988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:09.421524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d45cb9-4ca0-43ab-b286-625eadd8891f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:09.512552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:09.513709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:09.514064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:09.514467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] PATH_INFO: `/v3/users/d3b6e414a30846c1aa9ad33502a25128` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:09.516238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b6e414a30846c1aa9ad33502a25128)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:09.518052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:09.522628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:09.594749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b6e414a30846c1aa9ad33502a25128'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.595752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b6e414a30846c1aa9ad33502a25128'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.608312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b6e414a30846c1aa9ad33502a25128'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.627566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b6e414a30846c1aa9ad33502a25128'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.645673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6697594a-76e2-4e65-9d80-0365925e4f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b6e414a30846c1aa9ad33502a25128'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:09.662039 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3245/6478] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:09 2022] DELETE /identity/v3/users/d3b6e414a30846c1aa9ad33502a25128 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:10.229403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:10.230978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:10.256122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a00b-d13d-4b38-95fa-44b732650739 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:10.269319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:10.348340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:10.350015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.350485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.350919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] PATH_INFO: `/v3/projects/fb086b0ed81d409086ee88560ffdc496` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.352535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb086b0ed81d409086ee88560ffdc496)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:10.354937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:10.427922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb086b0ed81d409086ee88560ffdc496', 'request_id': 'req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:10.445066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb086b0ed81d409086ee88560ffdc496', 'request_id': 'req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:10.452391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb086b0ed81d409086ee88560ffdc496', 'request_id': 'req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:10.492663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] The token cache is being invalidate because project fb086b0ed81d409086ee88560ffdc496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:10.493261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:10.494072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cf3dbc7b-c159-44fb-8cc8-18e5535410e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:10.500333 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3234/6479] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:10 2022] DELETE /identity/v3/projects/fb086b0ed81d409086ee88560ffdc496 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:10.507844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a367-959b-4c91-847c-cc16ac50efdb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.509239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a367-959b-4c91-847c-cc16ac50efdb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.509720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a367-959b-4c91-847c-cc16ac50efdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.538530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2525a367-959b-4c91-847c-cc16ac50efdb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:10.540782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2525a367-959b-4c91-847c-cc16ac50efdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:10.588791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.589002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.589334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.646959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] MFA Rules not processed for user `871c269a6b15425d8b79a6c653c56402`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:10.648386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:10.706848 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3246/6480] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:10.713391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.713804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.714459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.760417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:10.761751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:10.762016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3235/6481] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:10.774875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:10.777417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:10.806831 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3247/6482] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:10.807804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:10.849215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:10.857861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6d7d-7e63-4c5a-b9cd-1457c958e0c3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:10.881530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:10.882112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.882393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.882645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.890105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:10.890426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:10.900387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:10.907783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c4a5-2f85-4281-b213-b9b5bc252b16 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:10.913096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:10.914122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.914770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.915381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.929585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:10.931447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:10.939603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3248/6483] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:10.944080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:10.960222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3236/6484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:10.968546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023e46-cb29-4cd4-bbd0-23a1478932dc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:10.983792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:10.990274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:10.990561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:10.990845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:10.991567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:10.993556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.074763 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3249/6485] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:10 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:11.080605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.103176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f89ee-18a6-4f55-aeeb-4a646ee75681 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.231436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:11.232121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.233399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.233691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.234536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:11.238737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.272525 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3237/6486] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:11 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:11.274369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.287874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9909d04-f09f-474b-b508-94f2b1a46dbb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.295365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:11.296244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.296568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.296852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.297737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:11.300534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.318794 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3250/6487] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:11.323570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.339282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a60f4d-d352-45d1-9684-68c8bf088e0a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.347761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:11.348737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.349237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.349704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.350616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:11.353650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a778a5-d7dc-4f79-9cea-3e70aeb2f52f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.371614 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3238/6488] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:11.373858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.387888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a69a9-137d-405d-b140-8c891a3a8a4b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.394502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:11.395623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.396051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.396393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] PATH_INFO: `/v3/projects/18f6d5e25e4c4f0cb0f947e7fa5d5f9e/users/8bcc7ea5d8d54c58a259367c8b228abf/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.416622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f6d5e25e4c4f0cb0f947e7fa5d5f9e, user_id=8bcc7ea5d8d54c58a259367c8b228abf, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:11.419377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.461331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3251/6489] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:11 2022] PUT /identity/v3/projects/18f6d5e25e4c4f0cb0f947e7fa5d5f9e/users/8bcc7ea5d8d54c58a259367c8b228abf/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:11.548515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.548870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.549162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.581713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] MFA Rules not processed for user `8bcc7ea5d8d54c58a259367c8b228abf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:11.583945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:11.682191 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3239/6490] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:11.683442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.690649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:11.770616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec81b-1686-4e52-a92c-3270c8d0056c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.776241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:11.778048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:11.778351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:11.778640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:11.779366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:11.781519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:11.855292 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3252/6491] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:11 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:11.857021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.881087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60d00-b1b5-41c3-8e89-6d81e3e3d735 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:11.895048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:11.897228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:11.980142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:12.030255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd394a-ae0a-4926-8c80-0fb99e8a674d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.035865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.037173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.037653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.038084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] PATH_INFO: `/v3/users/44144ee1bc6c4013a4f2097b46b3ac39` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.039598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44144ee1bc6c4013a4f2097b46b3ac39)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.041812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.044757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.045948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.046333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.046709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.050995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.054987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.123395 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3240/6492] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:11 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:12.127006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.128094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44144ee1bc6c4013a4f2097b46b3ac39'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:12.130118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44144ee1bc6c4013a4f2097b46b3ac39'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:12.140579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44144ee1bc6c4013a4f2097b46b3ac39'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:12.155041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c61c10-0829-4f80-a3da-8e1f4a57cd01 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.164196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44144ee1bc6c4013a4f2097b46b3ac39'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:12.168885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.169731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.170184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.170566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.171664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.173771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.179016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-85887155-2b60-441e-a017-cfe96b078a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44144ee1bc6c4013a4f2097b46b3ac39'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:12.188756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3241/6493] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:12.192808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.194045 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3253/6494] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:11 2022] DELETE /identity/v3/users/44144ee1bc6c4013a4f2097b46b3ac39 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:12.196572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:12.200002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.200617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.202309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.224196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef608a4d-90be-4d00-bd0a-801672fb6070 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.239974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:12.242069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:12.246971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:12.303630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.304711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.304992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.305313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] PATH_INFO: `/v3/projects/20bf48cc31d8450a866d651ed2a114cd/users/9f859127e1dc4e5f9f8eb5db6874d7ad/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.317970 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3254/6495] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:12.329161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bf48cc31d8450a866d651ed2a114cd, user_id=9f859127e1dc4e5f9f8eb5db6874d7ad, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.331848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.333667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.335279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:12.358709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3242/6496] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:12 2022] PUT /identity/v3/projects/20bf48cc31d8450a866d651ed2a114cd/users/9f859127e1dc4e5f9f8eb5db6874d7ad/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:12.365520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.409890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9538-0eb3-42f3-8e2e-dc91b1d4ad09 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.459968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911d5-ed18-4cb8-89f5-d9dc6cd40b03 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.465245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.466031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.466409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.466786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.467617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.469382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.473437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.474226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.475311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.475462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.484713 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3243/6497] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:12.487091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.489647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.491907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab784-1f99-4967-89a7-3caac7958203 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.505862 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3255/6498] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:12.517234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5748d-9775-4bb9-9b0f-6f90e8a7876f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.523551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.523920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.524269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.524680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] PATH_INFO: `/v3/projects/20bf48cc31d8450a866d651ed2a114cd/users/9f859127e1dc4e5f9f8eb5db6874d7ad/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.527145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bf48cc31d8450a866d651ed2a114cd, user_id=9f859127e1dc4e5f9f8eb5db6874d7ad, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.530273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.545413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3244/6499] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:12 2022] PUT /identity/v3/projects/20bf48cc31d8450a866d651ed2a114cd/users/9f859127e1dc4e5f9f8eb5db6874d7ad/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:12.557588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.558141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.558460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.605909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] MFA Rules not processed for user `9f859127e1dc4e5f9f8eb5db6874d7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:12.609077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:12.738897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:12.763998 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3256/6500] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:12.764244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.784039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12a9e-9d4f-40c4-8812-d47f8ce1f9fc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.834155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.835151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.838874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.839171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.842556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.846186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.885629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3245/6501] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:12 2022] POST /identity/v3/roles => generated 235 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:12.887102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.901849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8edd30-c8ff-41d5-8480-5a9742465d20 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.918108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.919632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.922560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.923299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.923868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:12.928133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:12.959434 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3257/6502] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:12 2022] POST /identity/v3/roles => generated 234 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:12.963627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:12.986726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc7b1-f911-46b1-9d79-c0035062a236 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:12.996273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:12.997077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:12.997368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:12.997654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:12.998434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.000255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.003817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:13.045159 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3246/6503] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:12 2022] POST /identity/v3/roles => generated 235 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:13.048575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.051622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.052570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.072713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f2ce-65b3-41ef-9a38-9ad8d69d2e67 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.080962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.081823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.084305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.084797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.085648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.087616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.134772 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3247/6504] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/domains => generated 277 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:13.139251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.167500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18871e99-547f-4e7c-b10a-e0649768fdb1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.217178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa604a-23ae-42cc-a464-035ee78349b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.222169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.222840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.223128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.223396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.224176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.226144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.228839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.229725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.230012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.230288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] PATH_INFO: `/v3/projects/1852fd4df3a24542bbd8ecb990222b0f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.231593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1852fd4df3a24542bbd8ecb990222b0f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.233580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.266077 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3248/6505] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:13.270465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.290096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1852fd4df3a24542bbd8ecb990222b0f', 'request_id': 'req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:13.299198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1852fd4df3a24542bbd8ecb990222b0f', 'request_id': 'req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:13.306688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1852fd4df3a24542bbd8ecb990222b0f', 'request_id': 'req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:13.321413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] The token cache is being invalidate because project 1852fd4df3a24542bbd8ecb990222b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:13.321717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:13.322434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-627901e3-bb88-47c6-9fc8-a6567d9ff8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:13.325050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3258/6506] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:13 2022] DELETE /identity/v3/projects/1852fd4df3a24542bbd8ecb990222b0f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:13.329258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7208-7aff-4708-8f6c-1ad5d7ad0b70 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.329622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7208-7aff-4708-8f6c-1ad5d7ad0b70 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.329902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7208-7aff-4708-8f6c-1ad5d7ad0b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.348754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b080-9868-42ed-be3d-e23e247f32ef tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.349332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5ffd7208-7aff-4708-8f6c-1ad5d7ad0b70 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:13.350363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5ffd7208-7aff-4708-8f6c-1ad5d7ad0b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.362761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:13.419073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.419382 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3259/6507] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:13.420310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.420641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.420919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.421617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.422665 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:13.422665 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:13.422665 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:13.423863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.430350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.430718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.431075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.440225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:13.452830 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3249/6508] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/groups => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:13.455633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.458142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.462408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:13.463771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.470599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81468deb-6790-4d53-98cd-c8f5bf39d9b8 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.476632 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3260/6509] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:13.477685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.478971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.479653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.479940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.480221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.480986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.482648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.487408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01086a-60be-4859-81d2-bec3c57df406 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.492554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.493231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.493787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.493787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.494520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:13.494836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.496757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.504476 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3250/6510] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/roles => generated 235 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:13.509128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.516934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3261/6511] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:13.521953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.523465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead453f-bd9c-45a5-9725-491bff6a678a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.529023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.530073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.530834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.530834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.531486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.533384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50de90d-5f3e-402e-a77a-339db9dccf98 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.533532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.540086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.540823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.541137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.541435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.542271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.544557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.556863 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3251/6512] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/users => generated 439 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:13.557811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.559571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.583344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3262/6513] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:13.585444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.662833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a345503-4eb2-4a50-b166-297367ff66fe admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.667418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.668104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.668390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.668704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.669481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.669997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f98d12-0e6a-45e2-bfc7-322d69383561 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.670524 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:13.670524 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:13.670524 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:13.671418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.688973 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3263/6514] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/roles => generated 270 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:13.688973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.740141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.740841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.741126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.741401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.743249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:13.749845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248195-b6ae-46d7-8a2f-911984492a1f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.754592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.755353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.755639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.755984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.756634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.758572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.775342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:13.783016 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3264/6515] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:13 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:13.784506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.796727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b08a2-eecf-4049-83a0-5a60a45ddb76 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.801575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.802487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.802774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.803044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/6af2de66b38e4184aaac34a2ddb8f92c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.804768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.806461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.819511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3252/6516] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:13.824789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=6af2de66b38e4184aaac34a2ddb8f92c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.827699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.831388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.838724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:13.846197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304d10-846d-4810-bf9c-135b1a2dd1c3 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.847197 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3265/6517] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:13 2022] PUT /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/6af2de66b38e4184aaac34a2ddb8f92c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:13.851872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.914480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.915395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.915682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.915957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.916757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.918704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.936054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3253/6518] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:13 2022] GET /identity/v3/roles => generated 2323 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:13.936283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b3a9c-e0af-4692-9723-cdbbfb39099b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.937346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:13.940729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.941694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.942101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.942599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.943528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Adding query filter params (scope.project.id=c4368b96f88b474eafe5c2c472fe437d, user.id=8b6f864483c04e51b33474835166dbd8) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:13.943942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.945399 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:13.945399 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:13.945399 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:13.947497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.951355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48eba9-e34b-4d4b-b2fd-537a166b2231 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:13.959323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:13.961060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:13.961198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:13.961408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:13.963286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:13.965370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:13.978225 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3254/6519] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:13 2022] GET /identity/v3/roles => generated 2323 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:13.982950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.009440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642af6-4ed7-4fc8-bf5f-27d276ebad52 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.015201 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3266/6520] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:17:13 2022] GET /identity/v3/role_assignments?scope.project.id=c4368b96f88b474eafe5c2c472fe437d&user.id=8b6f864483c04e51b33474835166dbd8&effective => generated 228 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:14.029094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.029094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.029094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.029539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.029646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] PATH_INFO: `/v3/projects/2f38a9584ed44c0d99279ad9953e4f4e/users/ea017638ef5b4335bbb2ef657217d7bd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.045148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f38a9584ed44c0d99279ad9953e4f4e, user_id=ea017638ef5b4335bbb2ef657217d7bd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.048176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e5d5-470c-4bdd-aeb5-e0a9a130f396 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.048404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552bf4-9fc1-49fc-8d1d-84632d8f3f3d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.057685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.059013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.059506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.063797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/6af2de66b38e4184aaac34a2ddb8f92c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.070451 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3255/6521] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:13 2022] PUT /identity/v3/projects/2f38a9584ed44c0d99279ad9953e4f4e/users/ea017638ef5b4335bbb2ef657217d7bd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:14.080980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=6af2de66b38e4184aaac34a2ddb8f92c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.083114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.083906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.084039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.084483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.093993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 6af2de66b38e4184aaac34a2ddb8f92c was removed from user 8b6f864483c04e51b33474835166dbd8 on project c4368b96f88b474eafe5c2c472fe437d. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:14.094249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:14.095565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:14.115177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3267/6522] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:17:14 2022] DELETE /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/6af2de66b38e4184aaac34a2ddb8f92c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:14.119617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.120799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] MFA Rules not processed for user `ea017638ef5b4335bbb2ef657217d7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:14.121443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:14.122678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:14.201155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050627-fba1-4498-98a8-7d4bb6f2cd1e tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.207989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.210211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.210583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.210940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/6af2de66b38e4184aaac34a2ddb8f92c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.212361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6af2de66b38e4184aaac34a2ddb8f92c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.214061 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:14.214061 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:14.214061 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:14.215252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.222171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3256/6523] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:14.238436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:14.241956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.243891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:14.281517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 6af2de66b38e4184aaac34a2ddb8f92c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:14.282074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:14.283076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:14.285309 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3268/6524] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:14 2022] DELETE /identity/v3/roles/6af2de66b38e4184aaac34a2ddb8f92c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:14.291216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.293645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:14.326052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5400e-f36b-4a20-9b38-6215a8fc9f0f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.331769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:14.390580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189579-9341-493e-998e-3b9ef1001cbf tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.398159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.400049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.400404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.401097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/4d8dc23d00d848cea01c638f3b88cab6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.404106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=4d8dc23d00d848cea01c638f3b88cab6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.404458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.405334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.405621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.405902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.407947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.408134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:14.431661 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3269/6525] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:14 2022] PUT /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/4d8dc23d00d848cea01c638f3b88cab6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:14.435684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.519816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.521731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.533973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3257/6526] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:14.539816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b93-7dd9-44e1-8488-ef0d82064a15 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.544958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.545905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.546287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.546553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.548334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.549420 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:14.549420 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:14.549420 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:14.550322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.616375 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3270/6527] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:14 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 520 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:14.618108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.632334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2081f6-65ef-4d46-9167-cf5cc7cbe661 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.726534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.727426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.727787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.728131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.729133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Adding query filter params (scope.project.id=c4368b96f88b474eafe5c2c472fe437d, user.id=8b6f864483c04e51b33474835166dbd8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:14.729514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.730890 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:14.730890 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:14.730890 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:14.732314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.836536 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3258/6528] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:17:14 2022] GET /identity/v3/role_assignments?scope.project.id=c4368b96f88b474eafe5c2c472fe437d&user.id=8b6f864483c04e51b33474835166dbd8&effective => generated 1061 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:14.840891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.855676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea46d-b808-49ce-99b6-1170976508bd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.872684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:14.874614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:14.874772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:14.875035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:14.879344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:14.880603 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:14.880603 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:14.880603 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:14.881495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:14.900153 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3271/6529] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:14 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:14.904502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:14.916877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a839f4-df93-4a8f-acc0-a3c2493e7ec1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:14.949291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:15.159173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.161735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.162237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.163552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.164881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Adding query filter params (scope.project.id=c4368b96f88b474eafe5c2c472fe437d, user.id=8b6f864483c04e51b33474835166dbd8) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:15.165459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.168171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.235185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3259/6530] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:17:14 2022] GET /identity/v3/role_assignments?scope.project.id=c4368b96f88b474eafe5c2c472fe437d&user.id=8b6f864483c04e51b33474835166dbd8&effective => generated 577 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:15.240167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.253041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b08c-deb9-4993-8185-3793566d5522 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.260462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.262094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.262553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.263270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.265624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.268144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901.: keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = query.one() Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._iter().one() Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._only_one_row( Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:15.299557 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:15.301067 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:15.302428 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3272/6531] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:15 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 137 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:15.306836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.318778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6914b4b-1130-4672-a97a-7e82bcfcd357 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.339250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.340762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.341059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.341343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/4d8dc23d00d848cea01c638f3b88cab6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.347331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=4d8dc23d00d848cea01c638f3b88cab6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.351505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.365195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 4d8dc23d00d848cea01c638f3b88cab6 was removed from user 8b6f864483c04e51b33474835166dbd8 on project c4368b96f88b474eafe5c2c472fe437d. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:15.365610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:15.366421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:15.393874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3260/6532] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:17:15 2022] DELETE /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/4d8dc23d00d848cea01c638f3b88cab6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:15.398937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.401972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:15.425019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37307-3d99-4556-a302-e052182ff756 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.480267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:15.529276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.530159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.530700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.531077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.532031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.533880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.558129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3273/6533] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:15 2022] POST /identity/v3/roles => generated 271 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:15.563269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.585501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9638e1-345a-45d4-9bc9-affdfb345766 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.590835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.592374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.592807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.593091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.593989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Adding query filter params (domain_id=2c948f95cc0242ab93fa2b4f037d6f22) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:15.595844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.596695 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:15.596695 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:15.596695 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:15.597548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.611685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3261/6534] 10.222.0.39 () {58 vars in 1206 bytes} [Sat Jun 25 21:17:15 2022] GET /identity/v3/roles?domain_id=2c948f95cc0242ab93fa2b4f037d6f22 => generated 408 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:15.613367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.628879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef475-4b3f-4352-ad06-915d705e1771 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.635883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.636942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.637385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.637776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/674030aaf2fb4a54bdad6cb4a56dbb08` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.639303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=674030aaf2fb4a54bdad6cb4a56dbb08)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.641618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.708812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 674030aaf2fb4a54bdad6cb4a56dbb08 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:15.709588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:15.717394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:15.737857 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3274/6535] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:15 2022] DELETE /identity/v3/roles/674030aaf2fb4a54bdad6cb4a56dbb08 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:15.741771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.744819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:15.771862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b505d-a2fe-433d-8f5b-f2aa0875b78a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.918032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.919204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.919736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.920379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.921586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Adding query filter params (domain_id=2c948f95cc0242ab93fa2b4f037d6f22) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:15.922297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:15.924326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:15.932706 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3262/6536] 10.222.0.39 () {58 vars in 1206 bytes} [Sat Jun 25 21:17:15 2022] GET /identity/v3/roles?domain_id=2c948f95cc0242ab93fa2b4f037d6f22 => generated 148 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:15.937098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:15.954288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b38895-a28f-4219-ac7d-1cd7116c2863 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:15.969947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:15.971010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:15.971697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:15.972225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/674030aaf2fb4a54bdad6cb4a56dbb08` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:15.990729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Could not find role: 674030aaf2fb4a54bdad6cb4a56dbb08.: keystone.exception.RoleNotFound: Could not find role: 674030aaf2fb4a54bdad6cb4a56dbb08. Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jun 25 21:17:16.002466 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:17:16.003679 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 674030aaf2fb4a54bdad6cb4a56dbb08. Jun 25 21:17:16.004971 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:16.008446 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3275/6537] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:15 2022] DELETE /identity/v3/roles/674030aaf2fb4a54bdad6cb4a56dbb08 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:16.013567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.025696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930482-ccb0-4172-a199-4c58bbb5ecfd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.032713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.033949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.034964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.035480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.045481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.048920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.076911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3263/6538] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:16 2022] PUT /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:16.081745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.096218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be94c-280a-4d69-82bd-7a0ec3257014 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.169211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.171543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.172349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.172883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.175403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, group_id=911975312b534beabe88a43300e6c150)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.176807 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:16.176807 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:16.176807 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:16.180614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.197535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3276/6539] 10.222.0.39 () {58 vars in 1364 bytes} [Sat Jun 25 21:17:16 2022] GET /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles => generated 410 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:16.202652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.215656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0d48-e592-423f-95b6-b14daf16bd2c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.222057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.224378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.225207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.225722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.228522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.232723 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:16.232723 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:16.232723 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:16.235787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.243909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3264/6540] 10.222.0.39 () {58 vars in 1464 bytes} [Sat Jun 25 21:17:16 2022] HEAD /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:16.247760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.259728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f538d-5b2f-4baa-bbf4-1c5ae989659b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.264632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.265798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.266193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.266584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.269037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.271850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.277980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role cbad085f2ee24e5bb1466e552fbd0353 was removed from group 911975312b534beabe88a43300e6c150 on domain 2c948f95cc0242ab93fa2b4f037d6f22. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:16.278399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:16.279260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:16.298171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3277/6541] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:17:16 2022] DELETE /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:16.304256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.307187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:16.322596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0375-8ac4-4a3c-aa48-d37979b1fe31 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.370797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:16.419133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.420851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.421216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.421716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.425699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.428012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.470105 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3265/6542] 10.222.0.39 () {60 vars in 1485 bytes} [Sat Jun 25 21:17:16 2022] PUT /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:16.471202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.482474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727d682-df9d-47f3-98c1-5054280079a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.570222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:16.603791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.608984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.611926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.612228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.616899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c4368b96f88b474eafe5c2c472fe437d, group_id=911975312b534beabe88a43300e6c150)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.619392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cd6ac-b511-4ab0-bfb4-d9832f7635b5 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.659855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:16.661259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3278/6543] 10.222.0.39 () {58 vars in 1367 bytes} [Sat Jun 25 21:17:16 2022] GET /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:16.684213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229b26-cafa-4f51-8e02-2d72e5f98d0f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:16.695248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:16.700200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.702026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.702567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/groups/911975312b534beabe88a43300e6c150/users/8b6f864483c04e51b33474835166dbd8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.705874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=911975312b534beabe88a43300e6c150, user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:16.712970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:16.782698 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3266/6544] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:17:16 2022] PUT /identity/v3/groups/911975312b534beabe88a43300e6c150/users/8b6f864483c04e51b33474835166dbd8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:16.785645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:16.786150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:16.786402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:16.897752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] MFA Rules not processed for user `8b6f864483c04e51b33474835166dbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:16.899345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:17.144043 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3279/6545] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:17.146229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.257043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1699-9256-4bb6-b5c6-fc705123fa49 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.264620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.267323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.267323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.267323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.272308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.277381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.289710 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3267/6546] 10.222.0.39 () {58 vars in 1467 bytes} [Sat Jun 25 21:17:17 2022] HEAD /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:17.290579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.318805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a200b-4bf0-4c10-9f9a-c4aa054e1c95 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.333134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.335440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.337760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.338227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.346168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.354623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.372823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role cbad085f2ee24e5bb1466e552fbd0353 was removed from group 911975312b534beabe88a43300e6c150 on project c4368b96f88b474eafe5c2c472fe437d. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:17.373239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:17.375693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:17.408002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3280/6547] 10.222.0.39 () {58 vars in 1469 bytes} [Sat Jun 25 21:17:17 2022] DELETE /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:17.412763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.414959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:17.433676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491897e1-007b-4916-844d-79f16ea06541 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.514680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.516086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.516373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.517364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/groups/911975312b534beabe88a43300e6c150/users/8b6f864483c04e51b33474835166dbd8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.521543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=911975312b534beabe88a43300e6c150, user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.525215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.546274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:17.569213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3268/6548] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:17:17 2022] DELETE /identity/v3/groups/911975312b534beabe88a43300e6c150/users/8b6f864483c04e51b33474835166dbd8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:17.575118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.590589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536cb5b-7301-45b6-81fd-f53dfd2e1818 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.694641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.695894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.698985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.699432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.702115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.703727 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:17.703727 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:17.703727 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:17.706212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.723932 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3281/6549] 10.222.0.39 () {60 vars in 1380 bytes} [Sat Jun 25 21:17:17 2022] PUT /identity/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:17.728113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.754178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfafe-f320-4b01-87ef-c48408c31be1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.766697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.768763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.768958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.770135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/groups/911975312b534beabe88a43300e6c150/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.773397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=911975312b534beabe88a43300e6c150)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.777819 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:17.777819 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:17.777819 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:17.781391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.809642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:17.824264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.826360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3269/6550] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:17:17 2022] GET /identity/v3/system/groups/911975312b534beabe88a43300e6c150/roles => generated 376 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:17.840653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336020f-c957-41fe-a1b1-a6814b4f4ba7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.871748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.871748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.871748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.874385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.874385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.874385 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:17.874385 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:17.874385 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:17.875269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:17.884886 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3282/6551] 10.222.0.39 () {58 vars in 1362 bytes} [Sat Jun 25 21:17:17 2022] HEAD /identity/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:17.888543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:17.921638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423b33-9900-43ae-8d7d-b22e7ff9cfa1 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:17.951440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:17.959054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:17.959322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:17.959611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:17.967861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=911975312b534beabe88a43300e6c150, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:17.969106 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:17.969106 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:17.969106 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:17.970150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.012321 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3270/6552] 10.222.0.39 () {58 vars in 1364 bytes} [Sat Jun 25 21:17:17 2022] DELETE /identity/v3/system/groups/911975312b534beabe88a43300e6c150/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.012920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.030527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70041-7cb4-4ee5-b0ef-527805c36aba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.049521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.050922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.051407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.051958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.054639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.057397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.103285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:18.133482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3283/6553] 10.222.0.39 () {60 vars in 1479 bytes} [Sat Jun 25 21:17:18 2022] PUT /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.135668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.155156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403daeee-1ecd-417c-a367-fdfb496bda11 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.309015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.310457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.310790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.311217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.314358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.315810 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:18.315810 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:18.315810 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:18.319283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.368004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3271/6554] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 25 21:17:18 2022] GET /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles => generated 409 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:18.371653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.400098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff343-5d80-4f0e-b229-aff784c5459b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.409115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.410659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.410659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.410659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.421006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.422760 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:18.422760 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:18.422760 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:18.426503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.436377 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3284/6555] 10.222.0.39 () {58 vars in 1461 bytes} [Sat Jun 25 21:17:18 2022] HEAD /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.443494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.466909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3101-c05b-4b4c-81a3-e313e5d3dc6b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.476295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.477485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.477919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.478328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.481869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2c948f95cc0242ab93fa2b4f037d6f22, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.485482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.491981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role cbad085f2ee24e5bb1466e552fbd0353 was removed from user 8b6f864483c04e51b33474835166dbd8 on domain 2c948f95cc0242ab93fa2b4f037d6f22. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:18.492440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:18.493577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:18.518383 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3272/6556] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Jun 25 21:17:18 2022] DELETE /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.519697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.521535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:18.538763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88376e78-cc41-42fa-b11e-a90dd8c70199 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.607229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.608150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.608471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.608755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.611077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.613816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.628264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3285/6557] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:18 2022] PUT /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.632632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.644115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4c272-051f-4630-815f-dfe196b40480 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.702784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.703529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.703820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.704098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.706373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.709370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.724441 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3273/6558] 10.222.0.39 () {58 vars in 1364 bytes} [Sat Jun 25 21:17:18 2022] GET /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles => generated 410 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:18.729769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.740900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659f509-fb99-43e5-ba0c-c7d7eb9369b6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.745699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.746609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.746893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.747169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.749444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.752083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.758884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3286/6559] 10.222.0.39 () {58 vars in 1464 bytes} [Sat Jun 25 21:17:18 2022] HEAD /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.763199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.773889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba85ec7-3282-4d30-b1ad-3957b8366407 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.778821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.779739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.780030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.780316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.782673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c4368b96f88b474eafe5c2c472fe437d, user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.785461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.791672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role cbad085f2ee24e5bb1466e552fbd0353 was removed from user 8b6f864483c04e51b33474835166dbd8 on project c4368b96f88b474eafe5c2c472fe437d. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:18.791973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:18.792724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:18.822734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3274/6560] 10.222.0.39 () {58 vars in 1466 bytes} [Sat Jun 25 21:17:18 2022] DELETE /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.827990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.830558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:18.845669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912061e-722a-4a39-9f3e-2b4c3b21e8ca tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.926550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.927773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.928102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.928778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:18.933147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:18.934197 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:18.934197 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:18.934197 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:18.935113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:18.955279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3287/6561] 10.222.0.39 () {60 vars in 1377 bytes} [Sat Jun 25 21:17:18 2022] PUT /identity/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:18.958702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:18.978886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f4361-f746-45b1-87be-4e66b192e898 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:18.993081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:18.994770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:18.994770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:18.995029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.000867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.002240 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:19.002240 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:19.002240 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:19.003817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.022771 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3275/6562] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:17:18 2022] GET /identity/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles => generated 375 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:19.024041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.036213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88ef67-d0fa-49d3-b4fc-29ba418c8d94 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.041852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.042805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.043102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.043458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.045523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.046833 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:19.046833 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:19.046833 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:19.048264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.055623 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3288/6563] 10.222.0.39 () {58 vars in 1359 bytes} [Sat Jun 25 21:17:19 2022] HEAD /identity/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:19.062359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.080029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dff270-bb0c-47a6-b69f-713510f514d2 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.086136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.087188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.087417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.087704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.090594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=8b6f864483c04e51b33474835166dbd8, role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.091759 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:19.091759 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:19.091759 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:19.092896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.116768 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3276/6564] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 25 21:17:19 2022] DELETE /identity/v3/system/users/8b6f864483c04e51b33474835166dbd8/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:19.117115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.130301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc3a7-c31f-4524-abfc-098b0bd7b537 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.136952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.138282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.138573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.138857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.140224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.141984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.162248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3289/6565] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:19 2022] POST /identity/v3/roles => generated 270 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:19.166734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.179699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3bbb-0825-4d67-9fb0-dabb0ed6693c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.185848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.186654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.187427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.187553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.188366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.189505 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:19.189505 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:19.189505 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:19.190484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.219250 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3277/6566] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:19 2022] POST /identity/v3/roles => generated 270 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:19.219426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.231963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78836b-c99e-4dfb-9698-feb9556ee7dd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.238001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.239680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.239969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.240274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/5b048efd25a94a0b8799dd501003009b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.247513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=5b048efd25a94a0b8799dd501003009b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.250318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.294925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3290/6567] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:19 2022] PUT /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/5b048efd25a94a0b8799dd501003009b => generated 531 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:19.300290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.307339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:19.316675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d9d6-4388-4633-aaf3-4f93f88bb74c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.430353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.431196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.431487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.431914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.432866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.435322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.460515 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3278/6568] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:17:19 2022] POST /identity/v3/domains => generated 277 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:19.468102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.503316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070fe7-774f-4374-8b63-98ebc996c50d tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.554207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:19.619661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.620575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.620874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.621217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.622065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.623884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.646033 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3291/6569] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:19 2022] POST /identity/v3/roles => generated 270 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:19.650642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.662281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957c78-8d9a-4bb1-b778-d76e6d458eba tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.669484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.670580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.671139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.671139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/22150ea6670f46f7b7f6438bd1a47d84` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.672955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=22150ea6670f46f7b7f6438bd1a47d84)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.674013 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:19.674013 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:19.674013 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:19.675013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.722329 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3279/6570] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:19 2022] PUT /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/22150ea6670f46f7b7f6438bd1a47d84 => generated 531 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:19.727171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.742485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127b5-51ed-4a61-9ccc-365642d1c498 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.811360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.812534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.812820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.813100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.815085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.816896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.850288 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3292/6571] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:19 2022] PUT /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 526 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:19.851755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.862944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107bac5-ae92-4d48-9774-1b90f94c3a66 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.925322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.926259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.926608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.926889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/cbad085f2ee24e5bb1466e552fbd0353/implies/b4993c44c95845de86969c09289768ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.928960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=cbad085f2ee24e5bb1466e552fbd0353, implied_role_id=b4993c44c95845de86969c09289768ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.930608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] b4993c44c95845de86969c09289768ea cannot be an implied roles.: keystone.exception.InvalidImpliedRole: b4993c44c95845de86969c09289768ea cannot be an implied roles. Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jun 25 21:17:19.956111 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: b4993c44c95845de86969c09289768ea cannot be an implied roles. Jun 25 21:17:19.957823 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:19.958583 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3280/6572] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:19 2022] PUT /identity/v3/roles/cbad085f2ee24e5bb1466e552fbd0353/implies/b4993c44c95845de86969c09289768ea => generated 116 bytes in 107 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:19.962366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:19.974028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d99-e73e-4a79-af41-9b8d7f2ad850 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:19.979167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:19.980184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:19.980598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:19.980936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:19.982790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:19.984525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:19.994420 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3293/6573] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:19 2022] DELETE /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:19.998834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:20.009764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21394ce0-cdb1-4400-9b45-a54fc080e431 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:20.073609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:20.074588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:20.074878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:20.075177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/22150ea6670f46f7b7f6438bd1a47d84` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:20.077025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=22150ea6670f46f7b7f6438bd1a47d84)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:20.078036 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:20.078036 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:20.078036 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:20.078941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:20.080769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:20.090510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3281/6574] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:19 2022] DELETE /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/22150ea6670f46f7b7f6438bd1a47d84 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:20.095130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:20.106386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee313-bd7d-47a7-beb5-7a65a4dd5a14 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:20.199717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:20.203001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:20.203001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:20.203001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/22150ea6670f46f7b7f6438bd1a47d84` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:20.204477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=22150ea6670f46f7b7f6438bd1a47d84)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:20.206243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:20.245210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:20.274115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 22150ea6670f46f7b7f6438bd1a47d84 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:20.274493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.275710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.278428 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3294/6575] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:20 2022] DELETE /identity/v3/roles/22150ea6670f46f7b7f6438bd1a47d84 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:20.282194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:20.291790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:20.324308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd8c9-8e72-4b2a-b703-513378bb17d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:20.397556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:20.398806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:20.399317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:20.400277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/4d64877b54934922b4c780796722a64e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:20.415668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4d64877b54934922b4c780796722a64e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:20.417627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:20.459994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.461451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.525357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.531600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.552807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3282/6576] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:17:20 2022] PATCH /identity/v3/domains/4d64877b54934922b4c780796722a64e => generated 278 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:20.560161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:20.576664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4634d-8d86-445f-a09b-0f1d5cc94106 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:20.629919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:20.632052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:20.727199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:20.728526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:20.730707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:20.730707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/4d64877b54934922b4c780796722a64e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:20.748308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4d64877b54934922b4c780796722a64e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:20.750301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:20.780064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.788049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb94-a40e-4f7a-aa2d-8c5426ddbab3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:20.789333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4d64877b54934922b4c780796722a64e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.797726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:20.798657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:20.799088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:20.799565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:20.801804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:20.833898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:20.840578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:20.878224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3283/6577] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:20.907288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.925982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.942946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.977253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] The token cache is being invalidate because project 4d64877b54934922b4c780796722a64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:20.977683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.978316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:20.997897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.010596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.011749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4d64877b54934922b4c780796722a64e', 'request_id': 'req-94845d05-3394-4a03-b0ac-2cdb567c48e0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.027477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3295/6578] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:17:20 2022] DELETE /identity/v3/domains/4d64877b54934922b4c780796722a64e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.031022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.033971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:21.062211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d0b9-3dc7-435b-ba08-dcaa35f61e47 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.171109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:21.178720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.180256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.181126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.181541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea/implies/5b048efd25a94a0b8799dd501003009b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.184473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b4993c44c95845de86969c09289768ea, implied_role_id=5b048efd25a94a0b8799dd501003009b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.188729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.211909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.212930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3284/6579] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:21 2022] DELETE /identity/v3/roles/b4993c44c95845de86969c09289768ea/implies/5b048efd25a94a0b8799dd501003009b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.213287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:21.237599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845d05-3394-4a03-b0ac-2cdb567c48e0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.284150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:21.324149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.325530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.325844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.326247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/5b048efd25a94a0b8799dd501003009b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.327697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5b048efd25a94a0b8799dd501003009b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.329568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.375741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 5b048efd25a94a0b8799dd501003009b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:21.376952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.378752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.382323 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3296/6580] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:21 2022] DELETE /identity/v3/roles/5b048efd25a94a0b8799dd501003009b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.386288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.388141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:21.402505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c47f-c2cb-4737-afb4-a3cce4d5a65f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.473835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.474741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.475022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.475303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/b4993c44c95845de86969c09289768ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.476828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b4993c44c95845de86969c09289768ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.477865 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:21.477865 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:21.477865 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:21.478750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.552338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role b4993c44c95845de86969c09289768ea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:21.552815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.553845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.556202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3285/6581] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:21 2022] DELETE /identity/v3/roles/b4993c44c95845de86969c09289768ea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.562151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.577182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ac4c3-051b-4c17-b67e-beac9d5fedc4 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.635321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.638491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:21.681766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.683049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.683535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.684005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.685893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.687527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.726284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3297/6582] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:21 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 520 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:21.731512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.734007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:21.779209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d36c25-b85c-4b1f-a046-cdcc77580558 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.861308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.862511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.863253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.863590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] PATH_INFO: `/v3/users/ea017638ef5b4335bbb2ef657217d7bd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.865477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea017638ef5b4335bbb2ef657217d7bd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.866981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887032c7-f6ed-42ff-8eeb-4f01a8dcfd51 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.868149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.877036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.878021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.878427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.879062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.883674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.884814 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:21.884814 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:21.884814 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:21.885490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:21.886859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.887848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.888793 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:21.888793 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:21.888793 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:21.889796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.900325 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3298/6583] 10.222.0.39 () {58 vars in 1344 bytes} [Sat Jun 25 21:17:21 2022] HEAD /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.904539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.918136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04359c1a-a750-46e4-a8b1-9a202f2f7c62 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.930169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.931283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.931556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.932105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.934203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.936267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.948324 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3299/6584] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:17:21 2022] GET /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 520 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:21.949730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:21.963007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b711-c217-433b-94cc-71eae6a591d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:21.971029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:21.973067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea017638ef5b4335bbb2ef657217d7bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.973345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:21.973345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:21.973575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:21.977308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:21.978502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:21.981160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:21.986028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea017638ef5b4335bbb2ef657217d7bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:21.995795 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3300/6585] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:21 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:21.997370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.018345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea017638ef5b4335bbb2ef657217d7bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:22.018345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea017638ef5b4335bbb2ef657217d7bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:22.018345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8113eed1-d083-4058-ae39-ef0dde902e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea017638ef5b4335bbb2ef657217d7bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:22.037190 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3286/6586] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:21 2022] DELETE /identity/v3/users/ea017638ef5b4335bbb2ef657217d7bd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:22.042474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.042904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.043208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.073096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:22.074767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:22.124865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a74fa-90f1-4920-8208-34dcaa85fedd tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.236241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3287/6587] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:22.258676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.259389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.260596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.260986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.261299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:22.261486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.263506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.265811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901.: keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = query.one() Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._iter().one() Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._only_one_row( Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:22.285571 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 25 21:17:22.287130 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 25 21:17:22.288633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 25 21:17:22.288633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:22.288633 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.288633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3301/6588] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:17:21 2022] GET /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 137 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:22.294239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.302376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:22.322502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021086e8-6165-4278-a3e7-d036472399d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.329028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.329984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.330979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.330979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.333843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.335531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901.: keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = query.one() Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._iter().one() Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._only_one_row( Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:22.353594 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 25 21:17:22.355311 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4d8dc23d00d848cea01c638f3b88cab6 does not imply 5b4114c9f8554a02af8e280c70036901. Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:22.358026 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3302/6589] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:22 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 137 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:22.361310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.375535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41736-752c-495b-9d73-4ab75640a9e3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.379008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b4fa-e691-4f92-ab94-c2f0bcbc5cba None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.383912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.385265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.385721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.386278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.387502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.388275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.388561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.388984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.391622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.393717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.409850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.411985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.430101 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3288/6590] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:22.448644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3303/6591] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:22 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 520 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:22.459320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.479272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95046687-74cd-4d6c-ba94-71c731853ac4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.549296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:22.615278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.616407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.616833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.617349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.619744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.626933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.669263 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3289/6592] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:22 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891 => generated 521 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:22.674832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.699093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd68b8-8e0c-4b73-bbf5-9d7f3e635a68 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.779981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.781122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.781510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.781863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.784067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4abca4cc47a34cfc8748112e30ae3891, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.786552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.796017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:22.823693 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3304/6593] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:22 2022] PUT /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 521 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:22.827946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.840891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b99e6-76d6-44c2-8fba-71c14216a53c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.907507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.908210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.908441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.908741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.909395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.910526 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:22.910526 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:22.910526 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:22.912070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:22.947648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3290/6594] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:17:22 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:22.952967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:22.978014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be78c7-7e65-4df1-b9c8-3e08f128f8f3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:22.992613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:22.993860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:22.994220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:22.994574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:22.996782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4abca4cc47a34cfc8748112e30ae3891, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:22.999006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.019444 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3305/6595] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:22 2022] DELETE /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:23.024041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.036021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a4ea3-9ebc-4780-b91d-6ace67cdf539 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.125117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.126481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.126843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.127199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.129283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.131124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.148468 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3291/6596] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:23 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:23.150134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.166760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd242-0cad-460f-929d-5044d0872b2a tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.260642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.261898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.262472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.262827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.266139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.268784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.284873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3306/6597] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:23 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:23.292100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.301522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.305494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:23.308962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ad27-40d6-4db2-bcf2-79082bd2fad3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.394017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:23.448953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e180-f46c-402d-9d52-eee31c41132b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.458336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.460841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.461202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.461607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] PATH_INFO: `/v3/projects/2f38a9584ed44c0d99279ad9953e4f4e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.463112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f38a9584ed44c0d99279ad9953e4f4e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.465393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.490122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.495542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.496277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.497847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.498849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.503958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.530167 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3292/6598] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:23 2022] GET /identity/v3/roles => generated 2323 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:23.534797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.562771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640947-5b20-4da0-9a2e-cb798f92da40 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.576669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.578453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.578936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.579474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.580729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.583961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.601626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f38a9584ed44c0d99279ad9953e4f4e', 'request_id': 'req-244f2be7-6c67-452e-8f1f-229232515b7b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:23.611063 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3293/6599] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:17:23 2022] POST /identity/v3/roles => generated 234 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:23.614237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.626036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f38a9584ed44c0d99279ad9953e4f4e', 'request_id': 'req-244f2be7-6c67-452e-8f1f-229232515b7b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:23.626319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cf1b9-5a1e-4af3-8a4e-7c2e85343008 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.640164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f38a9584ed44c0d99279ad9953e4f4e', 'request_id': 'req-244f2be7-6c67-452e-8f1f-229232515b7b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:23.668768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] The token cache is being invalidate because project 2f38a9584ed44c0d99279ad9953e4f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:23.669072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:23.669963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:23.672477 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3307/6600] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:23 2022] DELETE /identity/v3/projects/2f38a9584ed44c0d99279ad9953e4f4e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:23.802184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.804861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.804861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.804861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/03827f6785c349f9b5552b9f5c7544f5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.807220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:update_role(role_id=03827f6785c349f9b5552b9f5c7544f5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.809296 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:23.809296 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:23.809296 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:23.809688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.861022 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3294/6601] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 21:17:23 2022] PATCH /identity/v3/roles/03827f6785c349f9b5552b9f5c7544f5 => generated 238 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:23.865218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.868335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:23.889044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:23.917657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f2be7-6c67-452e-8f1f-229232515b7b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.934375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.935714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.939950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.941512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/03827f6785c349f9b5552b9f5c7544f5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.966041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:get_role(role_id=03827f6785c349f9b5552b9f5c7544f5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:23.967945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:23.970297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3308/6602] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:17:23 2022] GET /identity/v3/roles/03827f6785c349f9b5552b9f5c7544f5 => generated 238 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:23.975722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:23.988939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75c3f-42a6-4b6b-848c-300df4c44f44 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:23.995561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:23.996785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:23.997216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:23.998347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:23.998567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.000738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.030292 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3295/6603] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:23 2022] GET /identity/v3/roles => generated 2552 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:24.031525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.044744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadfb52-b7f7-416a-897b-f2c1c0c43a8f tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.050834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.052091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.052451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.053541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/03827f6785c349f9b5552b9f5c7544f5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.054826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=03827f6785c349f9b5552b9f5c7544f5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.056749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.115086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 03827f6785c349f9b5552b9f5c7544f5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:24.115461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:24.116392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:24.119949 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3309/6604] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:24 2022] DELETE /identity/v3/roles/03827f6785c349f9b5552b9f5c7544f5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:24.127404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.129670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:24.163228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0f69-6274-4dbd-8958-3a50e4345444 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.353377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.353377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.353377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.353734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.353874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.368768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.426450 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3296/6605] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:24 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 520 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:24.430132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.442777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30efbd-df22-4592-a971-cfbe2620c4d9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.519143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.520147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.520477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.520740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.522564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.524539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.562896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3310/6606] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:24 2022] PUT /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891 => generated 521 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:24.569175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.580682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2542d-1b87-4f08-ae37-93c073fd4180 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.590392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:24.657908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.659477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.659477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.659477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.661570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4abca4cc47a34cfc8748112e30ae3891, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.663287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.700148 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3297/6607] 10.222.0.39 () {60 vars in 1362 bytes} [Sat Jun 25 21:17:24 2022] PUT /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 521 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:24.702118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.714297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c7c3-6d6a-4248-8c1d-17dffad31971 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.786285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.788014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.788014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.788014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.789304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.790347 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:24.790347 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:17:24.790347 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:17:24.791349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.801032 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3311/6608] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:17:24 2022] GET /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies => generated 490 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:24.802715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.844116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2feeb1-ea22-43eb-8db9-992685ef97fa tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.861508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.862819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.863098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.863444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.865764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.866906 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:17:24.866906 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:17:24.866906 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:17:24.868133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.882407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3298/6609] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:17:24 2022] GET /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies => generated 660 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:24.890097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.910518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f13b2e-39c3-45b6-af68-5675e89961d6 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:24.928718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:24.929789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:24.930195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:24.930488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:24.932681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4abca4cc47a34cfc8748112e30ae3891, implied_role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:24.934727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:24.945760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3312/6610] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:24 2022] DELETE /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891/implies/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:24.950642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:24.965950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a5566-3f9d-49a7-bd24-878f4286a6a7 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.057064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.058030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.058316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.058602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.064920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:25.066822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:25.084255 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3299/6611] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:24 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/4abca4cc47a34cfc8748112e30ae3891 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:25.089908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:25.108577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fd1d2-aa82-415f-9631-285e20820d97 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.128875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:25.206575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.208371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.208873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.209169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.211217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d8dc23d00d848cea01c638f3b88cab6, implied_role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:25.216812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:25.235535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3313/6612] 10.222.0.39 () {58 vars in 1346 bytes} [Sat Jun 25 21:17:25 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6/implies/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:25.241187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:25.255212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365544b9-6ab6-4d73-9012-64e9d767d2d3 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.351715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.352960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.353295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.359533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/4d64877b54934922b4c780796722a64e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.372818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Could not find domain: 4d64877b54934922b4c780796722a64e.: keystone.exception.DomainNotFound: Could not find domain: 4d64877b54934922b4c780796722a64e. Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4d64877b54934922b4c780796722a64e. Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:25.384986 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:25.386484 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4d64877b54934922b4c780796722a64e. Jun 25 21:17:25.387746 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:25.389016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3300/6613] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:17:25 2022] PATCH /identity/v3/domains/4d64877b54934922b4c780796722a64e => generated 112 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:25.395618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:25.408148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65dfc7-e8dd-4a58-9c88-e3109ddb4428 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.418786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.420539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.420918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.421240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/users/8b6f864483c04e51b33474835166dbd8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.423418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8b6f864483c04e51b33474835166dbd8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:25.431231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:25.503852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.504923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.519293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.546749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.556631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6f864483c04e51b33474835166dbd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.565347 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3314/6614] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:25 2022] DELETE /identity/v3/users/8b6f864483c04e51b33474835166dbd8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:25.570892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:25.574841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:25.606909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60c67-cf57-4481-8bf7-177708e21ab0 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.643491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:25.760813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.761799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.762089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.762370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/cbad085f2ee24e5bb1466e552fbd0353` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.764019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cbad085f2ee24e5bb1466e552fbd0353)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:25.765966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:25.843326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role cbad085f2ee24e5bb1466e552fbd0353 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:25.843814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.844865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:25.847952 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3301/6615] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:25 2022] DELETE /identity/v3/roles/cbad085f2ee24e5bb1466e552fbd0353 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:25.856689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:25.869050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15807e-f6a7-4868-b5ad-f8810ae00092 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:25.956180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:25.959493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:25.959793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:25.960075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/groups/911975312b534beabe88a43300e6c150` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:25.961504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_group(group_id=911975312b534beabe88a43300e6c150)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:25.963539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:26.016345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:26.049197 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3315/6616] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:17:25 2022] DELETE /identity/v3/groups/911975312b534beabe88a43300e6c150 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:26.052972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:26.054668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:26.073817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30df5-0699-496c-881f-a537a35a0609 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:26.206864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:26.208649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:26.209103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:26.209558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/projects/c4368b96f88b474eafe5c2c472fe437d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:26.211508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4368b96f88b474eafe5c2c472fe437d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:26.213756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:26.329193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4368b96f88b474eafe5c2c472fe437d', 'request_id': 'req-dd5a1f73-09b4-4143-8e92-e8d2db962205'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.346572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4368b96f88b474eafe5c2c472fe437d', 'request_id': 'req-dd5a1f73-09b4-4143-8e92-e8d2db962205'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.365250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4368b96f88b474eafe5c2c472fe437d', 'request_id': 'req-dd5a1f73-09b4-4143-8e92-e8d2db962205'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.392890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] The token cache is being invalidate because project c4368b96f88b474eafe5c2c472fe437d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:26.392890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.393479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.395818 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3302/6617] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:26 2022] DELETE /identity/v3/projects/c4368b96f88b474eafe5c2c472fe437d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:26.400229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:26.402404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:26.416484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e5fd-da85-444b-a7e5-735e7401dda9 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:26.548632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:26.549716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:26.549851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:26.550135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:26.551860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2c948f95cc0242ab93fa2b4f037d6f22)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:26.553830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:26.582759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.585267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.632052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.632831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.637135 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3316/6618] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:17:26 2022] PATCH /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22 => generated 278 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:26.643394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:26.662145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1f73-09b4-4143-8e92-e8d2db962205 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:26.678960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:26.848213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:26.849943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:26.853660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:26.854236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:26.886269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2c948f95cc0242ab93fa2b4f037d6f22)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:26.888670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:26.922816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:26.927362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.034624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.054287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.080914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.100893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] The token cache is being invalidate because project 2c948f95cc0242ab93fa2b4f037d6f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:27.101227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.102790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.128900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.134534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.136468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2c948f95cc0242ab93fa2b4f037d6f22', 'request_id': 'req-a4af247d-d1b4-4c37-9f65-ee958145ec88'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.145281 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3303/6619] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:17:26 2022] DELETE /identity/v3/domains/2c948f95cc0242ab93fa2b4f037d6f22 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:27.149151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:27.150829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:27.171693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f70a22-4b54-47aa-92fa-bc144659eb7b tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:27.324239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:27.326517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:27.326789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:27.329268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4abca4cc47a34cfc8748112e30ae3891` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:27.332887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4abca4cc47a34cfc8748112e30ae3891)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:27.334555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:27.415392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 4abca4cc47a34cfc8748112e30ae3891 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:27.415392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.423789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.427552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3317/6620] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:27 2022] DELETE /identity/v3/roles/4abca4cc47a34cfc8748112e30ae3891 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:27.430947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:27.432639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:27.459295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af247d-d1b4-4c37-9f65-ee958145ec88 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:27.557925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:27.598954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:27.600031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:27.600471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:27.600855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/5b4114c9f8554a02af8e280c70036901` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:27.603456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5b4114c9f8554a02af8e280c70036901)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:27.606047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:27.705289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 5b4114c9f8554a02af8e280c70036901 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:27.705678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.710810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.711149 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3304/6621] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:27 2022] DELETE /identity/v3/roles/5b4114c9f8554a02af8e280c70036901 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:27.714914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:27.716968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:27.731116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e779d-0519-4026-97fc-3fa1376d3e85 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:27.746866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:27.849385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f859127e1dc4e5f9f8eb5db6874d7ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20bf48cc31d8450a866d651ed2a114cd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:27.851096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:27.851619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:27.852066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] PATH_INFO: `/v3/roles/4d8dc23d00d848cea01c638f3b88cab6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:27.855077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d8dc23d00d848cea01c638f3b88cab6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:27.857477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:27.942214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invalidating the token cache because role 4d8dc23d00d848cea01c638f3b88cab6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:27.942817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.943712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b081bdb5-6183-4ef2-b5db-6cf2cc88f286 tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:27.953682 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3318/6622] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:27 2022] DELETE /identity/v3/roles/4d8dc23d00d848cea01c638f3b88cab6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:27.959748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:27.963210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:28.111237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0175-dc83-4322-8da9-5da2ebfecd5c tempest-RolesV3TestJSON-445895252 tempest-RolesV3TestJSON-445895252-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:28.255154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:28.256676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:28.256676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:28.257188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] PATH_INFO: `/v3/users/8bcc7ea5d8d54c58a259367c8b228abf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:28.261885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcc7ea5d8d54c58a259367c8b228abf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:28.264188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:28.369577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcc7ea5d8d54c58a259367c8b228abf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:28.380228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcc7ea5d8d54c58a259367c8b228abf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:28.395244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:28.403430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcc7ea5d8d54c58a259367c8b228abf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:28.404449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcc7ea5d8d54c58a259367c8b228abf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:28.405393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcc7ea5d8d54c58a259367c8b228abf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:28.436371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3305/6623] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:27 2022] DELETE /identity/v3/users/8bcc7ea5d8d54c58a259367c8b228abf => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:28.442348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:28.442955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:28.442955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:28.485986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:28.487370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:28.588601 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3319/6624] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:28.596401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:28.598144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:28.687941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714f42-bdc2-404d-8fd2-d73c377f0abf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:28.690315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:28.691064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:28.691408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:28.692136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:28.708267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:28.710102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:28.731848 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3306/6625] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:17:29.104123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:29.106692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:29.122512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810a0bb-0364-453b-b6e0-5be9a40cb33f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:29.133456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:29.134618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:29.134910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:29.135191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] PATH_INFO: `/v3/projects/18f6d5e25e4c4f0cb0f947e7fa5d5f9e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:29.137138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f6d5e25e4c4f0cb0f947e7fa5d5f9e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:29.139318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:29.199821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f6d5e25e4c4f0cb0f947e7fa5d5f9e', 'request_id': 'req-a1dcc501-52e7-473f-89ed-6be8d600796a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.212889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f6d5e25e4c4f0cb0f947e7fa5d5f9e', 'request_id': 'req-a1dcc501-52e7-473f-89ed-6be8d600796a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.230663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f6d5e25e4c4f0cb0f947e7fa5d5f9e', 'request_id': 'req-a1dcc501-52e7-473f-89ed-6be8d600796a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.254666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] The token cache is being invalidate because project 18f6d5e25e4c4f0cb0f947e7fa5d5f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:29.255040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.256180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.258110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3320/6626] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:29 2022] DELETE /identity/v3/projects/18f6d5e25e4c4f0cb0f947e7fa5d5f9e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:29.263442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:29.281093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c7ee-085e-4ef8-b6ea-d13c39f8b527 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:29.363736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:29.370270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:29.370691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:29.371075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] PATH_INFO: `/v3/users/9f859127e1dc4e5f9f8eb5db6874d7ad` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:29.372902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f859127e1dc4e5f9f8eb5db6874d7ad)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:29.375526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:29.450584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f859127e1dc4e5f9f8eb5db6874d7ad'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.461196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f859127e1dc4e5f9f8eb5db6874d7ad'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.477506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f859127e1dc4e5f9f8eb5db6874d7ad'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.478306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f859127e1dc4e5f9f8eb5db6874d7ad'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.478970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-25d62a3d-3f34-4da6-8e4d-de55021730f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f859127e1dc4e5f9f8eb5db6874d7ad'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.492041 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3307/6627] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:29 2022] DELETE /identity/v3/users/9f859127e1dc4e5f9f8eb5db6874d7ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:29.796331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:29.798025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:29.820613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:29.825388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc501-52e7-473f-89ed-6be8d600796a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:29.899785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:29.901030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:29.901525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:29.901807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] PATH_INFO: `/v3/projects/20bf48cc31d8450a866d651ed2a114cd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:29.903076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bf48cc31d8450a866d651ed2a114cd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:29.905240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:29.972757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bf48cc31d8450a866d651ed2a114cd', 'request_id': 'req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.984215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bf48cc31d8450a866d651ed2a114cd', 'request_id': 'req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:29.990819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bf48cc31d8450a866d651ed2a114cd', 'request_id': 'req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:30.004279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] The token cache is being invalidate because project 20bf48cc31d8450a866d651ed2a114cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:30.004671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:30.005352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f3dcf30a-6240-4c42-98b6-c0d72d106ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:30.012534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3321/6628] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:29 2022] DELETE /identity/v3/projects/20bf48cc31d8450a866d651ed2a114cd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:30.013154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.013154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.013154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.024454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:30.042032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:30.047231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:30.130085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3308/6629] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:30.141061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.144452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.144452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.167724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:30.169460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:30.180756 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3322/6630] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:30.185597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.198406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177071bc-c274-419d-a00a-6f9b46c490dc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.205037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.205851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.206191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.206496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.207835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:30.208150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.209825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.228312 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3309/6631] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:30.229631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.239481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a65b-2c4f-4aa8-a106-4d58c327f466 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.246156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.247069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.247350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.247632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.248325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.250689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.280824 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3323/6632] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:30.285798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.298339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a429a-db65-45ff-bfa9-699e29f47c1a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.376685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.377465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.377749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.378189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.378881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.381114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.405868 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3310/6633] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:30.410314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.423481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0660-c806-4bed-955c-2a11579d2489 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.430957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.431760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.432265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.432669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.433489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.437171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.450107 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3324/6634] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:30.455200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.472109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4894-0170-48d9-98ce-890c3588feff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.481709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.483577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.484107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.484396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.488467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.488467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42486a2-e043-47b6-b233-ea9be3502dc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.499782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3311/6635] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:30.506783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.518277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea07b3-f121-411a-b5bf-0057ae9781b6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.524757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.525885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.526257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.526699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] PATH_INFO: `/v3/projects/33584674abc24c16a6770b8768abf2ea/users/4a3a5f0c1b3443bda09ec6a3c4a92ea7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.549129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33584674abc24c16a6770b8768abf2ea, user_id=4a3a5f0c1b3443bda09ec6a3c4a92ea7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.554243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.574115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3325/6636] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:30 2022] PUT /identity/v3/projects/33584674abc24c16a6770b8768abf2ea/users/4a3a5f0c1b3443bda09ec6a3c4a92ea7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:30.586230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.586583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.586914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.622184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] MFA Rules not processed for user `4a3a5f0c1b3443bda09ec6a3c4a92ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:30.623855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:30.718368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:30.723444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3312/6637] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:30.730900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.791830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:30.854088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feab12e-aa4f-4b13-b96a-7fdc6d416d5d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:30.858332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:30.859393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:30.859906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:30.860498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:30.861177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:30.863565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:30.914826 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3326/6638] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:30.916025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:30.954494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974d48-6f9b-447b-b2f9-73da5e355333 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.082990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.083964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.084271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.084696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.085396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.090060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.121967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3313/6639] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:30 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:31.126290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.140489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baa22c-f3d0-4041-b231-bec9ac89579f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.147074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.147860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.148401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.148871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.149823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.151888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.186212 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3327/6640] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:31.190266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.205193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551f5-d005-4671-a708-3efc5dd7e992 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.211180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.212370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.212742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.213028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] PATH_INFO: `/v3/projects/addc29f82e314a919f25db2f45e0d168/users/3a62864e444445e3adab8511a17fbba6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.232589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=addc29f82e314a919f25db2f45e0d168, user_id=3a62864e444445e3adab8511a17fbba6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.235388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.248979 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3314/6641] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:31 2022] PUT /identity/v3/projects/addc29f82e314a919f25db2f45e0d168/users/3a62864e444445e3adab8511a17fbba6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:31.253067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.263344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21fdf7-8995-460f-a910-dca6c6a5abf3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.332145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.333481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.333887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.334168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.334895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.336548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34899faa-bfa5-401f-b516-b4e63a8495d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.347086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3328/6642] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:17:31.351441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.362671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9a7e-d3af-4b00-83a1-99de22e69fd2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.369595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.370742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.371205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.371671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] PATH_INFO: `/v3/projects/addc29f82e314a919f25db2f45e0d168/users/3a62864e444445e3adab8511a17fbba6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.374791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=addc29f82e314a919f25db2f45e0d168, user_id=3a62864e444445e3adab8511a17fbba6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.378060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.389578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3315/6643] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:31 2022] PUT /identity/v3/projects/addc29f82e314a919f25db2f45e0d168/users/3a62864e444445e3adab8511a17fbba6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:31.400408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.400683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.400967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.431095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] MFA Rules not processed for user `3a62864e444445e3adab8511a17fbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:31.432380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:31.519469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3329/6644] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:31.524665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.540537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff891-9da2-40e1-bd7e-60e65c2415b9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.547601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.548351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.548685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.548974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.549728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.551864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.589002 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3316/6645] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:31 2022] POST /identity/v3/projects => generated 360 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:31.590084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.600541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e185858-c224-457b-bb1d-8e52b414d08d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.626077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:31.658792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.659474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.659764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.660047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.660827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.662795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.689101 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3330/6646] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:31 2022] POST /identity/v3/users => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:31.693568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.704546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784d5-46fd-4992-9436-50b8cf3d1e97 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.709672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.710343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.710661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.710942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.711759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:31.712070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.714183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f08019-7033-492f-8b45-9709161f091f tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.746299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3317/6647] 10.222.0.39 () {58 vars in 1156 bytes} [Sat Jun 25 21:17:31 2022] GET /identity/v3/users?domain_id=default => generated 7460 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:31.750948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.762207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee33298-d02e-4cd1-9a22-fba80a4fe681 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.767777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.768712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.768998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.769279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/users/81d1307a692144bcac050a86351003e9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.784440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:update_user(user_id=81d1307a692144bcac050a86351003e9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.786676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.819026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:31.828824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invalidating the token cache because user 81d1307a692144bcac050a86351003e9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:31.829269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:31.830032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:31.832726 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3331/6648] 10.222.0.39 () {60 vars in 1243 bytes} [Sat Jun 25 21:17:31 2022] PATCH /identity/v3/users/81d1307a692144bcac050a86351003e9 => generated 485 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:31.837863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.838192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.838497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.852600 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.auth.plugins.core [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] User is disabled: 81d1307a692144bcac050a86351003e9: AssertionError: User is disabled: 81d1307a692144bcac050a86351003e9 Jun 25 21:17:31.886708 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.application [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:17:31.888373 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3318/6649] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:31 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 52 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Jun 25 21:17:31.892988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:31.894784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:31.908239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8352f-7f49-4cac-9f07-ed0b2241e579 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:31.913572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:31.914455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:31.914738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:31.915033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/users/81d1307a692144bcac050a86351003e9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:31.929504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:delete_user(user_id=81d1307a692144bcac050a86351003e9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:31.931447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:31.981279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:31.982072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:31.990221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.003222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.010940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d1307a692144bcac050a86351003e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.017416 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3332/6650] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:31 2022] DELETE /identity/v3/users/81d1307a692144bcac050a86351003e9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:32.022272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:32.024238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:32.099822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10e06-6770-4470-9639-2276d9c529c5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:32.104372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:32.105271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.105556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.105830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/projects/dbd8cc11ed45435cb45270d0008c95f9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.107019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dbd8cc11ed45435cb45270d0008c95f9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:32.108967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:32.128705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:32.161128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd8cc11ed45435cb45270d0008c95f9', 'request_id': 'req-58186ade-2de0-4045-a787-9af05ff99034'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.171793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd8cc11ed45435cb45270d0008c95f9', 'request_id': 'req-58186ade-2de0-4045-a787-9af05ff99034'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.177711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd8cc11ed45435cb45270d0008c95f9', 'request_id': 'req-58186ade-2de0-4045-a787-9af05ff99034'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.190800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] The token cache is being invalidate because project dbd8cc11ed45435cb45270d0008c95f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:32.191122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.191982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-58186ade-2de0-4045-a787-9af05ff99034 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.194030 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3319/6651] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:32 2022] DELETE /identity/v3/projects/dbd8cc11ed45435cb45270d0008c95f9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:32.199172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:32.216052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337070-3068-40d9-9aef-b0218b7bddb3 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:32.244130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce62c4-2672-4a20-9b34-bffc82dfcea2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.244615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce62c4-2672-4a20-9b34-bffc82dfcea2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.244966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce62c4-2672-4a20-9b34-bffc82dfcea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.264606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:32.275359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f8ce62c4-2672-4a20-9b34-bffc82dfcea2 None None] MFA Rules not processed for user `871c269a6b15425d8b79a6c653c56402`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:32.277177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f8ce62c4-2672-4a20-9b34-bffc82dfcea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:32.295749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a62864e444445e3adab8511a17fbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addc29f82e314a919f25db2f45e0d168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:32.296754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.297138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.297510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.298307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:32.300322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Could not find domain: 8e1e170eb4674dee8b7f69df7b5eeee7.: keystone.exception.DomainNotFound: Could not find domain: 8e1e170eb4674dee8b7f69df7b5eeee7. Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8e1e170eb4674dee8b7f69df7b5eeee7. Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:32.313786 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:17:32.315296 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:17:32.316836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:17:32.318267 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:17:32.318267 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:17:32.318267 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8e1e170eb4674dee8b7f69df7b5eeee7. Jun 25 21:17:32.318267 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:32.320414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3333/6652] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:32 2022] POST /identity/v3/users => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:32.323399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:32.326387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:32.351766 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3320/6653] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:32.400914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b44ba-767e-4ae3-a24e-cf154f1d8512 tempest-UsersNegativeTest-1050467628 tempest-UsersNegativeTest-1050467628-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:32.407589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:32.408929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.409296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.409649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] PATH_INFO: `/v3/users/4a3a5f0c1b3443bda09ec6a3c4a92ea7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.413615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3a5f0c1b3443bda09ec6a3c4a92ea7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:32.415573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:32.464087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3a5f0c1b3443bda09ec6a3c4a92ea7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.464770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3a5f0c1b3443bda09ec6a3c4a92ea7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.473169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3a5f0c1b3443bda09ec6a3c4a92ea7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.485382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3a5f0c1b3443bda09ec6a3c4a92ea7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.492846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3a5f0c1b3443bda09ec6a3c4a92ea7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:32.498970 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3334/6654] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:32 2022] DELETE /identity/v3/users/4a3a5f0c1b3443bda09ec6a3c4a92ea7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:32.503502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.503794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.504072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.522023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:32.523223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:32.582873 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3321/6655] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:32.592973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:32.594459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:32.656692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32547-0bf4-479a-9621-c16464937510 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:32.661411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:32.662097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:32.662384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:32.662666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:32.674533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:32.676276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:32.680970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:32.696951 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3335/6656] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:32.994179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:32.995764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:33.024260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd09d95-aa61-4a03-92f3-f05e927bd6d4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:33.032706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:33.033819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:33.034251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:33.034553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] PATH_INFO: `/v3/projects/33584674abc24c16a6770b8768abf2ea` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:33.036643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=33584674abc24c16a6770b8768abf2ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:33.040019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:33.089206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:33.093226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33584674abc24c16a6770b8768abf2ea', 'request_id': 'req-b4d39335-4ca0-491e-907f-951dc19fbadc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.101409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33584674abc24c16a6770b8768abf2ea', 'request_id': 'req-b4d39335-4ca0-491e-907f-951dc19fbadc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.107036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33584674abc24c16a6770b8768abf2ea', 'request_id': 'req-b4d39335-4ca0-491e-907f-951dc19fbadc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.119196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] The token cache is being invalidate because project 33584674abc24c16a6770b8768abf2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:33.119574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.120236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.121891 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3322/6657] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:32 2022] DELETE /identity/v3/projects/33584674abc24c16a6770b8768abf2ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:33.126533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:33.137208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490ca3-0347-4949-9007-27e53c486a05 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:33.196167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:33.197132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:33.197415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:33.197694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] PATH_INFO: `/v3/users/3a62864e444445e3adab8511a17fbba6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:33.198933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a62864e444445e3adab8511a17fbba6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:33.200935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:33.261883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a62864e444445e3adab8511a17fbba6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.262738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a62864e444445e3adab8511a17fbba6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.270733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a62864e444445e3adab8511a17fbba6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.284366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:33.284637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a62864e444445e3adab8511a17fbba6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.286236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:33.292196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a62864e444445e3adab8511a17fbba6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.298753 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3336/6658] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:33 2022] DELETE /identity/v3/users/3a62864e444445e3adab8511a17fbba6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:33.380828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d39335-4ca0-491e-907f-951dc19fbadc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:33.493380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:33.494421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:33.494880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:33.495876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:33.499037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:33.526230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:33.528705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaca94-3f3a-4507-878e-2ceb6f3f5d36 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:33.557545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3323/6659] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:17:33.682992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:33.684598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:33.797593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a93b3-99cb-41e6-8cfe-c361396aab84 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:33.813488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:33.814743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:33.817778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:33.818118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] PATH_INFO: `/v3/projects/addc29f82e314a919f25db2f45e0d168` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:33.819448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=addc29f82e314a919f25db2f45e0d168)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:33.822692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:33.855710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:33.890929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addc29f82e314a919f25db2f45e0d168', 'request_id': 'req-7126a190-98cf-4106-91f5-3583b4efa1ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.901472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addc29f82e314a919f25db2f45e0d168', 'request_id': 'req-7126a190-98cf-4106-91f5-3583b4efa1ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.909476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addc29f82e314a919f25db2f45e0d168', 'request_id': 'req-7126a190-98cf-4106-91f5-3583b4efa1ff'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.922365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] The token cache is being invalidate because project addc29f82e314a919f25db2f45e0d168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:33.923290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.923675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7126a190-98cf-4106-91f5-3583b4efa1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:33.925499 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3337/6660] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:33 2022] DELETE /identity/v3/projects/addc29f82e314a919f25db2f45e0d168 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:33.931575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:33.932354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:33.932801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:33.955440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:33.956880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:34.034711 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3324/6661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:34.045602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.046408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.046528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.068159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:34.069525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:34.080912 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3338/6662] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:34.086731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.093387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:34.097574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fef49-6d6b-46e3-b32b-2d4e03e2006e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.105644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.106581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.107116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.107567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.108508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:34.108976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.110905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.128719 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3325/6663] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:34.130094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.140347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78c43-f9f9-463f-bcae-424b54a42601 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.147262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.148175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.148886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.149262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.150236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.152602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.192243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.199703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3339/6664] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:34 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:34.204079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349793e-8e41-48d6-aeab-6f632959c65b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.293617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.294886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.295380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.295801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.296897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.299499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.341676 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3326/6665] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:34 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:34.345486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.372993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a2ea-5660-4406-94ca-295b19dcb13f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.380996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.381834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.382199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.382530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.383756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.385570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.400344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3340/6666] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:34.404807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.424773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee2b2d-d6bc-43ab-8ecf-a1af8a76c01a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.430321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.431281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.431479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.431741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.432548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.434257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d5b3-4102-445d-832c-e96ecac9e86b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.449065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3327/6667] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:34.450430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.462673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c6a8-13ad-487d-9b9b-51ecf52c41f4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.467884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.468850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.469133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.469410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] PATH_INFO: `/v3/projects/bd96c78633be4d71a7ba743e150fac99/users/d27f15d86c6c48ddb872768eec08145f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.486144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd96c78633be4d71a7ba743e150fac99, user_id=d27f15d86c6c48ddb872768eec08145f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.488981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.503471 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3341/6668] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:34 2022] PUT /identity/v3/projects/bd96c78633be4d71a7ba743e150fac99/users/d27f15d86c6c48ddb872768eec08145f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:34.514001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.514293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.514573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.547280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] MFA Rules not processed for user `d27f15d86c6c48ddb872768eec08145f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:34.548569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:34.621042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3328/6669] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:34.626249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.636389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868dac-5249-4a37-b69b-3c1cd2a3d876 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.640405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd27f15d86c6c48ddb872768eec08145f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd96c78633be4d71a7ba743e150fac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.641117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.641400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.641681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] PATH_INFO: `/v3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.643061 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3342/6670] 10.222.0.39 () {58 vars in 1103 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:34.647820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.656569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03159756-5efb-42d2-b465-0837c2c74a2f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.662227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180eda6-7e25-4316-9a9a-96e20588927a tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd27f15d86c6c48ddb872768eec08145f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd96c78633be4d71a7ba743e150fac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.662944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180eda6-7e25-4316-9a9a-96e20588927a tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.663153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180eda6-7e25-4316-9a9a-96e20588927a tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.663435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180eda6-7e25-4316-9a9a-96e20588927a tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] PATH_INFO: `/v3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.668622 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3329/6671] 10.222.0.39 () {58 vars in 1103 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3 => generated 255 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:34.670025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.681645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9ae9d-08ca-459a-b54b-b5d1de4a6a15 tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.686949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1dfc-b65e-402b-a4a2-f3c01b7ca5ff tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd27f15d86c6c48ddb872768eec08145f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd96c78633be4d71a7ba743e150fac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.687631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1dfc-b65e-402b-a4a2-f3c01b7ca5ff tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.687934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1dfc-b65e-402b-a4a2-f3c01b7ca5ff tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.688242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1dfc-b65e-402b-a4a2-f3c01b7ca5ff tempest-TestApiDiscovery-1158825309 tempest-TestApiDiscovery-1158825309-project] PATH_INFO: `/v3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.695087 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3343/6672] 10.222.0.39 () {58 vars in 1103 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:34.697434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a577-1f7d-4b18-8f08-ce1c807b4e27 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.697725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a577-1f7d-4b18-8f08-ce1c807b4e27 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.698004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a577-1f7d-4b18-8f08-ce1c807b4e27 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.699634 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3330/6673] 10.222.0.39 () {56 vars in 894 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:17:34.704896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4996-286e-4b09-816e-dcbd9e7b73e2 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.705187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4996-286e-4b09-816e-dcbd9e7b73e2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.705542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4996-286e-4b09-816e-dcbd9e7b73e2 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.707047 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3344/6674] 10.222.0.39 () {56 vars in 894 bytes} [Sat Jun 25 21:17:34 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:17:34.711755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a577-1f7d-4b18-8f08-ce1c807b4e27 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:34.774910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:34.782854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a577-1f7d-4b18-8f08-ce1c807b4e27 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:34.787852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:34.789799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.790096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.790788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] PATH_INFO: `/v3/users/d27f15d86c6c48ddb872768eec08145f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.792044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27f15d86c6c48ddb872768eec08145f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:34.794075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:34.862655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27f15d86c6c48ddb872768eec08145f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:34.872189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27f15d86c6c48ddb872768eec08145f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:34.889659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27f15d86c6c48ddb872768eec08145f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:34.890565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27f15d86c6c48ddb872768eec08145f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:34.891147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27f15d86c6c48ddb872768eec08145f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:34.908299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3331/6675] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:34 2022] DELETE /identity/v3/users/d27f15d86c6c48ddb872768eec08145f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:34.912785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:34.913235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:34.913522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:34.933386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:34.935103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.006057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3345/6676] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:35.015931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.017989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.081614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7bee0-d5e0-494f-b61e-10db991fed79 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.086083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:35.086753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.087046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.087336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.098699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:35.099779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41f9a-52d5-4b3c-942f-f2f60ddf050c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:35.111485 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3332/6677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:35.411758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.413286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.429220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a3039-63c4-473f-8ad8-bcd4a5a14708 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.434173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:35.435116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.435332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.435711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] PATH_INFO: `/v3/projects/bd96c78633be4d71a7ba743e150fac99` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.437190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd96c78633be4d71a7ba743e150fac99)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:35.439123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:35.505106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:35.534992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd96c78633be4d71a7ba743e150fac99', 'request_id': 'req-6ef63b05-4879-44cc-a8aa-74b24f500f3a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:35.546543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd96c78633be4d71a7ba743e150fac99', 'request_id': 'req-6ef63b05-4879-44cc-a8aa-74b24f500f3a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:35.555803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd96c78633be4d71a7ba743e150fac99', 'request_id': 'req-6ef63b05-4879-44cc-a8aa-74b24f500f3a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:35.574117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] The token cache is being invalidate because project bd96c78633be4d71a7ba743e150fac99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:35.574545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:35.575428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:35.577313 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3346/6678] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:35 2022] DELETE /identity/v3/projects/bd96c78633be4d71a7ba743e150fac99 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:35.583269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3838-fc9c-47d8-95ad-476da0449944 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.584128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3838-fc9c-47d8-95ad-476da0449944 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.584665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3838-fc9c-47d8-95ad-476da0449944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.614502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3ced3838-fc9c-47d8-95ad-476da0449944 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:35.616077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3ced3838-fc9c-47d8-95ad-476da0449944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.672086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.673785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.736150 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3333/6679] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:35.737653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.737940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.738364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.757623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef63b05-4879-44cc-a8aa-74b24f500f3a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.759552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:35.760814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.763608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:35.764289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.764630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.764882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.766779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.769693 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3334/6680] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:35.773769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.781078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:35.783043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:35.786125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a71ff1-57c1-449d-9d11-4dccebf26f6d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.793256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:35.794223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.794666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.794942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.795800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:35.796107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:35.797811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f640e4-7090-42d2-a0c0-97913c148420 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:35.801103 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3347/6681] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:17:35.808346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:35.816641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3335/6682] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:35.823290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.849804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.850166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.850552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.853986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87a8b5-f495-47b7-9269-24d148075315 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.859748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:35.860766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:35.861196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:35.861732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:35.862697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:35.865038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:35.872339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:35.873380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:35.905106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3348/6683] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:35 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:35.906842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:35.945536 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3336/6684] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:35.993530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513221b0-1668-414c-8ab1-d809698ed30e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:35.999536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.000231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.000566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.000863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.001536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.003509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.037929 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3349/6685] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:35 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:36.042069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.055625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e12e1d-8b9e-4ae0-b78e-4823dec4b495 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.060556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.061251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.061535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.062005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.062884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.065367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.077299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3337/6686] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:36.081454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.092649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560982a-9c87-4f71-94f2-11e6b05b8b59 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.097483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.098212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.098501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.099201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.099544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.101230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d5f4-0831-47db-ac8b-8024164299b1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.112181 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3350/6687] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:17:36.116306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.127928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18a06-2fdf-477e-88f9-6b3e1bf35245 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.132670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.133879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.133879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.134131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] PATH_INFO: `/v3/projects/4feb11bd230a43d4a7bc0b811c30a1e9/users/bff81e1dfc5945e4b1b84cad16fcf8ea/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.155516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4feb11bd230a43d4a7bc0b811c30a1e9, user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.157302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.186106 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3338/6688] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:36 2022] PUT /identity/v3/projects/4feb11bd230a43d4a7bc0b811c30a1e9/users/bff81e1dfc5945e4b1b84cad16fcf8ea/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:36.197507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.197811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.198136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.240822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] MFA Rules not processed for user `bff81e1dfc5945e4b1b84cad16fcf8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:36.242065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:36.249123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:36.326748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3351/6689] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:36.331665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.349706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726526-ca1a-4735-b584-9b44c4a93343 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.353981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.355517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.355517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.355517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.356057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.357777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.376572 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3339/6690] 10.222.0.39 () {60 vars in 1298 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:36.381102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.390169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4cca-a9c6-458b-b51e-6810d364689f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.394471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.395412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.395854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.395961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/8ef09a79533c4570a1333ef769321bd8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.398329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=8ef09a79533c4570a1333ef769321bd8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.399893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.418621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3352/6691] 10.222.0.39 () {58 vars in 1379 bytes} [Sat Jun 25 21:17:36 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/8ef09a79533c4570a1333ef769321bd8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:36.424527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.435012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8fdf-2f90-4fca-b11e-627ab05cc94d tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.439654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.440531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.440814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.441230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.442013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.443676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.464146 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3340/6692] 10.222.0.39 () {60 vars in 1298 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 367 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:36.468195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.478712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0c4ae-81be-42ad-9b83-8f45390ca57b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.484004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.484604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.484813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.485104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/74259d450b544146b8e80ea92d702d85` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.487211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=74259d450b544146b8e80ea92d702d85)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.488680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.507593 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3353/6693] 10.222.0.39 () {58 vars in 1379 bytes} [Sat Jun 25 21:17:36 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/74259d450b544146b8e80ea92d702d85 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:36.512327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.523009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d8bc-a30b-4f45-8d73-5de4376585fb tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.527506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.528398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.528717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.528995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/74259d450b544146b8e80ea92d702d85` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Could not find credential: f15d8e51aaeb98db7935361fd18ec04077415787d1745cda3d8ac9b75477faee.: keystone.exception.CredentialNotFound: Could not find credential: f15d8e51aaeb98db7935361fd18ec04077415787d1745cda3d8ac9b75477faee. Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jun 25 21:17:36.560675 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:17:36.561567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: f15d8e51aaeb98db7935361fd18ec04077415787d1745cda3d8ac9b75477faee. Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:36.562398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3341/6694] 10.222.0.39 () {58 vars in 1376 bytes} [Sat Jun 25 21:17:36 2022] GET /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/74259d450b544146b8e80ea92d702d85 => generated 148 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:17:36.569821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.581066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e7ba-ac2f-4ba2-919e-c4b4eba743d5 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.588343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.589280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.589572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.589853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.591392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.593489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.657275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.660747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3354/6695] 10.222.0.39 () {60 vars in 1298 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:17:36.671973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308213ed-fd07-40e8-bac2-cada6374c344 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.679067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.680035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.680622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.681000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.681750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.683475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.729820 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3342/6696] 10.222.0.39 () {60 vars in 1298 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:36.734164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.745127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6ae1-b2cc-4102-9b17-3a0c71e7e139 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.749659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.750689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.750989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.751284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.751978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.753815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.767871 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3355/6697] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 21:17:36 2022] GET /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 865 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:17:36.772046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.782428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac497a-809f-4178-a5a0-897091099d20 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.789301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.791386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.791681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.792023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/98501187b2614d7096aed85edcfac33e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.794609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=98501187b2614d7096aed85edcfac33e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.796103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.830752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3343/6698] 10.222.0.39 () {58 vars in 1379 bytes} [Sat Jun 25 21:17:36 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/98501187b2614d7096aed85edcfac33e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:36.836562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.851028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439de0-fab1-4c03-aaac-7615eb7f3350 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.857615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.858844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.859172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.859552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/f2dd673ff6f0402f95f1e0d037583362` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.862107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=f2dd673ff6f0402f95f1e0d037583362)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.863773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.897362 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3356/6699] 10.222.0.39 () {58 vars in 1379 bytes} [Sat Jun 25 21:17:36 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/f2dd673ff6f0402f95f1e0d037583362 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:36.899038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.910844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149cbc-af5a-46df-912f-cd972e64be30 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.916356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.916877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.917162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.917443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.918493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.919673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.946805 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3344/6700] 10.222.0.39 () {60 vars in 1298 bytes} [Sat Jun 25 21:17:36 2022] POST /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2 => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:36.951205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:36.970787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04561b-c6a1-43e8-b937-811ae11cff2b tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:36.977993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:36.978938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:36.979225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:36.979507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/c5438ceaa5ae441f81ba1986733dcb19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:36.981627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=c5438ceaa5ae441f81ba1986733dcb19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:36.983463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:36.986786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3357/6701] 10.222.0.39 () {58 vars in 1376 bytes} [Sat Jun 25 21:17:36 2022] GET /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/c5438ceaa5ae441f81ba1986733dcb19 => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:36.991009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:37.002024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfde7-37e7-4708-95fc-e132bc7024c3 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:37.007724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff81e1dfc5945e4b1b84cad16fcf8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feb11bd230a43d4a7bc0b811c30a1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:37.009177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.009470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.009917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/c5438ceaa5ae441f81ba1986733dcb19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.012960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea, credential_id=c5438ceaa5ae441f81ba1986733dcb19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:37.015117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bb97-0429-4ba4-8bf6-0f914bb6b0f0 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:37.038337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3345/6702] 10.222.0.39 () {58 vars in 1379 bytes} [Sat Jun 25 21:17:36 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea/credentials/OS-EC2/c5438ceaa5ae441f81ba1986733dcb19 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:37.046925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:37.136593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a9ce-8379-4f0e-a6b3-d69c70f4e818 tempest-EC2CredentialsTest-847169958 tempest-EC2CredentialsTest-847169958-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:37.141771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:37.142669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.143694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.145551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] PATH_INFO: `/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.147065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff81e1dfc5945e4b1b84cad16fcf8ea)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:37.149317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:37.195588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:37.206838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff81e1dfc5945e4b1b84cad16fcf8ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.208053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff81e1dfc5945e4b1b84cad16fcf8ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.217392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff81e1dfc5945e4b1b84cad16fcf8ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.229401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff81e1dfc5945e4b1b84cad16fcf8ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.236348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff81e1dfc5945e4b1b84cad16fcf8ea'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.242705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3358/6703] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:17:37 2022] DELETE /identity/v3/users/bff81e1dfc5945e4b1b84cad16fcf8ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:37.247183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.247420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.247697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.266283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:37.267486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:37.301863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:37.334015 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3346/6704] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:37.343950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:37.345595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:37.409706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79660dd4-cb7f-4d89-8e41-5a8a41bd7f74 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:37.413898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:37.414556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.414892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.415286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.425094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:37.426633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249c5f2-5888-4297-b69e-f3a482c50cee service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:37.436533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3359/6705] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:37.818248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:37.819890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:37.836961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df222-5dea-4646-bd70-c5d9345e91be None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:37.843025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:37.843872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.844090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.844369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] PATH_INFO: `/v3/projects/4feb11bd230a43d4a7bc0b811c30a1e9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.845700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4feb11bd230a43d4a7bc0b811c30a1e9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:37.847658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:37.895783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4feb11bd230a43d4a7bc0b811c30a1e9', 'request_id': 'req-770173a9-e5c3-4800-b33d-cea9f2f76182'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.904270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4feb11bd230a43d4a7bc0b811c30a1e9', 'request_id': 'req-770173a9-e5c3-4800-b33d-cea9f2f76182'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.910899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4feb11bd230a43d4a7bc0b811c30a1e9', 'request_id': 'req-770173a9-e5c3-4800-b33d-cea9f2f76182'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.923297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] The token cache is being invalidate because project 4feb11bd230a43d4a7bc0b811c30a1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:17:37.923614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.924347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-770173a9-e5c3-4800-b33d-cea9f2f76182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:37.926050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3347/6706] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:17:37 2022] DELETE /identity/v3/projects/4feb11bd230a43d4a7bc0b811c30a1e9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:37.931175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:37.931469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:37.931750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:37.950863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:37.952152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:38.015244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3360/6707] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:38.023308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.023598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.023876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.043196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:38.044362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:38.052935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3348/6708] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:38.057500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.068275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b6f6-c09f-4c1a-8c8e-8024c16c31b9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.074416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.074416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.074717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.074906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.075623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:17:38.075986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.077721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.090621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3361/6709] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:17:38.095164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.105074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec0f2f-3d95-400b-ad80-2ce54c77b62f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.110033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.110698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.110978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.111256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.111976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.114003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.147365 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3349/6710] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:38.151638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.162011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8607-8338-4903-8e4f-0bda374abce2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.206334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:38.232797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.233497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.233785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.234096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.234802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.236786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.262290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3362/6711] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:17:38 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:17:38.263791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.275015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b57b0d-e2f5-4f86-9676-f3f77bcdefab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.280349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.281114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.281401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.281680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.282466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.284245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.298685 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3350/6712] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:17:38.300178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.311057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d80a5-a0d2-4fbd-ada5-6141deb86328 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.316925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.317586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.317876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.318193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.318918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.320588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcdf9-fee0-4447-a19a-0588433b7096 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.331149 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3363/6713] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:17:38.336112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.351559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c633e-0286-4c31-bf83-be5cf8d8b8d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.358109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.359051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.359323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.359584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] PATH_INFO: `/v3/projects/11f85059d7d1468c816969cb6c51e580/users/f3bffce36e764a9c8da6877a8fa9d136/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.375272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f85059d7d1468c816969cb6c51e580, user_id=f3bffce36e764a9c8da6877a8fa9d136, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:38.377973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:38.392237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3351/6714] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:17:38 2022] PUT /identity/v3/projects/11f85059d7d1468c816969cb6c51e580/users/f3bffce36e764a9c8da6877a8fa9d136/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:38.402690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b86ac-bbf3-4b99-afdc-69fb68366c37 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.402969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b86ac-bbf3-4b99-afdc-69fb68366c37 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.403256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b86ac-bbf3-4b99-afdc-69fb68366c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.430478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-814b86ac-bbf3-4b99-afdc-69fb68366c37 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:38.431724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-814b86ac-bbf3-4b99-afdc-69fb68366c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:38.507239 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3364/6715] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:38.512315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:38.522891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16ded3-955b-4d36-82aa-cab49dc31e4b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:38.527169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf735-75a4-4720-9af2-ad13314960d7 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:38.528026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf735-75a4-4720-9af2-ad13314960d7 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:38.528308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf735-75a4-4720-9af2-ad13314960d7 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:38.528619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf735-75a4-4720-9af2-ad13314960d7 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:38.569413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cbecf735-75a4-4720-9af2-ad13314960d7 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:38.578494 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3352/6716] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:38 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:39.584702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:39.585249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:39.585483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:39.606256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:39.607664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:39.611169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3365/6717] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:39.616665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42232-6877-42b3-8063-a72b88663511 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:39.617157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42232-6877-42b3-8063-a72b88663511 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:39.617233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42232-6877-42b3-8063-a72b88663511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:39.636639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-92d42232-6877-42b3-8063-a72b88663511 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:39.637860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-92d42232-6877-42b3-8063-a72b88663511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:39.651519 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3353/6718] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:17:39.652910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:39.665618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0db1-51ab-405e-942a-6f6c9423c2df None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:39.669815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:39.671015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:39.671132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:39.671348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:39.741006 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 25 21:17:39.741989 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:17:39.745419 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3366/6719] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:39 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 188 bytes in 92 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:17:39.749185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42232-6877-42b3-8063-a72b88663511 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:39.760259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42232-6877-42b3-8063-a72b88663511 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:39.765234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8283cc-48db-4981-b95b-ab69e1a3834a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:39.766389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8283cc-48db-4981-b95b-ab69e1a3834a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:39.766772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8283cc-48db-4981-b95b-ab69e1a3834a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:39.767145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8283cc-48db-4981-b95b-ab69e1a3834a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:39.784148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-2f8283cc-48db-4981-b95b-ab69e1a3834a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:39.812885 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 25 21:17:39.813671 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:39.817842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3354/6720] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:39 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 188 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:17:39.818771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:39.830590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e4106-80ea-4b98-a9e8-51cfd9887b19 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:39.837139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31058b96-4689-4147-bb29-d6fd0bb8cc4f tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:39.838097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058b96-4689-4147-bb29-d6fd0bb8cc4f tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:39.838378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058b96-4689-4147-bb29-d6fd0bb8cc4f tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:39.838653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31058b96-4689-4147-bb29-d6fd0bb8cc4f tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:39.883735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-31058b96-4689-4147-bb29-d6fd0bb8cc4f tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:39.894219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3367/6721] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:39 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:40.899791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:40.900705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:40.901150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:40.919683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:40.920945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:40.924231 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3355/6722] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:40.929355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7237d2-d524-4d3f-b173-bbcdf9650c3a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:40.929892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7237d2-d524-4d3f-b173-bbcdf9650c3a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:40.930133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7237d2-d524-4d3f-b173-bbcdf9650c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:40.950492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6e7237d2-d524-4d3f-b173-bbcdf9650c3a None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:40.952019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e7237d2-d524-4d3f-b173-bbcdf9650c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:40.959870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3368/6723] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:40.964155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:40.977118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847b1f6-4d08-4117-bcb3-4578ee19eb27 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:40.982647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c2e2-a4d2-4140-aba0-2923c5e1a729 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:40.983689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2e2-a4d2-4140-aba0-2923c5e1a729 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:40.984070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2e2-a4d2-4140-aba0-2923c5e1a729 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:40.984466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2e2-a4d2-4140-aba0-2923c5e1a729 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:41.031506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1434c2e2-a4d2-4140-aba0-2923c5e1a729 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:41.041771 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3356/6724] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:40 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:42.046972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70781e6-d605-4531-898f-24095c227d5d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:42.046972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70781e6-d605-4531-898f-24095c227d5d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:42.047414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70781e6-d605-4531-898f-24095c227d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:42.067163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a70781e6-d605-4531-898f-24095c227d5d None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:42.069010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a70781e6-d605-4531-898f-24095c227d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:42.072529 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3369/6725] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:42 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:42.078158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973783d9-fe32-4c7b-91d6-4af2e85c1c2d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:42.078541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973783d9-fe32-4c7b-91d6-4af2e85c1c2d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:42.078918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973783d9-fe32-4c7b-91d6-4af2e85c1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:42.098912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-973783d9-fe32-4c7b-91d6-4af2e85c1c2d None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:42.100216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-973783d9-fe32-4c7b-91d6-4af2e85c1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:42.112670 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3357/6726] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:42.112762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70781e6-d605-4531-898f-24095c227d5d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:42.123795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70781e6-d605-4531-898f-24095c227d5d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:42.129020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5706-1807-43b4-b553-788fd7acc942 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:42.129947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5706-1807-43b4-b553-788fd7acc942 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:42.130204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5706-1807-43b4-b553-788fd7acc942 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:42.130592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5706-1807-43b4-b553-788fd7acc942 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:42.200095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9c5706-1807-43b4-b553-788fd7acc942 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:42.213862 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3370/6727] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:42 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:43.219525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:43.219935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:43.220077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:43.238559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:43.239820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:43.243273 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3358/6728] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:43 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:43.248025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dfef4-bd2c-437a-862e-a8b7cd3d9fbc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:43.248538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dfef4-bd2c-437a-862e-a8b7cd3d9fbc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:43.248623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dfef4-bd2c-437a-862e-a8b7cd3d9fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:43.254945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:43.270006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-109dfef4-bd2c-437a-862e-a8b7cd3d9fbc None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:43.272555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-109dfef4-bd2c-437a-862e-a8b7cd3d9fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:43.280396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3371/6729] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:43.284750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:43.296873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a3320-46f1-47b6-bdd2-b0f6f6e2d79c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:43.300935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b78709-13d0-4c7f-81ae-f4780e1c43ea tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:43.301802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78709-13d0-4c7f-81ae-f4780e1c43ea tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:43.302117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78709-13d0-4c7f-81ae-f4780e1c43ea tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:43.302392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78709-13d0-4c7f-81ae-f4780e1c43ea tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:43.352692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-17b78709-13d0-4c7f-81ae-f4780e1c43ea tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:43.364980 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3359/6730] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:43 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:17:44.370509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6accf1-80f1-490a-be43-b777a7c4590f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:44.371053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6accf1-80f1-490a-be43-b777a7c4590f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:44.371053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6accf1-80f1-490a-be43-b777a7c4590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:44.389901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3e6accf1-80f1-490a-be43-b777a7c4590f None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:44.391137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e6accf1-80f1-490a-be43-b777a7c4590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:44.394675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3372/6731] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:45.402068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13520c26-7e2f-49f8-9f51-f220bb1c9afb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:45.402524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13520c26-7e2f-49f8-9f51-f220bb1c9afb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:45.402687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13520c26-7e2f-49f8-9f51-f220bb1c9afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:45.422390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-13520c26-7e2f-49f8-9f51-f220bb1c9afb None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:45.423628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13520c26-7e2f-49f8-9f51-f220bb1c9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:45.431916 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3360/6732] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:45.438187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a6f0c-c293-4b9c-989a-50c745800d42 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:45.438669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a6f0c-c293-4b9c-989a-50c745800d42 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:45.438756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a6f0c-c293-4b9c-989a-50c745800d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:45.457580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-546a6f0c-c293-4b9c-989a-50c745800d42 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:45.458807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-546a6f0c-c293-4b9c-989a-50c745800d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:45.462263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3373/6733] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:45 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:45.470063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee75-88a8-4d89-a680-1ed4c2e85543 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:45.470395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee75-88a8-4d89-a680-1ed4c2e85543 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:45.470711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee75-88a8-4d89-a680-1ed4c2e85543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:45.531639 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.application [None req-410aee75-88a8-4d89-a680-1ed4c2e85543 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:17:45.533289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3361/6734] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 64 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 25 21:17:45.537968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:45.538267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:45.538539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:45.587429 ncdv-master-1 devstack@keystone.service[97720]: WARNING keystone.server.flask.application [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:17:45.589148 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3374/6735] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 52 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 25 21:17:45.593930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faea09-90c3-4f89-b4fc-ff6dcca7b260 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:45.594224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faea09-90c3-4f89-b4fc-ff6dcca7b260 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:45.594504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faea09-90c3-4f89-b4fc-ff6dcca7b260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:45.617915 ncdv-master-1 devstack@keystone.service[97719]: WARNING keystone.server.flask.application [None req-80faea09-90c3-4f89-b4fc-ff6dcca7b260 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:17:45.619598 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3362/6736] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 27 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 25 21:17:47.973801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:47.975659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:48.062832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa10c-ba17-40d3-a54f-319913fb0f49 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:48.069554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:48.070219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:48.070503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:48.070785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:48.072686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:48.088086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:48.089870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa93b26-1b45-4c18-920e-dd953aaafb23 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:48.102682 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3375/6737] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:17:55.611353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=50,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:56.132868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:56.133127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:56.133602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:56.153109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] MFA Rules not processed for user `99a45af5dbf8442d9801f494b794e880`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:56.154329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:56.213898 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3363/6738] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:56.632108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56d80-f83e-478b-a451-9dae51c97939 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:56.632541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56d80-f83e-478b-a451-9dae51c97939 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:56.632723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56d80-f83e-478b-a451-9dae51c97939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:56.717125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-afa56d80-f83e-478b-a451-9dae51c97939 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:56.719559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-afa56d80-f83e-478b-a451-9dae51c97939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:56.731296 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3376/6739] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:56.733056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:56.746762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc5db6-63aa-45d1-9ffd-b2a92b3c8f18 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:56.752663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:56.754096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:56.754388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:56.754666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:56.814928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:56.831712 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3364/6740] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:56 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:57.049787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5896-ec48-4359-b14c-d06c95e97d33 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:57.050091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5896-ec48-4359-b14c-d06c95e97d33 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:57.050376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5896-ec48-4359-b14c-d06c95e97d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:57.071020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3c0b5896-ec48-4359-b14c-d06c95e97d33 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:57.072243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c0b5896-ec48-4359-b14c-d06c95e97d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:57.135891 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3377/6741] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:57.158087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:57.160201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:57.242031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816961c-b1ee-4165-aa9e-d1b66d880eaf tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:57.248257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:57.248969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:57.249252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:57.249523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:57.258666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:17:57.260266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b9d1-7467-4b92-a1d9-2eede913b59a service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:17:57.269008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3365/6742] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:57.838756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f171-b0d3-4721-9a37-b36c454eec9b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:57.839782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f171-b0d3-4721-9a37-b36c454eec9b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:57.840298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f171-b0d3-4721-9a37-b36c454eec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:57.907283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d7d5f171-b0d3-4721-9a37-b36c454eec9b None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:57.919075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d7d5f171-b0d3-4721-9a37-b36c454eec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:57.923108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3378/6743] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:57.927560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7839d4-46ff-40bc-8295-3e3a00f8b24a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:57.928025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7839d4-46ff-40bc-8295-3e3a00f8b24a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:57.928123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7839d4-46ff-40bc-8295-3e3a00f8b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-4d7839d4-46ff-40bc-8295-3e3a00f8b24a None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jun 25 21:17:57.958686 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:57.959782 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 25 21:17:57.960794 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:17:57.966283 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3366/6744] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:57 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:17:57.967854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:57.968149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:57.968454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:58.045845 ncdv-master-1 devstack@keystone.service[97720]: WARNING keystone.server.flask.application [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 25 21:17:58.052762 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3379/6745] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:57 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 86 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 25 21:17:58.052937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8291f3-b6a7-450f-8026-57cfc92e6def None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:58.053289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8291f3-b6a7-450f-8026-57cfc92e6def None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:58.053669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8291f3-b6a7-450f-8026-57cfc92e6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:58.107005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1b8291f3-b6a7-450f-8026-57cfc92e6def None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:58.109684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1b8291f3-b6a7-450f-8026-57cfc92e6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:58.120508 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3367/6746] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:58.124669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:58.133840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:UPDATE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:58.147345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dc237-a0f1-474a-8767-bd49c14af54d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:58.160714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c01d5-b4ed-4a9c-8d7b-d50ba3ef4b3a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:58.161747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c01d5-b4ed-4a9c-8d7b-d50ba3ef4b3a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:58.162111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c01d5-b4ed-4a9c-8d7b-d50ba3ef4b3a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:58.162464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c01d5-b4ed-4a9c-8d7b-d50ba3ef4b3a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:58.249861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-df0c01d5-b4ed-4a9c-8d7b-d50ba3ef4b3a tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:58.268290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3380/6747] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:58 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:17:59.274920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:59.275450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:59.275450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:59.303495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:59.305375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:59.316705 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3368/6748] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:59 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:59.321590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093f2e-129f-4632-8f21-798365ab92aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:59.322638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093f2e-129f-4632-8f21-798365ab92aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:59.323976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093f2e-129f-4632-8f21-798365ab92aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:59.366900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f1093f2e-129f-4632-8f21-798365ab92aa None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:17:59.369191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f1093f2e-129f-4632-8f21-798365ab92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:17:59.386059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3381/6749] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:17:59.390349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:17:59.404386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee2eec-1967-41fa-93c7-0e8db0213e75 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:17:59.409326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcce85-4a94-4cc6-bb9f-4aef44d0a4e4 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:17:59.410567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcce85-4a94-4cc6-bb9f-4aef44d0a4e4 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:17:59.411063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcce85-4a94-4cc6-bb9f-4aef44d0a4e4 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:17:59.411596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcce85-4a94-4cc6-bb9f-4aef44d0a4e4 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:17:59.508716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b3bcce85-4a94-4cc6-bb9f-4aef44d0a4e4 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:17:59.514266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:59.534659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3369/6750] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:17:59 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:00.539931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:00.540487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:00.540487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:00.597123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:00.598621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:00.603114 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3382/6751] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:00 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:00.608191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6a1d-84f3-4f82-9b47-188bf51a2ed8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:00.608767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6a1d-84f3-4f82-9b47-188bf51a2ed8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:00.608864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde6a1d-84f3-4f82-9b47-188bf51a2ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:00.637878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bfde6a1d-84f3-4f82-9b47-188bf51a2ed8 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:00.640466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bfde6a1d-84f3-4f82-9b47-188bf51a2ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:00.652066 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3370/6752] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:00.655918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:00.672208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597c1b0-c046-42b4-a097-6656c5328699 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:00.691561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3bffce36e764a9c8da6877a8fa9d136', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11f85059d7d1468c816969cb6c51e580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:00.692749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:00.693042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:00.693328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:00.780768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:00.826528 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3383/6753] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:18:00 2022] POST /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136/password => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:18:01.831681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd9d21-f393-4281-9f55-ce5fba3e3466 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:01.832553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd9d21-f393-4281-9f55-ce5fba3e3466 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:01.832665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd9d21-f393-4281-9f55-ce5fba3e3466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:01.853516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-67bd9d21-f393-4281-9f55-ce5fba3e3466 None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:01.854740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-67bd9d21-f393-4281-9f55-ce5fba3e3466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:01.858332 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3371/6754] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:01 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:02.691853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:02.694168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:02.714492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c12a3-477a-41b9-85de-85270300a934 tempest-IdentityV3UsersTest-753676758 tempest-IdentityV3UsersTest-753676758-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:02.721677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:02.722594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:02.723076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:02.723689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:02.727838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:02.826225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:02.828021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:02.853311 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3384/6755] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:02.863623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e302-0d07-4d82-b3d0-c740a4f7120c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:02.864147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e302-0d07-4d82-b3d0-c740a4f7120c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:02.864238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e302-0d07-4d82-b3d0-c740a4f7120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:02.892391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a334e302-0d07-4d82-b3d0-c740a4f7120c None None] MFA Rules not processed for user `f3bffce36e764a9c8da6877a8fa9d136`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:02.893905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a334e302-0d07-4d82-b3d0-c740a4f7120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:02.906217 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3372/6756] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:02.912260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:03.023638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d4ae-22ee-4192-8003-d925be032e42 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:03.030842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:03.031765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:03.032053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:03.032335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] PATH_INFO: `/v3/users/f3bffce36e764a9c8da6877a8fa9d136` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:03.033619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bffce36e764a9c8da6877a8fa9d136)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:03.035746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:03.060909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:03.118202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:03.119548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:03.130781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:03.146719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:03.154838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bffce36e764a9c8da6877a8fa9d136'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:03.164494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3385/6757] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:02 2022] DELETE /identity/v3/users/f3bffce36e764a9c8da6877a8fa9d136 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:03.166534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:03.166887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:03.167222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:03.186562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:03.188468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:03.299934 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3373/6758] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:03.309217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:03.311567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:03.468176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d4200-ccb6-4783-964e-15908fa9aae4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:03.473715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:03.474575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:03.474840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:03.475116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:03.490725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:03.492236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4283c8-99c6-4e88-9f8a-1ce16e5c8490 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:03.503651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3386/6759] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:04.039816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.041541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:04.063504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bef5c5-6bdc-4738-a62f-84b707b301a6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.087017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.087206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.087493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.088222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] PATH_INFO: `/v3/projects/11f85059d7d1468c816969cb6c51e580` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.094583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f85059d7d1468c816969cb6c51e580)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:04.110537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:04.216036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f85059d7d1468c816969cb6c51e580', 'request_id': 'req-84d3b33f-bf10-4351-85bf-d65920ac384c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:04.233455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f85059d7d1468c816969cb6c51e580', 'request_id': 'req-84d3b33f-bf10-4351-85bf-d65920ac384c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:04.248311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f85059d7d1468c816969cb6c51e580', 'request_id': 'req-84d3b33f-bf10-4351-85bf-d65920ac384c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:04.266631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] The token cache is being invalidate because project 11f85059d7d1468c816969cb6c51e580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:04.266959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:04.281287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-84d3b33f-bf10-4351-85bf-d65920ac384c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:04.283791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3374/6760] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:04 2022] DELETE /identity/v3/projects/11f85059d7d1468c816969cb6c51e580 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:04.295614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.295614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.295614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.330694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:04.337361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:04.489152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3387/6761] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:04.498408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.498722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.499026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.521079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:04.522483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:04.530996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3375/6762] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:04.535480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.546984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79d20-b5c8-4be0-96fc-3fb63f19035e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.551879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.552823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.552975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.553252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.554022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:04.554285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:04.556276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:04.585078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.589834 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3388/6763] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:04.595203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953d46d-f4d9-43fd-8455-48252a86c718 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.602653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.603339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.603618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.604286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.604805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:04.608190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:04.674607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3376/6764] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:04 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:04.679496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.694798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fd3d3-2dcf-4877-8246-4535e2466074 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.743874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:04.846964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.847674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.848281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.848922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.850189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:04.854046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:04.893309 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3389/6765] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:04 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:04.902966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.922306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fda5c-ac6a-489c-9053-48e063f76f5f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.927831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.928553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.928891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.929103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:04.929896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:04.931439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:04.949561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3377/6766] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:04.953989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:04.972195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112289-d4b3-4fac-9c9c-82721146423d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:04.979194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:04.980292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:04.980894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:04.981293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] PATH_INFO: `/v3/projects/bff7df483966438daa803e7628bc8ccc/users/b7407136687443caba0502f9fca26f7e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.002358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff7df483966438daa803e7628bc8ccc, user_id=b7407136687443caba0502f9fca26f7e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.006656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:05.029670 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3390/6767] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:04 2022] PUT /identity/v3/projects/bff7df483966438daa803e7628bc8ccc/users/b7407136687443caba0502f9fca26f7e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:18:05.034043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:05.049348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660d4a-9df1-4dcb-9956-4140dd670fa3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:05.080205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:05.200230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:05.202339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.202867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.203345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.204867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.213464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117a280-8085-4d96-bef3-eefd75348492 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:05.252911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3378/6768] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:05.256911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:05.281145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec01f8c-5ee1-40db-929c-9cd48ebba786 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:05.297215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:05.301389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.301845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.304192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] PATH_INFO: `/v3/projects/bff7df483966438daa803e7628bc8ccc/users/b7407136687443caba0502f9fca26f7e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.307742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff7df483966438daa803e7628bc8ccc, user_id=b7407136687443caba0502f9fca26f7e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.313210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:05.334293 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3391/6769] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:05 2022] PUT /identity/v3/projects/bff7df483966438daa803e7628bc8ccc/users/b7407136687443caba0502f9fca26f7e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:05.345638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.346136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.346589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.407749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] MFA Rules not processed for user `b7407136687443caba0502f9fca26f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:05.409023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:05.534761 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3379/6770] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:05.535924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:05.647425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9519-35ee-45c4-98c1-4f37e6d7194f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:05.653067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:05.653803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.654143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.654422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.657080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.658394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:05.734669 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3392/6771] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:05 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:05.739207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:05.758405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcfb1d-444e-4028-b364-949ad68d4c39 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:05.879505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:05.880332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.880643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.880920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.882178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.884922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:05.934392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3380/6772] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:05 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:05.936690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:05.953955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce6ab-dd97-4045-a013-68abcf8c911c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:05.979617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:05.980330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:05.986822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:05.988678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:05.991180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:05.994995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:06.032071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3393/6773] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:06.034919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:06.053406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7a6ae-4fd9-4a75-9903-c0cf1bfc47ab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:06.071223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:06.072296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:06.072804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:06.075858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:06.077204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:06.082135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb7391-381d-452f-8d3b-013c038827e0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:06.117727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:06.119406 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3381/6774] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:06.132779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce481d8-2783-4472-bac1-7e1a57fb67e8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:06.137899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:06.139642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:06.139642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:06.139642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] PATH_INFO: `/v3/projects/92f3da6b7a944afc9b4615b6d77138af/users/66862b547f5f4b8ab5ab634d0dc9c985/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:06.202271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f3da6b7a944afc9b4615b6d77138af, user_id=66862b547f5f4b8ab5ab634d0dc9c985, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:06.206242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:06.265924 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3394/6775] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:06 2022] PUT /identity/v3/projects/92f3da6b7a944afc9b4615b6d77138af/users/66862b547f5f4b8ab5ab634d0dc9c985/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:18:06.269320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:06.269972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:06.270438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:06.337696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] MFA Rules not processed for user `66862b547f5f4b8ab5ab634d0dc9c985`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:06.339210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:06.367575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:06.551808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3382/6776] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:06.568450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:06.570022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:06.645713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:06.745831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664488b-5184-4e53-8bcf-ba06e025da4b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:06.766340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:06.771293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:06.771635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:06.771928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:06.996111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:06.998771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026bb76-8738-44c2-846f-3fc182b28d3a service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:07.014189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3395/6777] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:08.250517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:08.400341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3983df-c12a-4037-8b1f-103455faa820 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:08.412292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:08.415414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:08.416874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:08.417252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] PATH_INFO: `/v3/users/b7407136687443caba0502f9fca26f7e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:08.433384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7407136687443caba0502f9fca26f7e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:08.446209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:08.604000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7407136687443caba0502f9fca26f7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:08.615937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7407136687443caba0502f9fca26f7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:08.633472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7407136687443caba0502f9fca26f7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:08.634549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7407136687443caba0502f9fca26f7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:08.635297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7407136687443caba0502f9fca26f7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:08.657718 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3383/6778] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:08 2022] DELETE /identity/v3/users/b7407136687443caba0502f9fca26f7e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:08.662544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:08.664707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:08.665153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:08.704055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:08.714440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:08.860054 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3396/6779] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:08.879331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:08.883313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:08.933046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:08.991994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e11eab-41d3-4b71-a669-06dc9b364fdd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:08.996778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:08.997603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:08.997941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:08.998299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:09.015804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:09.017510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:09.041534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3384/6780] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:09.148379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:09.150139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:09.345921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabbb50-d1c4-449f-a649-4e8e7152cd37 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:09.353688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:09.354419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:09.354707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:09.355030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:09.357087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:09.395016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:09.396909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:09.442219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3397/6781] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:09.748635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:09.750983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:09.771818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4b52-a6ff-489d-8133-7454958bae36 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:09.783095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:09.784631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:09.785119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:09.785413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] PATH_INFO: `/v3/projects/bff7df483966438daa803e7628bc8ccc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:09.790257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff7df483966438daa803e7628bc8ccc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:09.792387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:09.913115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff7df483966438daa803e7628bc8ccc', 'request_id': 'req-5232437b-1a3e-4379-9d15-e31aa3c258f6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:09.931409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff7df483966438daa803e7628bc8ccc', 'request_id': 'req-5232437b-1a3e-4379-9d15-e31aa3c258f6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:09.941152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff7df483966438daa803e7628bc8ccc', 'request_id': 'req-5232437b-1a3e-4379-9d15-e31aa3c258f6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:09.959647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] The token cache is being invalidate because project bff7df483966438daa803e7628bc8ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:09.960296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:09.961229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:09.963655 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3385/6782] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:09 2022] DELETE /identity/v3/projects/bff7df483966438daa803e7628bc8ccc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:09.967425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:09.976090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:09.985223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bc1a-9a72-421e-b131-e5512ab899a8 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:10.189288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:10.200719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:10.201218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:10.201846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] PATH_INFO: `/v3/users/66862b547f5f4b8ab5ab634d0dc9c985` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:10.203516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66862b547f5f4b8ab5ab634d0dc9c985)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:10.206054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:10.301493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66862b547f5f4b8ab5ab634d0dc9c985'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:10.305419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66862b547f5f4b8ab5ab634d0dc9c985'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:10.323717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66862b547f5f4b8ab5ab634d0dc9c985'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:10.347919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66862b547f5f4b8ab5ab634d0dc9c985'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:10.356996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-813f6ff1-4984-4b9b-bcff-28ce31d35e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66862b547f5f4b8ab5ab634d0dc9c985'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:10.369172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3398/6783] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:09 2022] DELETE /identity/v3/users/66862b547f5f4b8ab5ab634d0dc9c985 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:11.002412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.003913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:11.039355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232437b-1a3e-4379-9d15-e31aa3c258f6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.167765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.168742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.169224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.169691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] PATH_INFO: `/v3/projects/92f3da6b7a944afc9b4615b6d77138af` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.171146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f3da6b7a944afc9b4615b6d77138af)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.173254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:11.264078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f3da6b7a944afc9b4615b6d77138af', 'request_id': 'req-2f9afff2-61d7-4593-a226-1b82db89fbf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:11.274541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f3da6b7a944afc9b4615b6d77138af', 'request_id': 'req-2f9afff2-61d7-4593-a226-1b82db89fbf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:11.278158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:11.283848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f3da6b7a944afc9b4615b6d77138af', 'request_id': 'req-2f9afff2-61d7-4593-a226-1b82db89fbf8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:11.309682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] The token cache is being invalidate because project 92f3da6b7a944afc9b4615b6d77138af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:11.310003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:11.310684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f9afff2-61d7-4593-a226-1b82db89fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:11.312327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3386/6784] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:11 2022] DELETE /identity/v3/projects/92f3da6b7a944afc9b4615b6d77138af => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:11.317749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.318304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.318747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.341056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:11.343966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:11.422127 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3399/6785] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:11.424885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.424885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.424885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.452021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:11.453281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:11.462303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3387/6786] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:11.466925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.478314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50076e-7404-4451-bca7-67d9992e1bdc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.483160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.483972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.484336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.484737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.485559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:11.485958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.488141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:11.539347 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3400/6787] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:18:11.540609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.559671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe75e96-6aed-42e1-a545-04e39b805387 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.566360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.567250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.567737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.568179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.569171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.572692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:11.609069 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3388/6788] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:11 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:11.613659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.647415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa79f-7d80-4f91-8f7b-ada0d90cba98 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.662265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:11.825229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.826583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.827089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.827399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.828158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.830544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:11.895123 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3401/6789] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:11 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:11.898310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.910048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26c198-007c-411d-b569-882f9c0c4dc0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.918798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.919482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.920027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.921264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.922533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.925178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:11.943082 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3389/6790] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:11.946691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:11.958186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382232be-ca7c-4966-9618-dabc71b967ce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:11.965026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:11.965661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:11.965945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:11.966219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:11.966947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:11.971216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955f1a1-4abc-4ea2-9b65-79cf67377f7e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.011275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3402/6791] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:12.015340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.027602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fc96d-f6c1-4fed-aff4-e9492302ef1d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.034243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.035940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.036526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.037200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] PATH_INFO: `/v3/projects/7fc30fe49fc744718d4de3efb533fb51/users/988ee447f0c44b01bd1b62a3cc871758/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.058173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc30fe49fc744718d4de3efb533fb51, user_id=988ee447f0c44b01bd1b62a3cc871758, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.061884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.083948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3390/6792] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:12 2022] PUT /identity/v3/projects/7fc30fe49fc744718d4de3efb533fb51/users/988ee447f0c44b01bd1b62a3cc871758/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:12.106804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.109260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.110286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.151819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] MFA Rules not processed for user `988ee447f0c44b01bd1b62a3cc871758`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:12.153369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:12.232518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3403/6793] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:12.234010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.307462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347343-b9ce-44f4-913e-8f9a019bbc55 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.313815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.314511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.314840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.315130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.315828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.318804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.352874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3391/6794] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:12 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:18:12.355206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.368348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e26e6-93c1-41e7-a07f-d4be8beb0020 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.443774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.444782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.445238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.445846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.446816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.449008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.476458 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3404/6795] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:12 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:18:12.478133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.489601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24251-b363-41ea-a846-38258581d5cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.494994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.495679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.495963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.496389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.497145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.498798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.511482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3392/6796] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:12.515340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.526241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ceee-4967-452a-a4cf-0b3fd109f34b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.532701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.533385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.533711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.534036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.534778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.536567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10bfc9-ace2-4872-ae28-2573ea4e2c2f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.540331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:12.560397 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3405/6797] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:18:12.561658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.573743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b024ddc-a509-4048-8e42-810a16bfb10f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.582727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.583812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.584163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.584536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] PATH_INFO: `/v3/projects/69ff203611bc458daa9a664251c4e719/users/94c172039f6c422c8ca83cedb343a9f8/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.611080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ff203611bc458daa9a664251c4e719, user_id=94c172039f6c422c8ca83cedb343a9f8, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:12.614630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:12.645520 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3393/6798] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:12 2022] PUT /identity/v3/projects/69ff203611bc458daa9a664251c4e719/users/94c172039f6c422c8ca83cedb343a9f8/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:12.647838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.647838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.648028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:12.682202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] MFA Rules not processed for user `94c172039f6c422c8ca83cedb343a9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:12.683501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:12.776217 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3406/6799] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:12.789096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:12.791381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:12.861311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:12.915948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97ca6-3b06-4e11-a763-91f69d796264 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:12.927680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:12.928377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:12.928758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:12.929045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:13.031014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:13.032972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:13.046493 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3394/6800] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:13.232367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:13.245956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa51a5f-0e82-4424-8c6c-62a3ba3f2845 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:13.249782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:13.250461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:13.250743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:13.251014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:13.262550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:13.264540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90810869-c721-4e15-a864-3ae929c3c5e0 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:13.277223 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3407/6801] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:15.223688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:15.347673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aba7af-1c04-490d-94a2-f6640ec58395 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:15.354123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:15.361259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:15.361713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:15.362141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] PATH_INFO: `/v3/users/988ee447f0c44b01bd1b62a3cc871758` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:15.365313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988ee447f0c44b01bd1b62a3cc871758)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:15.370346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:15.503956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988ee447f0c44b01bd1b62a3cc871758'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:15.517605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988ee447f0c44b01bd1b62a3cc871758'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:15.546401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988ee447f0c44b01bd1b62a3cc871758'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:15.546876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988ee447f0c44b01bd1b62a3cc871758'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:15.547557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988ee447f0c44b01bd1b62a3cc871758'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:15.570647 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3395/6802] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:15 2022] DELETE /identity/v3/users/988ee447f0c44b01bd1b62a3cc871758 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:15.575432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:15.575871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:15.576027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:15.639213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:15.641428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:15.753359 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3408/6803] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:15.776702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:15.779001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:15.793873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:15.895297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46c5e-fdcb-4c15-b453-619daf9f8228 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:15.900698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:15.901640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:15.901980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:15.902325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:15.914246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:15.916017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:15.927773 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3396/6804] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:16.425586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:16.426499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:16.442316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81c09-68c8-4fa4-9a92-bc3e9fa2224f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:16.449626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:16.450874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:16.452110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:16.452317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] PATH_INFO: `/v3/projects/7fc30fe49fc744718d4de3efb533fb51` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:16.473595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc30fe49fc744718d4de3efb533fb51)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:16.476395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:16.540597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc30fe49fc744718d4de3efb533fb51', 'request_id': 'req-30adb3f6-3a44-434d-8904-f2f9f89f62f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.550878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc30fe49fc744718d4de3efb533fb51', 'request_id': 'req-30adb3f6-3a44-434d-8904-f2f9f89f62f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.559287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc30fe49fc744718d4de3efb533fb51', 'request_id': 'req-30adb3f6-3a44-434d-8904-f2f9f89f62f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.563069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:16.576567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] The token cache is being invalidate because project 7fc30fe49fc744718d4de3efb533fb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:16.577668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.579320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.582646 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3409/6805] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:16 2022] DELETE /identity/v3/projects/7fc30fe49fc744718d4de3efb533fb51 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:16.586755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:16.599440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c13c1-b282-4153-9eec-861e499bb805 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:16.680394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:16.681372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:16.681661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:16.682953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] PATH_INFO: `/v3/users/94c172039f6c422c8ca83cedb343a9f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:16.684532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c172039f6c422c8ca83cedb343a9f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:16.686674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:16.753299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c172039f6c422c8ca83cedb343a9f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.764600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c172039f6c422c8ca83cedb343a9f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.781843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c172039f6c422c8ca83cedb343a9f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.783254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c172039f6c422c8ca83cedb343a9f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.786302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c172039f6c422c8ca83cedb343a9f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:16.805807 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3397/6806] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:16 2022] DELETE /identity/v3/users/94c172039f6c422c8ca83cedb343a9f8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:18:17.364837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:17.367097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:17.456061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adb3f6-3a44-434d-8904-f2f9f89f62f0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:17.482413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:17.484293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:17.533799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:17.568993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:17.569611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:17.570005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:17.570505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:17.573059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:17.619237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451ae4-cb2c-4d91-ab2c-d47fd8d42388 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:17.625050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:17.626114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:17.626573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:17.626987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] PATH_INFO: `/v3/projects/69ff203611bc458daa9a664251c4e719` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:17.628844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ff203611bc458daa9a664251c4e719)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:17.631502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:17.702660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ff203611bc458daa9a664251c4e719', 'request_id': 'req-fbe7d342-d6b1-4464-a596-a976650cd22a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:17.717193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ff203611bc458daa9a664251c4e719', 'request_id': 'req-fbe7d342-d6b1-4464-a596-a976650cd22a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:17.723189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:17.724790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3f24-153b-4082-9f6f-a8515c0f3725 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:17.726866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ff203611bc458daa9a664251c4e719', 'request_id': 'req-fbe7d342-d6b1-4464-a596-a976650cd22a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:17.743183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3410/6807] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:17.745498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] The token cache is being invalidate because project 69ff203611bc458daa9a664251c4e719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:17.745803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:17.746527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fbe7d342-d6b1-4464-a596-a976650cd22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:17.748274 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3398/6808] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:17 2022] DELETE /identity/v3/projects/69ff203611bc458daa9a664251c4e719 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:18:17.755493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:17.755922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:17.756213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:17.781595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:17.782581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:17.873502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:17.889152 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3411/6809] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:17.897895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:17.898561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:17.899039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:17.924814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:17.926177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:17.934935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3399/6810] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:17.939308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:17.950787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc99d3-003e-4f42-a093-4871d392b77b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:17.957098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:17.958137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:17.958626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:17.958981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:17.959853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:17.960231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:17.962961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d9b64-2f19-463d-84da-a34033b0c4a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:17.980685 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3412/6811] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:17.986350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.003507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee954-434f-44cf-8cf4-9a4e1c0aee7b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.010408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.012404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.012934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.013674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.014640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.017690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.057916 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3400/6812] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:17 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:18.060243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.060625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.061259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.062904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.089151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] MFA Rules not processed for user `3648405427d14f91a4bb44bd81f2195b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:18.091207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:18.190650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce318d-c512-4f80-813c-94cb1a8a7982 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.207299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.208090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.208522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.208681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.209404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.218899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.220224 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3413/6813] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:18.251123 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3401/6814] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:18 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:18.255441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.271092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c76d3-4ab7-41ca-a4ec-34e066140979 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.277431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.278627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.278627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.278808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.279727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.281414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.293525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3414/6815] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:18:18.297301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.309274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8aec-71d4-41e9-8933-403700abe678 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.314964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.315657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.315942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.316219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.317020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.318879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d10e8-72f8-4d34-86d7-20e788ac178b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.339767 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3402/6816] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:18.349188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.361112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831aa0-ed4e-4aa3-8443-db2b169ef5f9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.366474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.367511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.367802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.368134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] PATH_INFO: `/v3/projects/6da38d465afb404bbf483aca8064243d/users/f612d7acb45f4db1b3c42e42a9320b03/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.387453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da38d465afb404bbf483aca8064243d, user_id=f612d7acb45f4db1b3c42e42a9320b03, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.390516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.406861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3415/6817] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:18 2022] PUT /identity/v3/projects/6da38d465afb404bbf483aca8064243d/users/f612d7acb45f4db1b3c42e42a9320b03/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:18.418361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.418649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.418930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.438321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:18.463395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] MFA Rules not processed for user `f612d7acb45f4db1b3c42e42a9320b03`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:18.464679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:18.544565 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3403/6818] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:18.549929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.626345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71447-0bd8-48e4-8a93-162beab40738 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.631182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.632360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.632360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.632735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.633423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.635839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.673461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3416/6819] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:18 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:18.676906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.697641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd759bed-0559-4fc2-b202-150bd70b8ddf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.777337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.778348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.778634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.778907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.780257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.783505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.819259 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3404/6820] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:18 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:18.824149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.847944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9fb4-494c-41aa-a954-95310ae8c362 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.855119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.857282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.857692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.858128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.859169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.861037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.875490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3417/6821] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:18.880613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.891445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764eb00-dc28-4e28-be5b-a4604603eeda admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.899033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:18.900072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:18.900307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:18.900645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] PATH_INFO: `/v3/projects/6868cec8c6524bf58f365530405841be/users/90eda36ac6f849d6b28979e76ef9ea6f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:18.921960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6868cec8c6524bf58f365530405841be, user_id=90eda36ac6f849d6b28979e76ef9ea6f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:18.924958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:18.955050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3405/6822] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:18 2022] PUT /identity/v3/projects/6868cec8c6524bf58f365530405841be/users/90eda36ac6f849d6b28979e76ef9ea6f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:18.956355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:18.975358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02915ce-d9ea-4c54-bdf0-f9ba4e4e6b09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:18.999387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:19.085965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.086760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.087114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.087455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.088283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.090119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984180e3-c5b1-4ec1-9795-8b4ddbfea2df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.102405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3418/6823] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:19.106530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:19.120195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74854e3b-8437-4786-9977-b8fd5a1c6061 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:19.126895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.127495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.127779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.128143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] PATH_INFO: `/v3/projects/6868cec8c6524bf58f365530405841be/users/90eda36ac6f849d6b28979e76ef9ea6f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.130440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6868cec8c6524bf58f365530405841be, user_id=90eda36ac6f849d6b28979e76ef9ea6f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.133546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.144854 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3406/6824] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:19 2022] PUT /identity/v3/projects/6868cec8c6524bf58f365530405841be/users/90eda36ac6f849d6b28979e76ef9ea6f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:19.156465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.156890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.157029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.184999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] MFA Rules not processed for user `90eda36ac6f849d6b28979e76ef9ea6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:19.186315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:19.290747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:19.292873 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3419/6825] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:19.303422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63c15-ed56-43eb-8efa-70e6b9e926f0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:19.308703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90eda36ac6f849d6b28979e76ef9ea6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6868cec8c6524bf58f365530405841be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.309494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.309962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.310312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.311108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:19.311480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.313586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.332683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:19.339710 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3407/6826] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:19.344815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b57b74-b0ed-4ad6-8b86-730573009428 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:19.351138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90eda36ac6f849d6b28979e76ef9ea6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6868cec8c6524bf58f365530405841be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.352109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.354034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.354034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.354034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.357128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.399223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:19.404538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3420/6827] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:19 2022] POST /identity/v3/projects => generated 349 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:19.409531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a9be-a4fa-487e-8a88-c3480abf25f0 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:19.457409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:19.510212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90eda36ac6f849d6b28979e76ef9ea6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6868cec8c6524bf58f365530405841be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.510911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.511199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.511479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.512211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:19.512669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.516648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.536371 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3408/6828] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:18:19.565145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:19.567846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:19.652887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d7907-a7a3-4cf9-beba-4d51317920b1 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:19.657201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:19.658074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:19.658506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:19.658993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:19.671520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:19.673784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:19.686527 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3421/6829] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:22.594914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:22.620597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4bb2c-183e-479b-a052-a51a54cbe065 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:22.628012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90eda36ac6f849d6b28979e76ef9ea6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6868cec8c6524bf58f365530405841be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:22.629603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:22.630597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:22.653145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] PATH_INFO: `/v3/projects/8d398b0054d94136b1f188a526c18932` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:22.654929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8d398b0054d94136b1f188a526c18932)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:22.656983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:22.759187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d398b0054d94136b1f188a526c18932', 'request_id': 'req-f710abbc-5597-4d9c-8d61-9fde67d77c95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:22.776475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d398b0054d94136b1f188a526c18932', 'request_id': 'req-f710abbc-5597-4d9c-8d61-9fde67d77c95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:22.789031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d398b0054d94136b1f188a526c18932', 'request_id': 'req-f710abbc-5597-4d9c-8d61-9fde67d77c95'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:22.820558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] The token cache is being invalidate because project 8d398b0054d94136b1f188a526c18932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:22.820911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:22.821702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f710abbc-5597-4d9c-8d61-9fde67d77c95 tempest-QuotasNegativeTest-301395331 tempest-QuotasNegativeTest-301395331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:22.823418 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3409/6830] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:22 2022] DELETE /identity/v3/projects/8d398b0054d94136b1f188a526c18932 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:22.828796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:22.904211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:22.963216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d3c08-5025-437e-bf79-5055792c0f05 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:23.076263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:23.077433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:23.077732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:23.087678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] PATH_INFO: `/v3/users/f612d7acb45f4db1b3c42e42a9320b03` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:23.089335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f612d7acb45f4db1b3c42e42a9320b03)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:23.091561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:23.188883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f612d7acb45f4db1b3c42e42a9320b03'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:23.189663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f612d7acb45f4db1b3c42e42a9320b03'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:23.214148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f612d7acb45f4db1b3c42e42a9320b03'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:23.237052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f612d7acb45f4db1b3c42e42a9320b03'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:23.257452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f612d7acb45f4db1b3c42e42a9320b03'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:23.273154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3422/6831] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:22 2022] DELETE /identity/v3/users/f612d7acb45f4db1b3c42e42a9320b03 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:23.278029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:23.278590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:23.279066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:23.339308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:23.360872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:23.487581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3410/6832] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:23.604075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:23.611798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:23.850664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23594af-aae2-4005-bfad-862382ce045b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:23.867427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:23.868910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:23.870263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:23.871032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:23.891702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:23.893361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:23.895545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:23.912888 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3423/6833] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:24.335829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:24.337509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:24.467554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:24.527125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b1e0-8f9c-4fac-b47d-65aa14993ef3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:24.534032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:24.534715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:24.535004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:24.535283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:24.537670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:24.556380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:24.558240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:24.580997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3411/6834] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:24.960232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:24.962538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:24.978797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30695ecf-1a76-47f6-a9c5-0fa88967145a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:24.999509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:25.000923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:25.002269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:25.002675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] PATH_INFO: `/v3/projects/6da38d465afb404bbf483aca8064243d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:25.004256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da38d465afb404bbf483aca8064243d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:25.006467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:25.062266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da38d465afb404bbf483aca8064243d', 'request_id': 'req-070d1dca-c8cf-4e36-bc81-d0b30c33026f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.074057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da38d465afb404bbf483aca8064243d', 'request_id': 'req-070d1dca-c8cf-4e36-bc81-d0b30c33026f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.080099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da38d465afb404bbf483aca8064243d', 'request_id': 'req-070d1dca-c8cf-4e36-bc81-d0b30c33026f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.092874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] The token cache is being invalidate because project 6da38d465afb404bbf483aca8064243d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:25.093168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.093830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-070d1dca-c8cf-4e36-bc81-d0b30c33026f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.095400 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3424/6835] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:24 2022] DELETE /identity/v3/projects/6da38d465afb404bbf483aca8064243d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:25.099559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:25.110400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed4fd-d210-4510-95eb-4f0d168046ae service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:25.171136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:25.171511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:25.172103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:25.172445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] PATH_INFO: `/v3/users/90eda36ac6f849d6b28979e76ef9ea6f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:25.174266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=90eda36ac6f849d6b28979e76ef9ea6f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:25.176502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:25.229564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90eda36ac6f849d6b28979e76ef9ea6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.238904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90eda36ac6f849d6b28979e76ef9ea6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.254466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90eda36ac6f849d6b28979e76ef9ea6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.255205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90eda36ac6f849d6b28979e76ef9ea6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.256498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90eda36ac6f849d6b28979e76ef9ea6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:25.272501 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3412/6836] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:25 2022] DELETE /identity/v3/users/90eda36ac6f849d6b28979e76ef9ea6f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:26.045810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.046765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.046765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.060654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:26.064304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.096548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:26.097813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.145588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2678e0-c78d-43a3-b7a3-a87cce415fce admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:26.151039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:26.151931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.152263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.152572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] PATH_INFO: `/v3/projects/6868cec8c6524bf58f365530405841be` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.154104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6868cec8c6524bf58f365530405841be)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:26.156544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:26.160070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:26.251800 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3425/6837] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:18:26.256169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6868cec8c6524bf58f365530405841be', 'request_id': 'req-bddcc330-5f19-4134-bd34-20b8f8538890'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:26.273933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:26.283607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.286580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6868cec8c6524bf58f365530405841be', 'request_id': 'req-bddcc330-5f19-4134-bd34-20b8f8538890'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:26.298979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6868cec8c6524bf58f365530405841be', 'request_id': 'req-bddcc330-5f19-4134-bd34-20b8f8538890'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:26.321771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] The token cache is being invalidate because project 6868cec8c6524bf58f365530405841be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:26.322226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:26.324236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-bddcc330-5f19-4134-bd34-20b8f8538890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:26.329689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3413/6838] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:26 2022] DELETE /identity/v3/projects/6868cec8c6524bf58f365530405841be => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:26.331278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832534c0-b67f-45ed-8617-20fc761c0d0d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.335133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832534c0-b67f-45ed-8617-20fc761c0d0d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.336874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832534c0-b67f-45ed-8617-20fc761c0d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.393247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-832534c0-b67f-45ed-8617-20fc761c0d0d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:26.397694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e52d-3556-412e-925f-eb1a009e97e3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:26.401956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-832534c0-b67f-45ed-8617-20fc761c0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.438176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:26.501055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:26.501743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.502021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.502850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.508803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.563431 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3414/6839] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:26.573112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.573533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.573978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.635877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:26.637533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:26.638193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:26.640179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:26.669008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3415/6840] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:26.671177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:26.685857 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3426/6841] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:26.696258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f4aaa-978f-471d-860a-abcc42b9a437 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:26.710491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:26.711369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.711829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.712254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.713752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:26.714141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:26.716749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:26.754042 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3416/6842] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:26.756692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:26.781554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12e9-0a29-452a-be5e-5c4b530e5c57 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:26.787799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:26.789403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:26.789878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:26.790330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:26.791568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:26.793925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:26.863345 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3427/6843] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:26 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:26.864929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:26.878818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb273a-3a6e-4b34-b880-e222d82ce25a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:27.090850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:27.091674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.091982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.092258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.093118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:27.095506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:27.128520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:27.140076 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3417/6844] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:26 2022] POST /identity/v3/users => generated 279 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:18:27.140977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:27.170550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6e8e-2b49-4c4b-b71f-85d0d05a67fc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:27.182543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:27.185285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.185814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.186693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.189012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:27.193120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:27.210966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3428/6845] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:27.215072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:27.230449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38d685-a95d-4b8c-abac-d052b8f4e118 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:27.248943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:27.249809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.250115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.250396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.251303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:27.253367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c27651-9896-4dc2-ace7-6f7411b7de9f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:27.269659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3418/6846] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:27.273869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:27.289682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e500-ef43-4f64-b701-cde785f4444d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:27.307737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:27.309119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.309547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.309977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] PATH_INFO: `/v3/projects/ba553790c11e494c83c536d059b7887a/users/aba6103ac6f14a9ba490fd13dc5713eb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.347833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba553790c11e494c83c536d059b7887a, user_id=aba6103ac6f14a9ba490fd13dc5713eb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:27.354526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:27.400265 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3429/6847] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:27 2022] PUT /identity/v3/projects/ba553790c11e494c83c536d059b7887a/users/aba6103ac6f14a9ba490fd13dc5713eb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:27.402255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601f86-26d5-4e34-98d4-b5e36f2fef51 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.402837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601f86-26d5-4e34-98d4-b5e36f2fef51 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.403154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601f86-26d5-4e34-98d4-b5e36f2fef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.465279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-06601f86-26d5-4e34-98d4-b5e36f2fef51 None None] MFA Rules not processed for user `aba6103ac6f14a9ba490fd13dc5713eb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:27.466673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-06601f86-26d5-4e34-98d4-b5e36f2fef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:27.635657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3419/6848] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:27.640729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:27.781605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dfb0-d9cc-4634-98eb-a73a7b6d0d7d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:27.789981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:27.791080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.791475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.792525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.793353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:27.797714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:27.830683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:27.832974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:27.834527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:27.879106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:27.886198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] MFA Rules not processed for user `aa2aaa29e0dd479283202bd6575b4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:27.892069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:27.908706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3430/6849] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:27 2022] POST /identity/v3/projects => generated 355 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:27.912604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.043405 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3420/6850] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:18:28.067326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824fe6-4acc-4e64-b44f-b3735929f824 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.075224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.075959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.076342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.076789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.078042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.080976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.109224 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3431/6851] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:27 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:28.112981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.139597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce87b7-598a-427c-a8e9-f0a059f04bb5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.145779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.146483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.146780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.147042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.147928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.149604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.187335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3421/6852] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:28.192753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.208553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1571-0f37-4bb6-9f24-9b533320c97f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.229699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.231950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.233194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.234214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] PATH_INFO: `/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d/users/145b188fa2bb485a9d6e7b6500c60df9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.278773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4eb3771df0b42e5a7ccf3022f96cd3d, user_id=145b188fa2bb485a9d6e7b6500c60df9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.286097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.313728 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3432/6853] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:28 2022] PUT /identity/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d/users/145b188fa2bb485a9d6e7b6500c60df9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:28.318113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.334893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d85c-a25d-4191-8101-7842c36b13dc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.469743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.471154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.471655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.472041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.473239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.477813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f755-fab7-46ee-b0af-4296ae33b8b3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.503578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3422/6854] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:28.504813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.527496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010d0d4-1529-47e7-a5cf-55eb59995119 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.533314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.534505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.534902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.535065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] PATH_INFO: `/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d/users/145b188fa2bb485a9d6e7b6500c60df9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.537437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4eb3771df0b42e5a7ccf3022f96cd3d, user_id=145b188fa2bb485a9d6e7b6500c60df9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.540690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.554058 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3433/6855] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:28 2022] PUT /identity/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d/users/145b188fa2bb485a9d6e7b6500c60df9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:28.566439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.566897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.567469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.635344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:28.660791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] MFA Rules not processed for user `145b188fa2bb485a9d6e7b6500c60df9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:28.664177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:28.894969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3423/6856] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:28.895934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.915351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e83-8a03-46aa-8f0d-fc4f15fbf8ca admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.925337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '145b188fa2bb485a9d6e7b6500c60df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.927405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.927966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.928932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.931067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:28.932155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.936646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:28.958963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3434/6857] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:28.962841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:28.974673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fcd0f-edcc-49cb-a8f7-243c61790117 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:28.983078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '145b188fa2bb485a9d6e7b6500c60df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:28.983929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:28.984211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:28.984548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:28.985255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:28.987471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:29.033043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3424/6858] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:28 2022] POST /identity/v3/projects => generated 349 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:29.038184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:29.065142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c87b-d08b-4d58-92c9-60d59fbf6ba2 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:29.229730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '145b188fa2bb485a9d6e7b6500c60df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:29.230525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:29.230729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:29.230967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:29.231737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:29.232022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:29.247501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:29.285276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3435/6859] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:18:29.296120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:29.298919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:29.470956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6b5a-7338-4365-9fd3-df4ef38fed56 tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:29.493190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:29.494017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:29.494296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:29.494814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:29.520873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:29.522421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:29.557162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3425/6860] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:29.857935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:29.875821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fa368-e062-4d2e-b6d4-8da8020ca3dd tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:29.890391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '145b188fa2bb485a9d6e7b6500c60df9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:29.892955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:29.893439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:29.895982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] PATH_INFO: `/v3/projects/9ecbcb991e8d41cda228cf9f6c93aace` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:29.898154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ecbcb991e8d41cda228cf9f6c93aace)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:29.914155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:29.983151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:30.034117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecbcb991e8d41cda228cf9f6c93aace', 'request_id': 'req-9708444d-95fc-40c6-a2e7-4f16dbefebbc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:30.052284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecbcb991e8d41cda228cf9f6c93aace', 'request_id': 'req-9708444d-95fc-40c6-a2e7-4f16dbefebbc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:30.068006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecbcb991e8d41cda228cf9f6c93aace', 'request_id': 'req-9708444d-95fc-40c6-a2e7-4f16dbefebbc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:30.093374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] The token cache is being invalidate because project 9ecbcb991e8d41cda228cf9f6c93aace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:30.097647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:30.098641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9708444d-95fc-40c6-a2e7-4f16dbefebbc tempest-QuotasTest-784984537 tempest-QuotasTest-784984537-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:30.100925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3436/6861] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:29 2022] DELETE /identity/v3/projects/9ecbcb991e8d41cda228cf9f6c93aace => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:30.565670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:30.715786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722ae26-fa8e-42b9-b560-6fa170df9877 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:30.742135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:30.829513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:30.830487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:30.843178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:30.843178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] PATH_INFO: `/v3/users/aba6103ac6f14a9ba490fd13dc5713eb` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:30.845794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6103ac6f14a9ba490fd13dc5713eb)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:30.868075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:30.978986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6103ac6f14a9ba490fd13dc5713eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:31.016855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6103ac6f14a9ba490fd13dc5713eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:31.072049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6103ac6f14a9ba490fd13dc5713eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:31.074356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6103ac6f14a9ba490fd13dc5713eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:31.075410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6103ac6f14a9ba490fd13dc5713eb'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:31.117016 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3426/6862] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:30 2022] DELETE /identity/v3/users/aba6103ac6f14a9ba490fd13dc5713eb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:31.121632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:31.123129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:31.123713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:31.170612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:31.173718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:31.380855 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3437/6863] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:31.407550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:31.409846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:31.647655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e58a7-c8a4-4103-ab92-22addc22fbbe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:31.664102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:31.664748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:31.665032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:31.665308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:31.706935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:31.710357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:31.736365 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3427/6864] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:32.804315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:32.806968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:32.834613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cea74-16a2-4d05-aed6-36c40b50775b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:32.848971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:32.850482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:32.850916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:32.851902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] PATH_INFO: `/v3/projects/ba553790c11e494c83c536d059b7887a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:32.862708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba553790c11e494c83c536d059b7887a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:32.865842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:32.998428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba553790c11e494c83c536d059b7887a', 'request_id': 'req-4cbc15fa-5abe-4a38-8669-db549e331940'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.038510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba553790c11e494c83c536d059b7887a', 'request_id': 'req-4cbc15fa-5abe-4a38-8669-db549e331940'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.048659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba553790c11e494c83c536d059b7887a', 'request_id': 'req-4cbc15fa-5abe-4a38-8669-db549e331940'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.076132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] The token cache is being invalidate because project ba553790c11e494c83c536d059b7887a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:33.076302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.077682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.084331 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3438/6865] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:32 2022] DELETE /identity/v3/projects/ba553790c11e494c83c536d059b7887a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:33.085433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:33.103607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bcc27-fdd0-48e1-8a77-8106f512de90 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:33.226424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:33.252282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:33.254386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:33.255305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:33.255875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] PATH_INFO: `/v3/users/145b188fa2bb485a9d6e7b6500c60df9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:33.257623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=145b188fa2bb485a9d6e7b6500c60df9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:33.259994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:33.343682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145b188fa2bb485a9d6e7b6500c60df9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.366365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145b188fa2bb485a9d6e7b6500c60df9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.392531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145b188fa2bb485a9d6e7b6500c60df9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.393588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145b188fa2bb485a9d6e7b6500c60df9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.394330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-28077168-bbde-4d38-90d6-d1e26256001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145b188fa2bb485a9d6e7b6500c60df9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:33.443621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3428/6866] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:33 2022] DELETE /identity/v3/users/145b188fa2bb485a9d6e7b6500c60df9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:33.915238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:33.917902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:33.947732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc15fa-5abe-4a38-8669-db549e331940 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:34.053354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:34.157875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:34.159049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.159329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.159612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] PATH_INFO: `/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.161200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4eb3771df0b42e5a7ccf3022f96cd3d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:34.170805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:34.345380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'request_id': 'req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:34.361902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'request_id': 'req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:34.375774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4eb3771df0b42e5a7ccf3022f96cd3d', 'request_id': 'req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:34.415114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] The token cache is being invalidate because project c4eb3771df0b42e5a7ccf3022f96cd3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:34.415419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:34.417282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6d8e9045-b65b-41c2-a02a-a75da6c63a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:34.424579 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3439/6867] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:33 2022] DELETE /identity/v3/projects/c4eb3771df0b42e5a7ccf3022f96cd3d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:34.426736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.427217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.427688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.468728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:34.469980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:34.637641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3429/6868] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:34.649393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.650030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.650834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.688630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:34.694812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:34.713582 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3440/6869] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:34.717916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:34.729871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f899aa-f6bc-416c-8c38-839983fca527 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:34.748738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:34.749776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.750257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.750701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.751974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:34.753352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:34.755705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:34.778871 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3430/6870] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:34.783645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:34.794366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa853-981c-4b7a-9f96-b61e54467bf0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:34.800878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:34.801654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.802128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.802524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.813919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:34.813919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:34.870199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:34.870799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3441/6871] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:34 2022] POST /identity/v3/projects => generated 359 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:34.881957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf59a-ccd6-4579-9ec0-8a8a366ce4cb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:34.942722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:34.961806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:34.963402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:34.964340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:34.965207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:34.965785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:34.968040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:34.997466 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3431/6872] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:34 2022] POST /identity/v3/users => generated 280 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:18:35.002299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:35.014835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc11db-748f-48b8-8645-71331f5d6dff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:35.020763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:35.021541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:35.021857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:35.022290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:35.023085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:35.024852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:35.037225 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3442/6873] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:35.042227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:35.069407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ddafe-63ac-472d-887e-91dfd26aeebd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:35.075905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:35.077138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:35.077594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:35.078014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:35.078906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:35.080803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae909-eebe-440d-8449-61426ca5eb08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:35.095932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3432/6874] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:35.102370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:35.119044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d2a9-d7a9-45c7-b2fa-e82f30add2d4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:35.137947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:35.138977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:35.139338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:35.139690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] PATH_INFO: `/v3/projects/00590b74ef7540b0aa39eb02ad92c882/users/aef0c4bc94a043568cd015ea22cd5c47/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:35.159800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=00590b74ef7540b0aa39eb02ad92c882, user_id=aef0c4bc94a043568cd015ea22cd5c47, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:35.163555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:35.200909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3443/6875] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:35 2022] PUT /identity/v3/projects/00590b74ef7540b0aa39eb02ad92c882/users/aef0c4bc94a043568cd015ea22cd5c47/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:35.218975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cab3d-5878-4834-8c9b-74026e4429b0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:35.219422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cab3d-5878-4834-8c9b-74026e4429b0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:35.220059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cab3d-5878-4834-8c9b-74026e4429b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:35.263978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7c2cab3d-5878-4834-8c9b-74026e4429b0 None None] MFA Rules not processed for user `aef0c4bc94a043568cd015ea22cd5c47`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:35.265693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7c2cab3d-5878-4834-8c9b-74026e4429b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:35.366901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3433/6876] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:35.379445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:35.381440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:35.513894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2077-86dc-4f6f-93ee-c2e80d92f1ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:35.518263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:35.519501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:35.519501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:35.519501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:35.529651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:35.531179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:35.542522 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3444/6877] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:18:45.352893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:45.542758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:46.700779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:46.701249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:46.701514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:46.724891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:46.726500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:46.802183 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3434/6878] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:46.825256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:46.826928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:46.918849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15743e-eae1-4285-be7c-31fa9bfed56a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:46.925218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:46.925887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:46.926169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:46.926443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:46.935995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:46.937637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:46.946424 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3445/6879] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:18:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:53.648678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:53.650235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:53.758456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016f1c6-57a9-470f-acd2-e90b0cd9a96a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:53.763169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:53.765000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:53.765458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:53.766149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] PATH_INFO: `/v3/users/99a45af5dbf8442d9801f494b794e880` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:53.767550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a45af5dbf8442d9801f494b794e880)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:53.769734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:53.830123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a45af5dbf8442d9801f494b794e880'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:53.841368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a45af5dbf8442d9801f494b794e880'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:53.863460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a45af5dbf8442d9801f494b794e880'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:53.865383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a45af5dbf8442d9801f494b794e880'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:53.866048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-16f9e9c3-89f4-4c5d-87b2-67217124b4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a45af5dbf8442d9801f494b794e880'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:53.881026 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3435/6880] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:18:53 2022] DELETE /identity/v3/users/99a45af5dbf8442d9801f494b794e880 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:54.118379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.130206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ccf11-74cb-4074-b8e8-f56feb07178f service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.194088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.195014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.195292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.195569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] PATH_INFO: `/v3/projects/1df9f09e5c7c4f21aca1705769d3c84c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.196822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df9f09e5c7c4f21aca1705769d3c84c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.198746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.253482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df9f09e5c7c4f21aca1705769d3c84c', 'request_id': 'req-244cfff1-e2ab-478e-8f8e-c32a4b0573db'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:54.263197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df9f09e5c7c4f21aca1705769d3c84c', 'request_id': 'req-244cfff1-e2ab-478e-8f8e-c32a4b0573db'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:54.269918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df9f09e5c7c4f21aca1705769d3c84c', 'request_id': 'req-244cfff1-e2ab-478e-8f8e-c32a4b0573db'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:54.284285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] The token cache is being invalidate because project 1df9f09e5c7c4f21aca1705769d3c84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:18:54.284719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:54.285468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-244cfff1-e2ab-478e-8f8e-c32a4b0573db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:18:54.287974 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3446/6881] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:18:54 2022] DELETE /identity/v3/projects/1df9f09e5c7c4f21aca1705769d3c84c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:54.293893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1320-e529-41ac-b314-2633955b5363 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.294291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1320-e529-41ac-b314-2633955b5363 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.294447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1320-e529-41ac-b314-2633955b5363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.315165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-794b1320-e529-41ac-b314-2633955b5363 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:54.317705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-794b1320-e529-41ac-b314-2633955b5363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:54.343034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:54.394919 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3436/6882] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:54.403491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.403852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.404160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.424564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:54.425786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:54.434550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3447/6883] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:54.438766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b1320-e529-41ac-b314-2633955b5363 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.449144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b1320-e529-41ac-b314-2633955b5363 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.457102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.457783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.458103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.458416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.459183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:18:54.459497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.461209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.474092 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3437/6884] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:18:54.478322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.488041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebfb9-fd31-49be-bbf0-e3a6f7f9b058 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.493744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.494415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.494703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.494987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.495683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.497687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.508146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:54.526229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3448/6885] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:18:54 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:54.531226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.543387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e22-c85d-45b5-bcd6-277f102f7ae1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.607693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.609903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.610378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.611169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.612547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.614779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.640867 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3438/6886] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:18:54 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:18:54.645466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.656675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb19f3-361c-4154-b2e1-6596fefb8d96 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.662705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.663142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.663428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.663707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.664715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.666246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.678460 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3449/6887] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:18:54.682506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.692755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56db7f-feb2-42e6-9050-6df5fb991e95 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.697661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.697995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.698277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.698551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.699274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.700917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520dc90-6c0c-4be8-b6cb-d1bdb622461a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.711919 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3439/6888] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:18:54.716134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.726343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0cc2-4332-48ab-b56d-0d3dd3a81c83 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.731092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.731988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.732621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.732907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] PATH_INFO: `/v3/projects/675ab7469dbb421eb3a598e7439bca65/users/579aac7a3fbe41fea6323681f07e8fc4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.748361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675ab7469dbb421eb3a598e7439bca65, user_id=579aac7a3fbe41fea6323681f07e8fc4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.751221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.765332 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3450/6889] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:18:54 2022] PUT /identity/v3/projects/675ab7469dbb421eb3a598e7439bca65/users/579aac7a3fbe41fea6323681f07e8fc4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:18:54.775839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.776132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.776475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.805224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] MFA Rules not processed for user `579aac7a3fbe41fea6323681f07e8fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:18:54.806402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:54.880080 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3440/6890] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:18:54.891574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:18:54.893302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:18:54.960223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf79278-2836-4fd5-839b-67b0d8631df9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:18:54.965084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:18:54.965861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:18:54.966371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:18:54.966568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:18:54.976951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:18:54.978427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d8d8-8987-41ef-afc6-7d9e424d8953 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:18:54.988208 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3451/6891] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:03.651104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:03.674474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:03.720671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743c8e-4a6b-4975-9571-d70f1e16f761 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:03.726014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:03.726899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:03.727190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:03.727470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] PATH_INFO: `/v3/users/579aac7a3fbe41fea6323681f07e8fc4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:03.728729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579aac7a3fbe41fea6323681f07e8fc4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:03.731473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:03.782646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579aac7a3fbe41fea6323681f07e8fc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:03.790708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579aac7a3fbe41fea6323681f07e8fc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:03.803856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579aac7a3fbe41fea6323681f07e8fc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:03.804829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579aac7a3fbe41fea6323681f07e8fc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:03.805416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579aac7a3fbe41fea6323681f07e8fc4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:03.820317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3441/6892] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:03 2022] DELETE /identity/v3/users/579aac7a3fbe41fea6323681f07e8fc4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:03.824757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839047cf-62f1-4564-8852-c4982373168c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:03.825263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839047cf-62f1-4564-8852-c4982373168c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:03.825373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839047cf-62f1-4564-8852-c4982373168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:03.843954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-839047cf-62f1-4564-8852-c4982373168c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:03.845402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-839047cf-62f1-4564-8852-c4982373168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:03.912280 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3452/6893] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:03.920253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:03.922174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:04.004734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15605eb-a4d5-4f25-b1c8-b091a7b13e04 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:04.008407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:04.009095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:04.009380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:04.009657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:04.024598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:04.026161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c03db4-d108-4c9f-a50a-5d8153b72342 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:04.036464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3442/6894] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:04.801614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839047cf-62f1-4564-8852-c4982373168c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:04.803628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-839047cf-62f1-4564-8852-c4982373168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:04.821324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839047cf-62f1-4564-8852-c4982373168c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:04.831673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:04.832646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:04.832923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:04.833205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] PATH_INFO: `/v3/projects/675ab7469dbb421eb3a598e7439bca65` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:04.834431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=675ab7469dbb421eb3a598e7439bca65)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:04.842262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:04.899395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675ab7469dbb421eb3a598e7439bca65', 'request_id': 'req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:04.903087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:04.908257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675ab7469dbb421eb3a598e7439bca65', 'request_id': 'req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:04.915664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675ab7469dbb421eb3a598e7439bca65', 'request_id': 'req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:04.930075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] The token cache is being invalidate because project 675ab7469dbb421eb3a598e7439bca65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:04.930341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:04.930997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2977ce1-6d26-4d83-b7d6-acbdb59bc80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:04.932722 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3453/6895] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:04 2022] DELETE /identity/v3/projects/675ab7469dbb421eb3a598e7439bca65 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:04.939621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:04.940158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:04.940158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:04.959282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:04.960542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:05.006096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:05.029607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3443/6896] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:05.037759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.038121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.038464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.059015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:05.061146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:05.070730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3454/6897] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:05.075136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.085868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad5fd8-294f-4291-91a5-4daf229d9f9b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.091414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.092082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.092363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.092672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.093434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:05.093741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.095364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.111086 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3444/6898] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:05.115636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.125203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c5c4-e69a-43d4-abfe-1aab082f5c87 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.129928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.130601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.130882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.131159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.131862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.133825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.161733 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3455/6899] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:05.166084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.176965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5cf1-c78f-43d9-bc7d-900861e91e87 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.236196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.236920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.237209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.237490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.238185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.240260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.263533 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3445/6900] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:05.267390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.278040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fd254-3c01-4d8f-8202-2aedf04c5aeb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.286750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.287468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.287771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.288052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.288836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.290462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.301666 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3456/6901] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:05.305772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.315811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260bf16-2549-45b9-9ff2-f9abcea2e20c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.320647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.321320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.321602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.321878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.322605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.324212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a24cd-7d71-43e4-8d1d-0292ab483df0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.337910 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3446/6902] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:05.339181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.349263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769649-511e-474b-a5a0-cfdd56ad9e0d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.354199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.355234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.355523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.355804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] PATH_INFO: `/v3/projects/e76276ec64c946e38ab97edcf28eaacc/users/4cee433140094fb38626dfbfb6b9cfaf/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.371325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76276ec64c946e38ab97edcf28eaacc, user_id=4cee433140094fb38626dfbfb6b9cfaf, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.374250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.387973 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3457/6903] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:05 2022] PUT /identity/v3/projects/e76276ec64c946e38ab97edcf28eaacc/users/4cee433140094fb38626dfbfb6b9cfaf/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:05.399462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.399753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.400028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.428236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] MFA Rules not processed for user `4cee433140094fb38626dfbfb6b9cfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:05.429624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:05.499972 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3447/6904] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:05.505400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.580223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4a6b-ab69-4a3b-b503-e0bb0e12e417 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.585960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.586350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.586633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.586907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.587600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.589544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.624592 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3458/6905] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:05.625927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.638330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83c08c-6b7d-4138-98f8-dc216496995b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.685536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:05.711555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.712244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.712557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.712845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.713518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.716009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.741422 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3448/6906] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:05.745366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.760599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d77471-9980-4875-b771-e2e95e008b46 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.766935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.767632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.767921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.768205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.769159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.770888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.782672 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3459/6907] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:05.787341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.799135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909f1ce-cb2a-4bf7-b434-1d04bb757179 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.808115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.809082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.809367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.809645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] PATH_INFO: `/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0/users/7061f35eacae4f2293bb523ef0955906/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.830043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f03c827bcf4207ba1b628ec5e30ea0, user_id=7061f35eacae4f2293bb523ef0955906, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.834295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.850582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3449/6908] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:05 2022] PUT /identity/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0/users/7061f35eacae4f2293bb523ef0955906/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:05.854448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.867635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9281-477f-4adc-9c31-af00d641a378 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.917051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:05.927693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.928388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.928909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.929345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.930365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.932098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963b81-1580-4c07-90fe-e43d04e0d5a3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.942686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3460/6909] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:05.947032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:05.959281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2409-092a-48e7-b0e5-f07f3eba12d8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:05.964856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:05.965786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.966045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.966345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] PATH_INFO: `/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0/users/7061f35eacae4f2293bb523ef0955906/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:05.968449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f03c827bcf4207ba1b628ec5e30ea0, user_id=7061f35eacae4f2293bb523ef0955906, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:05.971145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:05.982051 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3450/6910] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:05 2022] PUT /identity/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0/users/7061f35eacae4f2293bb523ef0955906/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:05.992973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:05.993216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:05.993510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.022932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] MFA Rules not processed for user `7061f35eacae4f2293bb523ef0955906`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:06.024441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:06.106256 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3461/6911] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:06.112054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.127707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f0a5-27a9-4234-9ec1-a9925329d17a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.141042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.141748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.142037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.142317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.143697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.145435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.165482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3451/6912] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/domains => generated 277 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:06.169987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.180463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc42a1d-0aab-49c7-9e96-c8267d3acd6d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.248039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.248756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.249044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.249346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.250041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.251960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.276280 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3462/6913] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/groups => generated 279 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:06.280215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.291109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf522-8d0a-41b3-9684-4f41ed11f530 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.297342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.298304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.298666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.299004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.304354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:update_group(group_id=c4a9becdb087479a9447b0c9bfaf4c90)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.305511 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:06.305511 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:06.305511 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:06.306874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.330125 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3452/6914] 10.222.0.39 () {60 vars in 1246 bytes} [Sat Jun 25 21:19:06 2022] PATCH /identity/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90 => generated 291 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:06.332012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.342689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098327e-09c9-4af8-9722-78b010ec4761 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.348944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.349846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.350165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.350441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.355926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:get_group(group_id=c4a9becdb087479a9447b0c9bfaf4c90)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.356984 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:06.356984 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:19:06.356984 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:19:06.358170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.359846 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3463/6915] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:06 2022] GET /identity/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90 => generated 291 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:06.364397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.376068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa423-62f6-4fae-aaf3-aeb140336de0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.381644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.382536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.382822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.383093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.384856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:update_group(group_id=c4a9becdb087479a9447b0c9bfaf4c90)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.386790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.407332 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3453/6916] 10.222.0.39 () {60 vars in 1245 bytes} [Sat Jun 25 21:19:06 2022] PATCH /identity/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90 => generated 307 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:06.412213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.423407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc988-eb5c-43d6-ad79-b11161058952 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.429872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.431563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.432085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.432293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.439300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c4a9becdb087479a9447b0c9bfaf4c90)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.441310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.489244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:06.498750 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3464/6917] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:06 2022] DELETE /identity/v3/groups/c4a9becdb087479a9447b0c9bfaf4c90 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:06.503487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.513829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2c2a-b4a8-45a1-bd0c-51bb7f395209 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.581340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.582297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.582615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.582929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.583641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.585887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.605171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3454/6918] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/groups => generated 327 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:06.609588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.625938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9de4-8a92-4a76-bf75-a07aad0520ca tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.630913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.631607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.631901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.632188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.632931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.634861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.676176 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3465/6919] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/users => generated 321 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:06.677640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.689430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e7f7-7cfc-424a-856f-70dac4526523 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.696115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.696115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.696115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.696526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.718045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=bd19842c2de246018cce956b5969b296)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.721869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.748783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:06.757403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3455/6920] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:19:06 2022] PUT /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:06.762698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.774613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ad223-e7c1-41b2-9ec2-f7d4afb755ec tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.853224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.854018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.854616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.854616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.855345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.857370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.896330 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3466/6921] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/users => generated 321 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:06.900715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.913205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f600-b5e2-40bb-b3c1-6adacfeaabf6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:06.919853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:06.920944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:06.921244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:06.921517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:06.939253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=b412f6756a3c47dab549af1d327be7ae)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:06.941446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:06.978666 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3456/6922] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:19:06 2022] PUT /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:06.982908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:06.994133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1d5-942b-4c8a-bb72-101e06fd0160 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.051550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.052241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.052616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.053022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.053721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.055760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.083402 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3467/6923] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:06 2022] POST /identity/v3/users => generated 323 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:07.087540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.098924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dd9b-7bd5-4d25-b84c-89f3977802e9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.103509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.104415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.104738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.105013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.121413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=66b224ec06784bf7a91e4aa180e17796)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.123398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.148892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3457/6924] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:19:07 2022] PUT /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.154600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.169372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f869e-53ce-43d1-ad17-13170d41dad3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.237256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.238146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.238447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.238716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.240104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.241504 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:07.241504 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:19:07.241504 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:19:07.242745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.244742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:07.265687 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3468/6925] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:19:07 2022] GET /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users => generated 1081 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:07.270202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.281795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c95538-5baf-428c-997e-eaccf09862b7 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.287486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.288443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.288744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.289024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.291014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=bd19842c2de246018cce956b5969b296)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.292066 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:07.292066 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:07.292066 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:07.293301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.309384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3458/6926] 10.222.0.39 () {58 vars in 1341 bytes} [Sat Jun 25 21:19:07 2022] HEAD /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.313621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.324939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d40a4-b302-4dce-8d45-757cf66f2d2d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.330396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.331682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.331964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.332249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.334340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=bd19842c2de246018cce956b5969b296)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.335397 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:07.335397 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:19:07.335397 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:19:07.336624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.346992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.362378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3469/6927] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:19:07 2022] DELETE /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/bd19842c2de246018cce956b5969b296 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.367014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.378387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af65b24-3f44-48b6-86c7-ceedd9fa9bed tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.443594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.444653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.444947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.445230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.447209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=b412f6756a3c47dab549af1d327be7ae)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.449293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.464230 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3459/6928] 10.222.0.39 () {58 vars in 1341 bytes} [Sat Jun 25 21:19:07 2022] HEAD /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:07.468479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.480093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dc56e-9028-4c96-9a6f-760a10bba17c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.485336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.486330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.486600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.486882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.488709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=b412f6756a3c47dab549af1d327be7ae)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.490798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.500411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.520917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3470/6929] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:19:07 2022] DELETE /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/b412f6756a3c47dab549af1d327be7ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.524885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.537714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe52df-f79f-45fd-aba6-2d8003e93da0 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.614219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.615082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.615365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.615652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.617437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=66b224ec06784bf7a91e4aa180e17796)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.619442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.631001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:07.638787 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3460/6930] 10.222.0.39 () {58 vars in 1341 bytes} [Sat Jun 25 21:19:07 2022] HEAD /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.640006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.652592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298a6f-db18-45b4-8c5f-7b62db74da82 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.657646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.658627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.658917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.659196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.661175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00, user_id=66b224ec06784bf7a91e4aa180e17796)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.663080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.672299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.687867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3471/6931] 10.222.0.39 () {58 vars in 1343 bytes} [Sat Jun 25 21:19:07 2022] DELETE /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users/66b224ec06784bf7a91e4aa180e17796 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.692212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.703246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ece0a-ea98-43bd-bd52-97dbba1a3bd9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.763541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.764404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.764728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.764975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.766247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.767263 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:07.767263 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:07.767263 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:07.768558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.787822 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3461/6932] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:19:07 2022] GET /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00/users => generated 145 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:07.792211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.803091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4c46-9209-44ec-b462-4007d974e3bf tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.809339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.810258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.810546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.810827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users/66b224ec06784bf7a91e4aa180e17796` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.812280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_user(user_id=66b224ec06784bf7a91e4aa180e17796)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.814137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:07.869937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.871069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.881493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.894914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.902747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b224ec06784bf7a91e4aa180e17796'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:07.908906 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3472/6933] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:07 2022] DELETE /identity/v3/users/66b224ec06784bf7a91e4aa180e17796 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:07.913341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:07.915152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:07.928030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef637a7-8889-4a9e-bf2b-87af91b92089 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:07.993158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:07.994126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:07.994430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:07.994703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users/b412f6756a3c47dab549af1d327be7ae` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:07.995955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b412f6756a3c47dab549af1d327be7ae)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:07.998046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.043381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.051930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.065509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.066259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.066922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b412f6756a3c47dab549af1d327be7ae'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.081659 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3462/6934] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:07 2022] DELETE /identity/v3/users/b412f6756a3c47dab549af1d327be7ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:08.085983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.096241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddcec8-11c2-4a11-a7f0-df4e50d39da6 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.155371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.156272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.156584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.156858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users/bd19842c2de246018cce956b5969b296` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.158059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bd19842c2de246018cce956b5969b296)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.160004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.161746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:08.208941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.209702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.218755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.231584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.238773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd19842c2de246018cce956b5969b296'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:08.246785 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3473/6935] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:08 2022] DELETE /identity/v3/users/bd19842c2de246018cce956b5969b296 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:08.251226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.253402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:08.269114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd42a1-08e9-4c85-8c8d-ee8d853ba9d8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.282079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:08.333202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.334126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.334414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.334693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.335947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=de7593d6f6754b3f8fef1d5b4b334e00)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.337103 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:08.337103 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:08.337103 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:08.338647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.395260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3463/6936] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:08 2022] DELETE /identity/v3/groups/de7593d6f6754b3f8fef1d5b4b334e00 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:08.404568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.406288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:08.424413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca5e5-a03b-4f9c-b68b-b7f18bf0e724 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.489782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.490539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.490912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.491198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.491911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.494018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.512479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3474/6937] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:08 2022] POST /identity/v3/groups => generated 325 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:08.514768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.527650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849159c-8f77-4c15-a652-09e135f16c8b tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.533643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.534333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.534696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.535105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.535998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.539578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.564543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3464/6938] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:08 2022] POST /identity/v3/groups => generated 326 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:08.565662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.579842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23bea4-1288-437f-adcb-255181d42462 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.585456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.586265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.586556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.586839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.587540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.589506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.608297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3475/6939] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:08 2022] POST /identity/v3/groups => generated 325 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:08.612389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.623162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f36f4-20c8-4b62-91ff-a11aef66808d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.628527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.629245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.629673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.629955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.630682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.631745 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:08.631745 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:08.631745 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:08.633008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.643335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3465/6940] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:19:08 2022] GET /identity/v3/groups => generated 1486 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:08.644594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.655687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80da92-fea5-469c-b67d-ab4427e0f0a3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.666466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.667441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.667706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.667986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/7360cabb8bc24cd6a97c2a18ceb73cce` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.674296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7360cabb8bc24cd6a97c2a18ceb73cce)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.676394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.730496 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3476/6941] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:08 2022] DELETE /identity/v3/groups/7360cabb8bc24cd6a97c2a18ceb73cce => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:08.734829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.745524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259bae2-579d-4b32-aa8a-e6c4f15675cd tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.811388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.812262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.812578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.812862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/2995b73a67604c1f84d48f389e48ffac` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.825229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2995b73a67604c1f84d48f389e48ffac)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.827324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:08.879897 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3466/6942] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:08 2022] DELETE /identity/v3/groups/2995b73a67604c1f84d48f389e48ffac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:08.884224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:08.895949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f320-d3e1-45b6-9af1-a7c4e0e5887d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:08.899885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:08.963476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:08.964379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:08.964707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:08.964995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/4ffdb0b8ee804d5281746e0dd06751d8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:08.970616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4ffdb0b8ee804d5281746e0dd06751d8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:08.973598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.026037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3477/6943] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:08 2022] DELETE /identity/v3/groups/4ffdb0b8ee804d5281746e0dd06751d8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:09.032679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.043840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78b2e0-a220-4144-b647-eb9d438dd94d tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.047666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:09.108241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.108966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.109257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.109539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.110254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.112567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.140278 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3467/6944] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:09 2022] POST /identity/v3/users => generated 323 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:09.144722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.158420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4cbac-cb78-4410-9643-c5c0ec8fedb8 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.163948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.164703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.164994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.165283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.166000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.167970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.183229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3478/6945] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:09 2022] POST /identity/v3/groups => generated 325 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:09.189027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.199565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7135f8-5bfe-49b6-8459-59b6dae544ac tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.204452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.205476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.205767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.206397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/19c81a9f80c24435b4aee4ee18d7dfe3/users/2cf9ae24cf674a7cbc9a56686d0c65c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.227529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=19c81a9f80c24435b4aee4ee18d7dfe3, user_id=2cf9ae24cf674a7cbc9a56686d0c65c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.229706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.252945 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3468/6946] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:19:09 2022] PUT /identity/v3/groups/19c81a9f80c24435b4aee4ee18d7dfe3/users/2cf9ae24cf674a7cbc9a56686d0c65c0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:09.257967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.271748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416d4b-35a1-4365-9d63-4597b07deca3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.340785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.341805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.341805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.342054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.342760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.344763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.366201 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3479/6947] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:09 2022] POST /identity/v3/groups => generated 325 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:09.367746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.379853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420938b-cc62-493a-ae32-ceba96ea640e tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.385137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.386270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.386561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.386870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/2cc4f6c7998e4f128983d435927176ac/users/2cf9ae24cf674a7cbc9a56686d0c65c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.393234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2cc4f6c7998e4f128983d435927176ac, user_id=2cf9ae24cf674a7cbc9a56686d0c65c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.396890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.428161 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3469/6948] 10.222.0.39 () {60 vars in 1359 bytes} [Sat Jun 25 21:19:09 2022] PUT /identity/v3/groups/2cc4f6c7998e4f128983d435927176ac/users/2cf9ae24cf674a7cbc9a56686d0c65c0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:09.432135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.445014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f101-584b-48f1-bacd-528f16cba47c tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.493708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:09.518797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.519705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.520598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.520896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users/2cf9ae24cf674a7cbc9a56686d0c65c0/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.522318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=2cf9ae24cf674a7cbc9a56686d0c65c0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.524520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.541411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3480/6949] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:19:09 2022] GET /identity/v3/users/2cf9ae24cf674a7cbc9a56686d0c65c0/groups => generated 836 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:19:09.545502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.556573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce1f81-f225-4a78-b378-8057a4e549c2 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.564467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.564467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.564840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.564934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/2cc4f6c7998e4f128983d435927176ac` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.574588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2cc4f6c7998e4f128983d435927176ac)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.580475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.645009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3470/6950] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:09 2022] DELETE /identity/v3/groups/2cc4f6c7998e4f128983d435927176ac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:09.649092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.660474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ac3d-8da8-4e34-8d9f-9df2a3bdcb01 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.733446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.734520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.734866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.735228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/groups/19c81a9f80c24435b4aee4ee18d7dfe3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.736696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=19c81a9f80c24435b4aee4ee18d7dfe3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.738596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.787637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3481/6951] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:19:09 2022] DELETE /identity/v3/groups/19c81a9f80c24435b4aee4ee18d7dfe3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:09.791864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.803209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c967fb-c901-4b82-8e5d-e83cc0913527 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.849415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:09.871146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.871838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.872128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.872412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/users/2cf9ae24cf674a7cbc9a56686d0c65c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.873428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.873663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2cf9ae24cf674a7cbc9a56686d0c65c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.875324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:09.875748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.930829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf9ae24cf674a7cbc9a56686d0c65c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:09.939092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf9ae24cf674a7cbc9a56686d0c65c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:09.948960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb1d9d-7168-4641-9cc5-f1cf5b4baaa3 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:09.954072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:09.954931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf9ae24cf674a7cbc9a56686d0c65c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:09.955193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:09.955550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:09.956257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] PATH_INFO: `/v3/users/aef0c4bc94a043568cd015ea22cd5c47` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:09.956367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf9ae24cf674a7cbc9a56686d0c65c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:09.957232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf9ae24cf674a7cbc9a56686d0c65c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:09.957766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef0c4bc94a043568cd015ea22cd5c47)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:09.959917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:09.971739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3471/6952] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:09 2022] DELETE /identity/v3/users/2cf9ae24cf674a7cbc9a56686d0c65c0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:09.977093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:09.978887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.009005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:10.023568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef0c4bc94a043568cd015ea22cd5c47'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.024252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef0c4bc94a043568cd015ea22cd5c47'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.035102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef0c4bc94a043568cd015ea22cd5c47'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.048083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef0c4bc94a043568cd015ea22cd5c47'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.053054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8299-8a13-4ec3-9c31-7177fd04eaf1 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.055523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e592339-f619-4136-951b-c390f82572eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef0c4bc94a043568cd015ea22cd5c47'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.057882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.058768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.059055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.059559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/domains/4465cf0663184190950d2ddb292984a1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.060943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4465cf0663184190950d2ddb292984a1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.062322 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3482/6953] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:09 2022] DELETE /identity/v3/users/aef0c4bc94a043568cd015ea22cd5c47 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:10.062661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.067500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.067789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.068070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.084282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.085077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.091000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:10.092539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.112397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.113053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.115733 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3472/6954] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:19:09 2022] PATCH /identity/v3/domains/4465cf0663184190950d2ddb292984a1 => generated 278 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:10.119634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.120996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.151443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:10.160284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3483/6955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:10.171266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.172691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.188906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c236c-29da-469e-9fda-6d5a79d12070 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.193976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7061f35eacae4f2293bb523ef0955906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f03c827bcf4207ba1b628ec5e30ea0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.194800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.195121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.195402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] PATH_INFO: `/v3/domains/4465cf0663184190950d2ddb292984a1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.207934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4465cf0663184190950d2ddb292984a1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.209870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.233497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.234501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c983d9f-1535-4066-9dda-f4a528adeebc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.237048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4465cf0663184190950d2ddb292984a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.238445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.239148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.239434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.239715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.249793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.251255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.261130 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3484/6956] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:10.287379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.297818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.303892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.316452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] The token cache is being invalidate because project 4465cf0663184190950d2ddb292984a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:10.316845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.317523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.325391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.328607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.329271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4465cf0663184190950d2ddb292984a1', 'request_id': 'req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.335377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3473/6957] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:19:10 2022] DELETE /identity/v3/domains/4465cf0663184190950d2ddb292984a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:10.339677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.341596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.354658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e9173-47a7-4058-ac8d-7fa99cc52262 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.409641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:10.421651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.422600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.423210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.423854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] PATH_INFO: `/v3/users/4cee433140094fb38626dfbfb6b9cfaf` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.425767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cee433140094fb38626dfbfb6b9cfaf)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.427792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.438583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.440832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.460282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ed5d1-0621-4e7a-ba28-b66cd97e8ee9 tempest-GroupsV3TestJSON-1855653957 tempest-GroupsV3TestJSON-1855653957-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.467569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.468533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.468826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.469113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] PATH_INFO: `/v3/projects/00590b74ef7540b0aa39eb02ad92c882` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.470670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00590b74ef7540b0aa39eb02ad92c882)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.472766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.489007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cee433140094fb38626dfbfb6b9cfaf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.489690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cee433140094fb38626dfbfb6b9cfaf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.497074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cee433140094fb38626dfbfb6b9cfaf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.510320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cee433140094fb38626dfbfb6b9cfaf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.517840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-26becf44-0a65-4023-a1e9-1c049b9debf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cee433140094fb38626dfbfb6b9cfaf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.520829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00590b74ef7540b0aa39eb02ad92c882', 'request_id': 'req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.524621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3485/6958] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:10 2022] DELETE /identity/v3/users/4cee433140094fb38626dfbfb6b9cfaf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:10.529294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00590b74ef7540b0aa39eb02ad92c882', 'request_id': 'req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.529446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.529604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.529884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.531367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:10.535770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00590b74ef7540b0aa39eb02ad92c882', 'request_id': 'req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.548509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] The token cache is being invalidate because project 00590b74ef7540b0aa39eb02ad92c882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:10.548801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.548965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:10.549449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5835eb3d-75b1-4182-9ad9-1aeee93a90c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:10.550288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.551017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3474/6959] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:10 2022] DELETE /identity/v3/projects/00590b74ef7540b0aa39eb02ad92c882 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:10.556046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550dcea-0797-4f8f-a371-0009cd051a8b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.556341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550dcea-0797-4f8f-a371-0009cd051a8b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.556690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550dcea-0797-4f8f-a371-0009cd051a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.576413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5550dcea-0797-4f8f-a371-0009cd051a8b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:10.577769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5550dcea-0797-4f8f-a371-0009cd051a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.617624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3486/6960] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:10.627686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.629102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.641059 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3475/6961] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:10.648761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.649047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.649323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.667501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:10.668938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:10.678720 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3476/6962] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:10.682670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.689625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fb36-2e75-4c65-a096-d7feaeb2e5b5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.692059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4095-ed72-4688-88ef-9f2920541434 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.693512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.694170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.694451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.694724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.697611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.698213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.698492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.698772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.699502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:10.699811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.701469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.704043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.705510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.717531 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3477/6963] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:10.717690 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3487/6964] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:19:10.718917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.729682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b1ae-4125-44e9-bd5b-592c2181f133 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.735426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.736101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.736390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.736708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.737436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.739402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.773629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3478/6965] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:10.777822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.790044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81ffd-5748-4928-8a21-5b0eb92fd9a0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.804988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:10.861202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.861984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.862402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.862828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.863851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.865909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.890696 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3488/6966] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:10 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:10.894779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.905353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ac97-40eb-4b6c-b32e-999d7ca7f316 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.910149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.910905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.911186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.911462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.912183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.913875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.924647 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3479/6967] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:10.928705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.939084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f687c74-9df9-41f8-9189-67eefab9631a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.943969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.944685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.944971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.945252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:10.945987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:10.947678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:10.962067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3489/6968] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:10.964701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:10.975206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7df5-8190-42af-a400-18eb090fbd8a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:10.982113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:10.983100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:10.983382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:10.983738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] PATH_INFO: `/v3/projects/bd19405bbffb474e90643b002d7aefe1/users/580b092801584a7799fa0becf3e50811/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.002205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd19405bbffb474e90643b002d7aefe1, user_id=580b092801584a7799fa0becf3e50811, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.004563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.005012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03995b-49b1-4cfa-9aa4-b0e65c9bbc80 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.006640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.025036 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3480/6969] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:10 2022] PUT /identity/v3/projects/bd19405bbffb474e90643b002d7aefe1/users/580b092801584a7799fa0becf3e50811/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:11.032949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738937bf-45a4-4610-b6d6-4881ae9b228c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:11.035895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.036674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.037078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.069390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] MFA Rules not processed for user `580b092801584a7799fa0becf3e50811`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:11.070982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.101929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:11.102812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.103097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.103374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] PATH_INFO: `/v3/projects/e76276ec64c946e38ab97edcf28eaacc` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.105274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76276ec64c946e38ab97edcf28eaacc)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.106524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.132164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:11.135938 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3481/6970] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:11.146879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.159648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76276ec64c946e38ab97edcf28eaacc', 'request_id': 'req-b2caab18-76f0-4b25-b92f-75409e5491c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.168010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76276ec64c946e38ab97edcf28eaacc', 'request_id': 'req-b2caab18-76f0-4b25-b92f-75409e5491c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.173557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76276ec64c946e38ab97edcf28eaacc', 'request_id': 'req-b2caab18-76f0-4b25-b92f-75409e5491c5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.185298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] The token cache is being invalidate because project e76276ec64c946e38ab97edcf28eaacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:11.185585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.186237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.188205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3490/6971] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:11 2022] DELETE /identity/v3/projects/e76276ec64c946e38ab97edcf28eaacc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:11.191945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.193293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.206702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd33be-97af-4c47-b379-c47ec5b108b0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:11.222119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:11.262580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:11.263239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.263526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.263807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.264215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caab18-76f0-4b25-b92f-75409e5491c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:11.265735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.268919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:11.269808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.270249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.270524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] PATH_INFO: `/v3/users/7061f35eacae4f2293bb523ef0955906` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.271736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7061f35eacae4f2293bb523ef0955906)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.273702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.322797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7061f35eacae4f2293bb523ef0955906'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.323443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7061f35eacae4f2293bb523ef0955906'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.328934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.330522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.331517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7061f35eacae4f2293bb523ef0955906'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.341442 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3482/6972] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:11.344338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7061f35eacae4f2293bb523ef0955906'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.351645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7061f35eacae4f2293bb523ef0955906'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.357818 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3491/6973] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:11 2022] DELETE /identity/v3/users/7061f35eacae4f2293bb523ef0955906 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:11.663207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.664820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.675210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.677331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.680446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298914-9742-4aa7-a201-be61e00836a5 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:11.748884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:11.751207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.751615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.751899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] PATH_INFO: `/v3/users/580b092801584a7799fa0becf3e50811` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.752985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db924-b31d-4436-810a-e4ed390479e5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:11.753142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=580b092801584a7799fa0becf3e50811)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.755258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.757639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:11.758515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.758800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.759074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] PATH_INFO: `/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.760276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f03c827bcf4207ba1b628ec5e30ea0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:11.762239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:11.771858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:11.819034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:11.823870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f03c827bcf4207ba1b628ec5e30ea0', 'request_id': 'req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.828170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580b092801584a7799fa0becf3e50811'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.838283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f03c827bcf4207ba1b628ec5e30ea0', 'request_id': 'req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.842322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580b092801584a7799fa0becf3e50811'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.846458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f03c827bcf4207ba1b628ec5e30ea0', 'request_id': 'req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.859800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] The token cache is being invalidate because project 56f03c827bcf4207ba1b628ec5e30ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:11.860195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.861021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7285eb7f-fcd3-457e-8725-ccb6e6e79e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.861385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580b092801584a7799fa0becf3e50811'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.862288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580b092801584a7799fa0becf3e50811'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.863035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-90b59051-575e-4772-94d8-d2845f349e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580b092801584a7799fa0becf3e50811'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:11.863506 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3492/6974] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:11 2022] DELETE /identity/v3/projects/56f03c827bcf4207ba1b628ec5e30ea0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:11.868630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559353f-fc84-46e9-88c1-9a9761e78747 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.868953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559353f-fc84-46e9-88c1-9a9761e78747 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.869261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559353f-fc84-46e9-88c1-9a9761e78747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.879981 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3483/6975] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:11 2022] DELETE /identity/v3/users/580b092801584a7799fa0becf3e50811 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:11.884808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.885206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.885984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.891532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1559353f-fc84-46e9-88c1-9a9761e78747 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:11.892713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1559353f-fc84-46e9-88c1-9a9761e78747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.904911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:11.906364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.958073 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3493/6976] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:11.966872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:11.967513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:11.967513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:11.973053 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3484/6977] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:11.982896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:11.984318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:11.991895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:11.993193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.001603 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3494/6978] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:12.005635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.014668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f55e6-9fbc-4c19-9b2e-7be843f407aa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.019266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.019958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.020250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.020555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.021279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:12.021586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.023203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.035186 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3495/6979] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:19:12.039782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.046158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60469fbf-35a5-4d37-92c8-cbb5c4e0c6ea None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.049534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.049817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09e48-b920-4eed-a65e-8d30b13413af admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.050187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.050476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.050761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.054620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.055257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.055589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.055846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.056573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.058581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.060264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.061760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.072004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3485/6980] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:19:12.088484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3496/6981] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:12.090830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.100683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6789-dbf9-4394-82a7-28cc2a35106f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.132501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.164020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.164742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.165030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.165306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.166037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.168738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.193098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3486/6982] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:12.194462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.206557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1cdd-6c1a-4a52-ba83-e51c1505af64 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.213572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.214265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.214600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.214885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.215670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.217319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.232490 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3497/6983] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:12.233667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.248928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415e96-6597-4438-86c4-de7ae69d155a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.255051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.255792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.256144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.256527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.257348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.258980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d829-6b3e-440f-be43-c6af07077ebf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.269563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3487/6984] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:12.274017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.285031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764f04c-e318-4807-a0ee-fb9c5bbbd470 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.290400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.291360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.291643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.291951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] PATH_INFO: `/v3/projects/9c3574bb40084a0e8d079f9aa4561cc2/users/13bb3d6ef23348219e4fd6f9640c16b0/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.307465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3574bb40084a0e8d079f9aa4561cc2, user_id=13bb3d6ef23348219e4fd6f9640c16b0, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.310179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.326454 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3498/6985] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:12 2022] PUT /identity/v3/projects/9c3574bb40084a0e8d079f9aa4561cc2/users/13bb3d6ef23348219e4fd6f9640c16b0/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:12.337768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.338065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.338345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.359125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.360978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.377130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] MFA Rules not processed for user `13bb3d6ef23348219e4fd6f9640c16b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:12.390981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.448667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.454192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852706b-ee6f-4881-863c-9e2fd86b41dc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.462479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.463504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.463851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.464240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] PATH_INFO: `/v3/projects/bd19405bbffb474e90643b002d7aefe1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.465906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd19405bbffb474e90643b002d7aefe1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.468018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.487651 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3488/6986] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:12.491926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.504370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88fadf-1cec-49d3-a506-291618c760dc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.509400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.510135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.510500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.510967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.511665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.513727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.525611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd19405bbffb474e90643b002d7aefe1', 'request_id': 'req-5bb7e09f-f94b-48c2-a25f-66d16eed363f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:12.534836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd19405bbffb474e90643b002d7aefe1', 'request_id': 'req-5bb7e09f-f94b-48c2-a25f-66d16eed363f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:12.541809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd19405bbffb474e90643b002d7aefe1', 'request_id': 'req-5bb7e09f-f94b-48c2-a25f-66d16eed363f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:12.544241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3489/6987] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:12.548854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.556884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] The token cache is being invalidate because project bd19405bbffb474e90643b002d7aefe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:12.557183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:12.557907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bb7e09f-f94b-48c2-a25f-66d16eed363f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:12.559779 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3499/6988] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:12 2022] DELETE /identity/v3/projects/bd19405bbffb474e90643b002d7aefe1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:12.564298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a6ed-6541-4219-87a4-bdf560bfb5ea None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.564617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a6ed-6541-4219-87a4-bdf560bfb5ea None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.565138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a6ed-6541-4219-87a4-bdf560bfb5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.587323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a995a6ed-6541-4219-87a4-bdf560bfb5ea None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:12.588601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a995a6ed-6541-4219-87a4-bdf560bfb5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.624356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5a68c-7c67-458e-8d85-e1fa51716ce8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.629205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.630138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.630335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.630624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.631339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.634322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.659581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3490/6989] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:12.664517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.667430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.669664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3500/6990] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:12.682573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.683017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.683419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.708002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49669eb-97f2-498a-a982-4f3a36c64265 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.716165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.717318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.717793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.718254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.719508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.722517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.723974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:12.725993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:12.726866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.739671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3501/6991] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:12.743976 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3491/6992] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:12.745598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.750129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.757951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a7c-95c2-4a0b-9c25-085b10d0b5f6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.763303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.764601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.764894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.765176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.765920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:12.766248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.767876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.769901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e39d44-05ec-4718-974a-1594609770bf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.777418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.779023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.779578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.780114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] PATH_INFO: `/v3/projects/2072d831fe47449d804ef3a979ff909d/users/bbe97c289ed647dca1fea7f47eda6ea5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.781878 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3502/6993] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:12.787555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.812105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb9d63-cb02-4966-80db-d275f8c880cd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.820415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.821372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.821715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.822012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.822475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2072d831fe47449d804ef3a979ff909d, user_id=bbe97c289ed647dca1fea7f47eda6ea5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.822718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.825334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.828256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.865028 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3492/6994] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:12 2022] PUT /identity/v3/projects/2072d831fe47449d804ef3a979ff909d/users/bbe97c289ed647dca1fea7f47eda6ea5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:12.868699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.879575 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3503/6995] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:12.883389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.934550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.943837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3850-6f6b-4a86-94b1-e1b36a202e62 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.949682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.950986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.951445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.952036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.952671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.954308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a64bc2-6ca9-4ac6-a571-de503cd0c958 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.954443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.960791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.961859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.962184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.962682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.963570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.966240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:12.966797 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3493/6996] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:12.970518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.981845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398d41-8130-4cbf-a00b-89c54f99ff65 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:12.989168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:12.989557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3504/6997] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:12 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:12.990067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:12.990349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:12.990625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] PATH_INFO: `/v3/projects/2072d831fe47449d804ef3a979ff909d/users/bbe97c289ed647dca1fea7f47eda6ea5/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:12.992937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2072d831fe47449d804ef3a979ff909d, user_id=bbe97c289ed647dca1fea7f47eda6ea5, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:12.993585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:12.995570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b85e-f5fa-4fd6-b686-72eddfdcb73f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.004637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106bc5-4576-48ee-8f00-92072ad26968 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.008411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3494/6998] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:12 2022] PUT /identity/v3/projects/2072d831fe47449d804ef3a979ff909d/users/bbe97c289ed647dca1fea7f47eda6ea5/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:13.018948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.019237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.019651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.047807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] MFA Rules not processed for user `bbe97c289ed647dca1fea7f47eda6ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:13.049766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:13.064717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.065501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.065854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.066221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.067258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.068927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.082685 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3505/6999] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:13.083924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.093848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af589b-850d-4fa4-abd4-c06d3361f2af admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.098646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.099289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.099571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.099846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.100755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.102349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.112264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3506/7000] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:13.116124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.120994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3495/7001] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:13.125275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.126665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fe65-3e59-4b9c-95ce-cc1f53fe34e3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.132091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.133050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.133515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.133656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] PATH_INFO: `/v3/projects/cdc75a1d6aac4165b28f34a927541e70/users/605aef4a67e441279246375bfe0f355a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.134568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7988-846c-4500-ab39-7a062a2c7629 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.140162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.141053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.141350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.141717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.142387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.144006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.151087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc75a1d6aac4165b28f34a927541e70, user_id=605aef4a67e441279246375bfe0f355a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.153973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68194fb5-a97f-4d2d-b728-6ae4e5889b46 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.161139 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3496/7002] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:19:13 2022] POST /identity/v3/domains => generated 274 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:13.165192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.169634 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3507/7003] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:13 2022] PUT /identity/v3/projects/cdc75a1d6aac4165b28f34a927541e70/users/605aef4a67e441279246375bfe0f355a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:13.180096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.180386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.180803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.200896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:13.209308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] MFA Rules not processed for user `605aef4a67e441279246375bfe0f355a`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:13.210553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:13.234365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d181222-b580-4d13-83d3-e59f534ed731 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.276586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3508/7004] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:13.286610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.288316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:13.291191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.291873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.292163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.292471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.293186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.295164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.319481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:13.330466 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3497/7005] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:13 2022] POST /identity/v3/users => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:13.331750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.343902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b677-06a7-474e-a4aa-3e5d695bd9fe tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.348852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.349560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.349846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.350148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.350854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.352777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.353680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ccc73-6faa-4557-9052-1ed2bbf066b0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.357346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.358002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.358287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.358567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.368663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.370106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.378017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3498/7006] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:13 2022] POST /identity/v3/users => generated 324 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:13.379210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3509/7007] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:13.382554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.392986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00542-79cc-47c4-adb3-442a350f7f10 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.397863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.398753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.399037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.399531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users/29410db50abf463bbae09ff0600ca256` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.415388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:get_user(user_id=29410db50abf463bbae09ff0600ca256)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.417743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.419558 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3499/7008] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/users/29410db50abf463bbae09ff0600ca256 => generated 347 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:19:13.424820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.435913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197caa4-bf69-4eac-832c-1b3d28c83b03 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.440765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.441437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.441789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.442095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.442905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Adding query filter params (domain_id=72b006faf4f542f39cb83d34cec03b45) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:13.443213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.445105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.459394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3510/7009] 10.222.0.39 () {58 vars in 1206 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/users?domain_id=72b006faf4f542f39cb83d34cec03b45 => generated 484 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:13.464608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.475273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52274-a9d2-4f26-8a6f-b3bfc61e593e tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.479892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.480608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.480892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.481173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.482045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.484351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.514267 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3500/7010] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/users => generated 8036 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:13.520044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.532526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126408-2a5b-4592-8a1e-07c67a5890a5 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.537326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.538007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.538295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.538573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.539383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Adding query filter params (name=tempest-test_user-454758424) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:13.539692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.541593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.563578 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3511/7011] 10.222.0.39 () {58 vars in 1186 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/users?name=tempest-test_user-454758424 => generated 474 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:13.564987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.575959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529e-98bc-4181-8956-4d64f97487cc tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.581521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.582202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.582715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.582998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.583826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:13.584319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.586300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.608815 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3501/7012] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:19:13 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:13.613893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.624797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6118-7df8-4911-b42c-c1e3ccf806d6 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.630657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.631606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.632058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.632342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users/660f97ddd59b47b2815c4b04cf466b43` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.648220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:delete_user(user_id=660f97ddd59b47b2815c4b04cf466b43)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.650458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.700821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660f97ddd59b47b2815c4b04cf466b43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.701511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660f97ddd59b47b2815c4b04cf466b43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.710858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660f97ddd59b47b2815c4b04cf466b43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.725969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660f97ddd59b47b2815c4b04cf466b43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.733347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660f97ddd59b47b2815c4b04cf466b43'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.740637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3512/7013] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:13 2022] DELETE /identity/v3/users/660f97ddd59b47b2815c4b04cf466b43 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:13.744810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.747119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:13.760403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd09f04-f3a7-47ad-bfbd-e781620d5520 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:13.827099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:13.827099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:13.827500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:13.827759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/users/29410db50abf463bbae09ff0600ca256` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:13.830457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:delete_user(user_id=29410db50abf463bbae09ff0600ca256)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:13.833532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:13.837392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:13.925069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29410db50abf463bbae09ff0600ca256'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.941527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29410db50abf463bbae09ff0600ca256'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.958951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29410db50abf463bbae09ff0600ca256'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.959792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29410db50abf463bbae09ff0600ca256'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.960856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29410db50abf463bbae09ff0600ca256'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:13.975983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3502/7014] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:13 2022] DELETE /identity/v3/users/29410db50abf463bbae09ff0600ca256 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:13.980196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:13.990785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c67034-fb69-4331-845e-73c812aa737c tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:14.059409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:14.060275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:14.060599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:14.060879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/domains/72b006faf4f542f39cb83d34cec03b45` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:14.062285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=72b006faf4f542f39cb83d34cec03b45)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:14.064307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:14.074393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:14.093000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.094234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.130049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.130998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.133966 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3513/7015] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:19:13 2022] PATCH /identity/v3/domains/72b006faf4f542f39cb83d34cec03b45 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:14.138120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:14.140311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:14.155604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0e275-e272-4365-a0f7-e78cba02ce21 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:14.225877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbe97c289ed647dca1fea7f47eda6ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2072d831fe47449d804ef3a979ff909d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:14.226776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:14.227747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:14.228032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] PATH_INFO: `/v3/domains/72b006faf4f542f39cb83d34cec03b45` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:14.243515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=72b006faf4f542f39cb83d34cec03b45)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:14.249176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:14.283528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.287353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '72b006faf4f542f39cb83d34cec03b45'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.356367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.358615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:14.367730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.377139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.395991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] The token cache is being invalidate because project 72b006faf4f542f39cb83d34cec03b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:14.396849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.397561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.417831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.424082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.425007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '72b006faf4f542f39cb83d34cec03b45', 'request_id': 'req-aef323a6-10d5-4e3c-b8a0-822bbbf5076b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.436687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3503/7016] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:19:14 2022] DELETE /identity/v3/domains/72b006faf4f542f39cb83d34cec03b45 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:14.440855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:14.442551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:14.579520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88a4f-3b80-49d6-908c-5b7ac9f5a5f7 tempest-UsersV3TestJSON-153768834 tempest-UsersV3TestJSON-153768834-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:14.673524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:14.674704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:14.675162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:14.675714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] PATH_INFO: `/v3/users/13bb3d6ef23348219e4fd6f9640c16b0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:14.677494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13bb3d6ef23348219e4fd6f9640c16b0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:14.679675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:14.763565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13bb3d6ef23348219e4fd6f9640c16b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.764295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13bb3d6ef23348219e4fd6f9640c16b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.774456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13bb3d6ef23348219e4fd6f9640c16b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.789284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13bb3d6ef23348219e4fd6f9640c16b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.797607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:14.799923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13bb3d6ef23348219e4fd6f9640c16b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:14.822643 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3514/7017] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:14 2022] DELETE /identity/v3/users/13bb3d6ef23348219e4fd6f9640c16b0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:14.826970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:14.827493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:14.827912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:14.853820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:14.855132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:14.944844 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3504/7018] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:14.952094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:14.953811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:15.042957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04957e5f-d4e3-4ea5-b945-da08e40d1acc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:15.048150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:15.049296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:15.049726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:15.050170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:15.066568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:15.068826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:15.084640 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3515/7019] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:15.569097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:15.573353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:15.594870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8fbde-6628-473c-9a7b-f470e892fa88 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:15.612195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:15.613218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:15.613718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:15.614041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] PATH_INFO: `/v3/projects/9c3574bb40084a0e8d079f9aa4561cc2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:15.621596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3574bb40084a0e8d079f9aa4561cc2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:15.623187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:15.758803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3574bb40084a0e8d079f9aa4561cc2', 'request_id': 'req-a645132b-bcf5-452b-9d2c-b0e796db84b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:15.775197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3574bb40084a0e8d079f9aa4561cc2', 'request_id': 'req-a645132b-bcf5-452b-9d2c-b0e796db84b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:15.790954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3574bb40084a0e8d079f9aa4561cc2', 'request_id': 'req-a645132b-bcf5-452b-9d2c-b0e796db84b3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:15.807284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] The token cache is being invalidate because project 9c3574bb40084a0e8d079f9aa4561cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:15.807847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:15.808759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:15.813975 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3505/7020] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:15 2022] DELETE /identity/v3/projects/9c3574bb40084a0e8d079f9aa4561cc2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:15.814800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:15.837759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1f32-31cc-4bd9-adca-88f29690ec1f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:15.919183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:15.920106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:15.920393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:15.920708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] PATH_INFO: `/v3/users/bbe97c289ed647dca1fea7f47eda6ea5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:15.924954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe97c289ed647dca1fea7f47eda6ea5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:15.926988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:16.015352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe97c289ed647dca1fea7f47eda6ea5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.016036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe97c289ed647dca1fea7f47eda6ea5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.037529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe97c289ed647dca1fea7f47eda6ea5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.065616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe97c289ed647dca1fea7f47eda6ea5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.075795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-eed66271-ec3f-44c9-bf09-3eb4c6f24561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe97c289ed647dca1fea7f47eda6ea5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.083998 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3516/7021] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:15 2022] DELETE /identity/v3/users/bbe97c289ed647dca1fea7f47eda6ea5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:16.721802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:16.723869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:16.743353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645132b-bcf5-452b-9d2c-b0e796db84b3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:16.794268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:DELETE=14,keystone:SELECT=84 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:16.820706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:16.821771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:16.822070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:16.822955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] PATH_INFO: `/v3/projects/2072d831fe47449d804ef3a979ff909d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:16.823635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2072d831fe47449d804ef3a979ff909d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:16.826903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:16.884064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2072d831fe47449d804ef3a979ff909d', 'request_id': 'req-792130c2-7620-44b7-bee4-0b12b155bef2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.895584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2072d831fe47449d804ef3a979ff909d', 'request_id': 'req-792130c2-7620-44b7-bee4-0b12b155bef2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.903244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2072d831fe47449d804ef3a979ff909d', 'request_id': 'req-792130c2-7620-44b7-bee4-0b12b155bef2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.918811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] The token cache is being invalidate because project 2072d831fe47449d804ef3a979ff909d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:16.919117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.920458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-792130c2-7620-44b7-bee4-0b12b155bef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:16.925619 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3506/7022] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:16 2022] DELETE /identity/v3/projects/2072d831fe47449d804ef3a979ff909d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:16.927328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:16.927619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:16.927894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:16.950188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:16.951337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:16.968116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:17.068685 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3517/7023] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:17.078030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.078342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.078593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.100360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:17.101636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:17.113658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3507/7024] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:17.114627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.126125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a80045-884a-4993-8a3b-c1735cbb54fa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.132887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.133901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.134536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.134950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.135950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:17.136594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.138437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.156559 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3518/7025] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:19:17.158186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.168204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8d30f-02b7-402c-a478-1314e7ff4ba8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.173281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.173950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.174236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.174520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.175238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.177253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.214458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3508/7026] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:17.218441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.234413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87493c0-ce01-41e8-b96a-6b5c8c100da2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.312613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.313467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.313822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.314170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.314953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.317292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.345453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3519/7027] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:17 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:17.349594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.363844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac87b3-e26a-4218-97d1-d58df55f0f93 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.369556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.370482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.370827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.371316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.372345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.375303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.392026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.400588 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3509/7028] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:17.407262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb10da-313e-4d94-96f8-9772166d8016 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.423731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.424875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.425366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.426110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.427371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.430528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc7b0-87c6-4545-a9d3-b66596d04dbb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.451254 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3520/7029] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:17.453611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.488107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652fe5-3c8d-4351-af65-5546cf039066 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.500567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.502767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.504921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.505334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] PATH_INFO: `/v3/projects/fd757132e87c4baaa35c47040ee48b92/users/efff34139a3b44d893690e480773d368/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.540244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd757132e87c4baaa35c47040ee48b92, user_id=efff34139a3b44d893690e480773d368, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.543191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.599329 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3510/7030] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:17 2022] PUT /identity/v3/projects/fd757132e87c4baaa35c47040ee48b92/users/efff34139a3b44d893690e480773d368/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:17.599942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.600239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.600547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.656949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] MFA Rules not processed for user `efff34139a3b44d893690e480773d368`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:17.658422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:17.805684 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3521/7031] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:17.806897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:17.951635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be505fa-766a-44b6-b2f8-7e6edabff7b0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:17.958514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:17.959475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:17.960240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:17.960361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:17.961280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:17.963462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:17.982259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:18.027111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3511/7032] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:18.032866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.047938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1120-d7a4-42cd-90ff-827fc9b63ef5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.064203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:18.211768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.212732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.213029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.213317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.214143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.218255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.266381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.266931 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3522/7033] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:18 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:18.279580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2783-228a-4cdf-bae5-135e21a0f34d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.287502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.288363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.288754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.289073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.289916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.291802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.309210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3512/7034] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:18.313590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.357200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac0b5-d024-4c4b-90b1-b146899aa3fd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.364110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.365567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.366042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.366522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] PATH_INFO: `/v3/projects/dcf75bd2e832462d9a30fc7730969806/users/fdd0fd2f5d9d40df8ec46925cb6877c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.398510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf75bd2e832462d9a30fc7730969806, user_id=fdd0fd2f5d9d40df8ec46925cb6877c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.403675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.431467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3523/7035] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:18 2022] PUT /identity/v3/projects/dcf75bd2e832462d9a30fc7730969806/users/fdd0fd2f5d9d40df8ec46925cb6877c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:18.437265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.450158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf31f2-0810-401d-909f-5e840f4ea959 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.565002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.565710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.566003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.566277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.567070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.568796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a46d8-f464-4209-9283-e472389b9dce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.582344 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3513/7036] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:18.587869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.601154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8b7b-c334-42e9-a628-2711d01bc9cb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.606114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.607048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.607337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.607622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] PATH_INFO: `/v3/projects/dcf75bd2e832462d9a30fc7730969806/users/fdd0fd2f5d9d40df8ec46925cb6877c6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.609976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf75bd2e832462d9a30fc7730969806, user_id=fdd0fd2f5d9d40df8ec46925cb6877c6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.612707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.630730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3524/7037] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:18 2022] PUT /identity/v3/projects/dcf75bd2e832462d9a30fc7730969806/users/fdd0fd2f5d9d40df8ec46925cb6877c6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:18.645092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.645414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.645695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.679621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] MFA Rules not processed for user `fdd0fd2f5d9d40df8ec46925cb6877c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:18.680951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:18.787256 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3514/7038] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:18.792234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.809960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d3b6-0881-47b8-8329-d6bc4ff2ee8a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.817584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.818288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.818575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.818875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.819758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.821561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.850348 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3525/7039] 10.222.0.39 () {60 vars in 1151 bytes} [Sat Jun 25 21:19:18 2022] POST /identity/v3/services => generated 241 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:18.854774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.866782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a083ff-5468-4219-9760-c5f9eb8cb1e4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.892784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.893987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.894338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.894757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/b199c1f2a6f24f4e8ba95cdd19a7f88b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.895550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b199c1f2a6f24f4e8ba95cdd19a7f88b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.898104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:18.943929 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3515/7040] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:18 2022] DELETE /identity/v3/services/b199c1f2a6f24f4e8ba95cdd19a7f88b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:18.945189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:18.957371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f152-997d-4653-8bfb-90d3f19d07ee tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:18.977967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:18.978685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:18.978975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:18.979442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:18.980593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:18.982324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.000273 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3526/7041] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:18 2022] POST /identity/v3/services => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:19.006314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.024883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cd480-4e60-4e70-b042-b0d054c87fea tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.046862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.048262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.048709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.049120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/9a445ef477794075962c24cf97a3b887` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.050253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:update_service(service_id=9a445ef477794075962c24cf97a3b887)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.051416 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:19.051416 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:19.051416 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:19.052864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.092482 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3516/7042] 10.222.0.39 () {60 vars in 1251 bytes} [Sat Jun 25 21:19:19 2022] PATCH /identity/v3/services/9a445ef477794075962c24cf97a3b887 => generated 283 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:19.098142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.111573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bf2db-6008-4a7b-aa70-ea95f15ff2e3 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.155363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.156254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.156589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.157015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/9a445ef477794075962c24cf97a3b887` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.157685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:get_service(service_id=9a445ef477794075962c24cf97a3b887)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.159067 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:19.159067 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:19:19.159067 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:19:19.160103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.171645 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3527/7043] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services/9a445ef477794075962c24cf97a3b887 => generated 283 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:19.173921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.189766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac716-bfe5-461f-8641-033b153792cb tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.196875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.198603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.198898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.199556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/9a445ef477794075962c24cf97a3b887` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.200382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9a445ef477794075962c24cf97a3b887)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.202680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.204218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:19.234779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3517/7044] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:19 2022] DELETE /identity/v3/services/9a445ef477794075962c24cf97a3b887 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:19.239121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.251923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3ad59-4b68-4183-ab42-90737728ab61 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.296560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.298131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.298589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.299015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/9a445ef477794075962c24cf97a3b887` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.299891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:get_service(service_id=9a445ef477794075962c24cf97a3b887)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.302072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Could not find service: 9a445ef477794075962c24cf97a3b887.: keystone.exception.ServiceNotFound: Could not find service: 9a445ef477794075962c24cf97a3b887. Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 9a445ef477794075962c24cf97a3b887. Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:19:19.321101 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:19:19.322279 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 9a445ef477794075962c24cf97a3b887. Jun 25 21:19:19.323347 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:19:19.326637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3528/7045] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services/9a445ef477794075962c24cf97a3b887 => generated 113 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:19:19.332033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.347033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d526c3-c470-41b9-90a3-eaf479c0bb39 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.356109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.356852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.357782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.358075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.358978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.360048 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:19.360048 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:19.360048 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:19.360999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.385101 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3518/7046] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:19 2022] POST /identity/v3/services => generated 274 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:19.387385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.411308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fad96-4480-4717-841f-ce2c14369426 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.439106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.439872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.440307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.441479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.442665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.447240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.470908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3529/7047] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:19 2022] POST /identity/v3/services => generated 275 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:19.475186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.491850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b4c0c-970c-4372-8583-54ae73e5d607 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.551445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.552151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.552453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.552856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.553501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.555147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.590458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3519/7048] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:19 2022] POST /identity/v3/services => generated 274 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:19.593244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.614599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737664fb-2f33-4431-b652-0396fa5bc0e6 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.644348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.645201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.645562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.645911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.646854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.648211 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:19.648211 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:19:19.648211 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:19:19.649325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.662288 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3530/7049] 10.222.0.39 () {58 vars in 1130 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services => generated 2978 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:19.663593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.681880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a600a3-a9c0-4f4c-abcb-413d7b52ccf1 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.698601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.699357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.699594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.699875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.700644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2122845188) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:19.700952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.701996 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:19:19.701996 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:19:19.701996 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:19:19.702896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.718759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3520/7050] 10.222.0.39 () {58 vars in 1221 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2122845188 => generated 417 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:19.720110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.733998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7698e-52f1-4146-a7dc-ed28f3cfd445 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.741960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.742582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.742878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.743164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.752699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1813976761) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:19.753159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.754921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.767708 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3531/7051] 10.222.0.39 () {58 vars in 1221 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1813976761 => generated 418 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:19.772883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.789977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65c73e-31da-4769-9c5b-f5028eb735fa tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.804754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.805440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.805724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.806003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.806718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-370550314) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:19.807022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.808693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.820008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3521/7052] 10.222.0.39 () {58 vars in 1219 bytes} [Sat Jun 25 21:19:19 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-370550314 => generated 416 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:19.821757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.835241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747556-d930-4da8-b98e-58c2498f3b7d tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.854754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.855714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.856097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.856631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/c6a934dcb5e340abb1df4bcbd2f7f14d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.857310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c6a934dcb5e340abb1df4bcbd2f7f14d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.861639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:19.864626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:19.907886 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3532/7053] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:19 2022] DELETE /identity/v3/services/c6a934dcb5e340abb1df4bcbd2f7f14d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:19.912467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:19.929842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a53a2-b0ae-456e-a98f-67e1b5b45274 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:19.961679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:19.963351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:19.963865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:19.970359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/81ce47fe2aab47ba91ba26c80bf869d4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:19.972930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:delete_service(service_id=81ce47fe2aab47ba91ba26c80bf869d4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:19.974646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:20.034966 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3522/7054] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:19 2022] DELETE /identity/v3/services/81ce47fe2aab47ba91ba26c80bf869d4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:20.039517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:20.058858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd589-3fd5-42e5-b0c7-ddd736020410 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:20.104345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdd0fd2f5d9d40df8ec46925cb6877c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf75bd2e832462d9a30fc7730969806', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:20.105550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:20.105663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:20.105862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] PATH_INFO: `/v3/services/7900efd671ab4d5c9768498315784edd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:20.106535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7900efd671ab4d5c9768498315784edd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:20.108916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232b964-f7fe-4e7f-b7bd-34dc8c9fd7ca tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:20.178381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3533/7055] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:20 2022] DELETE /identity/v3/services/7900efd671ab4d5c9768498315784edd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:20.183589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:20.283904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7173-6b81-4ba8-8317-8f8f6f5f92f0 tempest-ServicesTestJSON-2139216564 tempest-ServicesTestJSON-2139216564-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:20.302859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:20.303546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:20.303931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:20.304273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] PATH_INFO: `/v3/users/efff34139a3b44d893690e480773d368` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:20.305913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efff34139a3b44d893690e480773d368)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:20.308549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:20.381786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:20.392219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efff34139a3b44d893690e480773d368'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:20.410400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efff34139a3b44d893690e480773d368'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:20.438314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efff34139a3b44d893690e480773d368'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:20.441168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efff34139a3b44d893690e480773d368'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:20.441920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efff34139a3b44d893690e480773d368'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:20.461195 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3523/7056] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:20 2022] DELETE /identity/v3/users/efff34139a3b44d893690e480773d368 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:20.462449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:20.462919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:20.463019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:20.502492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:20.503762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:20.611861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3534/7057] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:20.623366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:20.627727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:20.742779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a80b-6748-453b-8fc5-dfa0164c5be7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:20.747036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:20.747675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:20.747966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:20.748245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:20.760705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:20.762668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:20.777749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3524/7058] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:21.318996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:21.320531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:21.342476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cdce0-abfd-49e0-ba1b-98bb50193923 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:21.349072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:21.350235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:21.350610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:21.350976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] PATH_INFO: `/v3/projects/fd757132e87c4baaa35c47040ee48b92` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:21.352290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd757132e87c4baaa35c47040ee48b92)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:21.354458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:21.425214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd757132e87c4baaa35c47040ee48b92', 'request_id': 'req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.434803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd757132e87c4baaa35c47040ee48b92', 'request_id': 'req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.441672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd757132e87c4baaa35c47040ee48b92', 'request_id': 'req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.457878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] The token cache is being invalidate because project fd757132e87c4baaa35c47040ee48b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:21.458191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.458848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.460556 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3535/7059] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:21 2022] DELETE /identity/v3/projects/fd757132e87c4baaa35c47040ee48b92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:21.464774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:21.475390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a61bf2-abfa-4bf0-a3f8-6cd64ed221a0 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:21.538667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:21.539557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:21.539842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:21.540122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] PATH_INFO: `/v3/users/fdd0fd2f5d9d40df8ec46925cb6877c6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:21.541384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd0fd2f5d9d40df8ec46925cb6877c6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:21.543374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:21.602981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd0fd2f5d9d40df8ec46925cb6877c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.612211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd0fd2f5d9d40df8ec46925cb6877c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.613996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:21.637815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd0fd2f5d9d40df8ec46925cb6877c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.639850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd0fd2f5d9d40df8ec46925cb6877c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.640851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b608bb48-ab68-4950-99bc-52a3d34a4b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd0fd2f5d9d40df8ec46925cb6877c6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:21.657852 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3525/7060] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:21 2022] DELETE /identity/v3/users/fdd0fd2f5d9d40df8ec46925cb6877c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:22.326090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:22.328244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:22.354993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a53a7d-54c3-4ddd-8162-d79c0edbaefb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:22.396651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:22.449798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:22.450511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:22.450920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:22.451203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] PATH_INFO: `/v3/projects/dcf75bd2e832462d9a30fc7730969806` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:22.453918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf75bd2e832462d9a30fc7730969806)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:22.456676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:22.537029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf75bd2e832462d9a30fc7730969806', 'request_id': 'req-d3b4addc-b807-4030-a5b9-04efdbe4ecda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:22.554200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf75bd2e832462d9a30fc7730969806', 'request_id': 'req-d3b4addc-b807-4030-a5b9-04efdbe4ecda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:22.566415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf75bd2e832462d9a30fc7730969806', 'request_id': 'req-d3b4addc-b807-4030-a5b9-04efdbe4ecda'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:22.612295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] The token cache is being invalidate because project dcf75bd2e832462d9a30fc7730969806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:22.612637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:22.614636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3b4addc-b807-4030-a5b9-04efdbe4ecda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:22.619283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3536/7061] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:22 2022] DELETE /identity/v3/projects/dcf75bd2e832462d9a30fc7730969806 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:22.626663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:22.628150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:22.628658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:22.679774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:22.681954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:22.825252 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3526/7062] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:22.834240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:22.834882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:22.835311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:22.869883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:22.880635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:22.894860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3537/7063] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:22.899454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:22.911656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889df68-17ff-48ab-9f32-1406ebabaaa0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:22.917030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:22.919255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:22.919255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:22.919255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:22.919558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:22.920123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:22.921609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:22.938721 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3527/7064] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:22.939920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:22.950060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b9ae-442b-4c81-929f-f4c19dd0593e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:22.956474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:22.957224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:22.957515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:22.957961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:22.958722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:22.960819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:22.992455 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3538/7065] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:22 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:22.995354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.010112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c1f8-fd3e-4535-be1d-ee9c62d113ea admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.113342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.114462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.114819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.115167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.116143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.118741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.142636 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3528/7066] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:22 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:23.148000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.162200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f7442-8e6a-4988-8de5-2887139cafc8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.170812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.171537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.171828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.172184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.174033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.175957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.189336 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3539/7067] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:23.194289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.212238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690f6a-49cd-4c06-81f4-036049d5ab97 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.221201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.222042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.222422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.223173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.223884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.225670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753824b-0eb0-4b34-9a61-1cb6a5dda56a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.240041 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3529/7068] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:23.244456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.255475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8313-3d4d-4e6d-b7f8-c17a932f5b26 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.260822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.262257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.262257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.262429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] PATH_INFO: `/v3/projects/9e9d47740f30461bba86f47055b82e17/users/84a5f6243e884cf9b9d347b9a3bc0c6f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.304208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d47740f30461bba86f47055b82e17, user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.307499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.325370 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3540/7069] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:23 2022] PUT /identity/v3/projects/9e9d47740f30461bba86f47055b82e17/users/84a5f6243e884cf9b9d347b9a3bc0c6f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:23.337263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.338370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.339232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.387401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] MFA Rules not processed for user `84a5f6243e884cf9b9d347b9a3bc0c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:23.389184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:23.425258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:23.487992 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3530/7070] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:23.489532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.506197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0edf-8ca3-4abc-b1b8-96d143d2af81 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.515872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.517006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.518613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.518899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.520286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.521702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0270bb-084a-4d9e-94fd-cf8a86c955b9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.602112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:23.629002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3541/7071] 10.222.0.39 () {60 vars in 1313 bytes} [Sat Jun 25 21:19:23 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 788 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:23.633055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.642282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e1dc1-856b-4b04-a2b9-44b952cb0b17 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.647831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.649341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.649341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.649677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/7955ebf8a61841a0a263d2636c28ce62` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.659772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:get_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=7955ebf8a61841a0a263d2636c28ce62)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.661549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:23.663842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3531/7072] 10.222.0.39 () {58 vars in 1391 bytes} [Sat Jun 25 21:19:23 2022] GET /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/7955ebf8a61841a0a263d2636c28ce62 => generated 688 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:23.668516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.668920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.669110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.698301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] MFA Rules not processed for user `84a5f6243e884cf9b9d347b9a3bc0c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:23.699595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:23.950074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:23.951394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3542/7073] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3412 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 25 21:19:23.963377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf8030-ca82-4509-84e0-b2eca0e128d0 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:23.969072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:23.970485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:23.970485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:23.970690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/7955ebf8a61841a0a263d2636c28ce62` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:23.976526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=7955ebf8a61841a0a263d2636c28ce62)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:23.981064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.042103 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3532/7074] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:23 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/7955ebf8a61841a0a263d2636c28ce62 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:24.047594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.060328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd0b5-2d60-4d66-b970-03638d9406a3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.069594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.070755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.071154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.071510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.072499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.074042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.226617 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3543/7075] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:19:24 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 921 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:24.228546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.241381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040259-efd9-4547-9e46-e67df0e352a2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.266178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.267175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.267461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.267734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/2a0fd4752879433790b457d425ec0eb1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.301931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=2a0fd4752879433790b457d425ec0eb1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.303575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.375792 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3533/7076] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:24 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/2a0fd4752879433790b457d425ec0eb1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:24.377146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.396706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099153-572a-4152-832a-88904868428c tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.402796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.404270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.404872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.406363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.407398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.408927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.472020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:24.530162 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3544/7077] 10.222.0.39 () {60 vars in 1314 bytes} [Sat Jun 25 21:19:24 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 812 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:24.534773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.547540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b6547-3197-4e1c-8483-3e157bffc616 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.558243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.559450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.559903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.560593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/0b56995156454ecb9a02d6493d6dd13a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.574042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=0b56995156454ecb9a02d6493d6dd13a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.576359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.662842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3534/7078] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:24 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/0b56995156454ecb9a02d6493d6dd13a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:24.668817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.679802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e267-1baa-45b1-9ddc-8d79b9a011c2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.685005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.686138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.686653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.687491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.707516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.709955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:24.839028 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3545/7079] 10.222.0.39 () {60 vars in 1313 bytes} [Sat Jun 25 21:19:24 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 789 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:24.843911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:24.873598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c546-c418-4ef1-94bb-4d1b660a8b84 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:24.884074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:24.885954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:24.887754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:24.888235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:24.889759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:24.891319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.002253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3535/7080] 10.222.0.39 () {60 vars in 1313 bytes} [Sat Jun 25 21:19:24 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 789 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:25.003123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.014258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4d458-e1b1-4cba-8d62-98785a068ee9 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.019957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.021490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.022014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.022628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.023754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:list_application_credentials(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.026145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.047964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.054058 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3546/7081] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:19:25 2022] GET /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 1502 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:25.059428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb809ed-0c31-458c-89c5-4612e4ba5dc4 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.064246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.069594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.070206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.070636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/eb05a17746c14233ab597d738dda2e4b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.096015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=eb05a17746c14233ab597d738dda2e4b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.097973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.109310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:25.137442 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3536/7082] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:25 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/eb05a17746c14233ab597d738dda2e4b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:25.137989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.149093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb483a5-ec0d-452d-a09e-db41e4f1746e tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.156183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.157472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.157828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.158176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/0e12c3016fb9456fad771d3929b2e837` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.175970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=0e12c3016fb9456fad771d3929b2e837)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.177794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.231456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3547/7083] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:25 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/0e12c3016fb9456fad771d3929b2e837 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:25.232060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.243847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bae2-00a4-45de-98de-135bb8737383 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.254099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.255076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.255384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.255651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.256396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.257678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.357915 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3537/7084] 10.222.0.39 () {60 vars in 1313 bytes} [Sat Jun 25 21:19:25 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 789 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:25.362195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.376745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9038e8-b9f3-4130-83be-c9ab5ac78f77 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.385587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.386615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.386966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.387316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.388279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:create_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.389573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.478106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3548/7085] 10.222.0.39 () {60 vars in 1313 bytes} [Sat Jun 25 21:19:25 2022] POST /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials => generated 788 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:25.479411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.489998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2646005-659e-480d-a403-a0bfac73d590 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.495174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.496084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.496510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.496804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.497575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Adding query filter params (name=tempest-application_credential-693852765) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:25.497946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:list_application_credentials(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.499648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.512046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3538/7086] 10.222.0.39 () {58 vars in 1383 bytes} [Sat Jun 25 21:19:25 2022] GET /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials?name=tempest-application_credential-693852765 => generated 885 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:25.516197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.527184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9145e-028b-444a-a195-0246da461d16 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.534775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.539684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.540062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.540335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/bbd0c951c7c6452a8b2935a11c0d2d77` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.551323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=bbd0c951c7c6452a8b2935a11c0d2d77)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.553144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.555395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:25.581079 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3549/7087] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:25 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/bbd0c951c7c6452a8b2935a11c0d2d77 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:25.585309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.595939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881ba2f-18fa-4d00-b3ce-c9178b76b5af tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.603490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a5f6243e884cf9b9d347b9a3bc0c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9d47740f30461bba86f47055b82e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.605584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.605584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.605815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/d64ce624e4764cbb9b3ced5b7570c5dd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.618637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f, application_credential_id=d64ce624e4764cbb9b3ced5b7570c5dd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.620490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9a39-e8ee-4430-bcf4-f0f8e07023d2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.656524 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3539/7088] 10.222.0.39 () {58 vars in 1394 bytes} [Sat Jun 25 21:19:25 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f/application_credentials/d64ce624e4764cbb9b3ced5b7570c5dd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:25.657611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:25.762396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767777f8-811e-40da-b897-ebfa47543ad2 tempest-ApplicationCredentialsV3Test-65792530 tempest-ApplicationCredentialsV3Test-65792530-project] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:25.767699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:25.768960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:25.769092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:25.769304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] PATH_INFO: `/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:25.770870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a5f6243e884cf9b9d347b9a3bc0c6f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:25.773505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:25.910851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a5f6243e884cf9b9d347b9a3bc0c6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:25.913292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a5f6243e884cf9b9d347b9a3bc0c6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:25.938002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a5f6243e884cf9b9d347b9a3bc0c6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:25.975676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a5f6243e884cf9b9d347b9a3bc0c6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:25.995997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a5f6243e884cf9b9d347b9a3bc0c6f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:26.015394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3550/7089] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:25 2022] DELETE /identity/v3/users/84a5f6243e884cf9b9d347b9a3bc0c6f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:26.020970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01314-19c8-4744-b284-b365c771a19e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:26.021702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01314-19c8-4744-b284-b365c771a19e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:26.021702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01314-19c8-4744-b284-b365c771a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:26.055944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-adc01314-19c8-4744-b284-b365c771a19e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:26.057245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-adc01314-19c8-4744-b284-b365c771a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:26.167930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3540/7090] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:26.194064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:26.195539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:26.311776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c695e-e8b9-4198-ba99-f710a488222f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:26.318774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:26.319825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:26.320299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:26.320848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:26.334019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:26.345154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:26.363295 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3551/7091] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:26.961758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39deec-0165-4aaf-98cc-fc1984a122e3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:26.961758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39deec-0165-4aaf-98cc-fc1984a122e3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:26.961758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39deec-0165-4aaf-98cc-fc1984a122e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.007457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cf39deec-0165-4aaf-98cc-fc1984a122e3 None None] MFA Rules not processed for user `3648405427d14f91a4bb44bd81f2195b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:27.008799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cf39deec-0165-4aaf-98cc-fc1984a122e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.064436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:27.119664 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3541/7092] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:27.149911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.152331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.178586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:27.184756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cedab-7f85-4705-ba3f-60cff23b9df6 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.191491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.193173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.196264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.196868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] PATH_INFO: `/v3/projects/9e9d47740f30461bba86f47055b82e17` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.198951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9d47740f30461bba86f47055b82e17)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.201909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.264775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9d47740f30461bba86f47055b82e17', 'request_id': 'req-1527630a-8ab8-46ac-9c85-11118f7aa5fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:27.275220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9d47740f30461bba86f47055b82e17', 'request_id': 'req-1527630a-8ab8-46ac-9c85-11118f7aa5fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:27.282651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9d47740f30461bba86f47055b82e17', 'request_id': 'req-1527630a-8ab8-46ac-9c85-11118f7aa5fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:27.298958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] The token cache is being invalidate because project 9e9d47740f30461bba86f47055b82e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:27.299253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:27.299911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1527630a-8ab8-46ac-9c85-11118f7aa5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:27.301822 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3552/7093] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:27 2022] DELETE /identity/v3/projects/9e9d47740f30461bba86f47055b82e17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:27.307929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.308459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.308848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.347721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:27.349236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.424763 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3542/7094] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:27.434068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.434380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.434641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.459232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:27.460686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.472207 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3553/7095] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:27.476414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.487903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14a9c-22f6-4e92-a1da-1c0c4764dba3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.493042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.493785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.494141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.494490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.495370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:27.495742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.497522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.502592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.504217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.515480 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3543/7096] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:27.516855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.528476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938770a8-8e09-4edc-b353-f9007bb8175b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.533636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.534521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.534931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.535265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.536551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.538659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.573849 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3544/7097] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:27 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:27.578557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e02f-7d83-4549-995b-2c78edb7a075 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.579000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.656513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231a8ad-cab7-4435-b451-550ae3def6f3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.662901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.663602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.663886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.664163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.664914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.666953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.673503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.674488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.674878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.675265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.677710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.696030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.696840 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3545/7098] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:27 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:27.700963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.701880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.714199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16374-577a-419f-819c-d83f981a5c74 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.715111 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3554/7099] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:19:27.719948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.720767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.721121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.721462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.722298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.724278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.740539 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3546/7100] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:27.742499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.757594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde2271-6d18-4818-81b2-4d8c1779f9f3 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.764255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.765115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.765499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.765880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.767034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.769095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df311-27b4-4b2d-bf6e-8df8ecb57a81 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.785392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3555/7101] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:27.786175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:27.798672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103914d1-6a72-42d5-9f5a-66db31bf0c14 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:27.804952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:27.806445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.807060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.807211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] PATH_INFO: `/v3/projects/3ba9c0896e4547b595af047cf875be51/users/434b24b51e3f4a4e958d3d10249b02a6/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.846307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba9c0896e4547b595af047cf875be51, user_id=434b24b51e3f4a4e958d3d10249b02a6, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:27.855736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:27.870812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:27.887908 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3547/7102] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:27 2022] PUT /identity/v3/projects/3ba9c0896e4547b595af047cf875be51/users/434b24b51e3f4a4e958d3d10249b02a6/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:27.889769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:27.890315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:27.890777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:27.930144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] MFA Rules not processed for user `434b24b51e3f4a4e958d3d10249b02a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:27.931578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:27.946562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:28.033874 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3556/7103] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:28.047458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:28.049424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:28.187508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7098ae-8d3b-4c75-a071-eddf999e1dd2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:28.200845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:28.201566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:28.201850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:28.202137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:28.237695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:28.239227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae2b1-2dc8-424d-a980-2cb58e7dacb6 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:28.263443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3548/7104] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:28.895637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:29.009818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e9174-4141-4a9f-ac46-a66a787ad2fe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:29.016165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:29.017785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.018086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.018686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] PATH_INFO: `/v3/users/434b24b51e3f4a4e958d3d10249b02a6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.020371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=434b24b51e3f4a4e958d3d10249b02a6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:29.022446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:29.107395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434b24b51e3f4a4e958d3d10249b02a6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:29.108703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434b24b51e3f4a4e958d3d10249b02a6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:29.128713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434b24b51e3f4a4e958d3d10249b02a6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:29.151576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434b24b51e3f4a4e958d3d10249b02a6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:29.162029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434b24b51e3f4a4e958d3d10249b02a6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:29.172600 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3557/7105] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:28 2022] DELETE /identity/v3/users/434b24b51e3f4a4e958d3d10249b02a6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:29.174723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f75782-8da7-4e95-b656-841734b74428 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.175016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f75782-8da7-4e95-b656-841734b74428 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.175294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f75782-8da7-4e95-b656-841734b74428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.198322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c9f75782-8da7-4e95-b656-841734b74428 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:29.199705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c9f75782-8da7-4e95-b656-841734b74428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:29.296443 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3549/7106] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:29.337735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:29.339365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:29.460736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:29.498901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043bb65-3288-4aa3-b5b3-1e24c578dc1a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:29.518121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:29.520078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.520364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.523029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.571750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:29.573340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4d3d-bfc4-4b71-878a-fe577b144fae service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:29.606086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3558/7107] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:29.722702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.722702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.723014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.724829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3550/7108] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:19:29.735147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.735462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.735749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.780333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:29.783076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:29.885256 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3559/7109] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:29.921465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:29.923382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:29.960400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6613c2-bc31-459c-af2d-998d83dac55a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:29.974404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:29.976636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:29.977103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:29.977921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:29.994002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:29.996338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3b64b-8831-4cd6-b203-2b1fdf97b7c0 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:30.011109 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3551/7110] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:30.398007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:30.406458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:30.424355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb5904-4555-462b-ab12-65e0ee286471 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:30.429513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:30.430404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:30.430689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:30.430977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] PATH_INFO: `/v3/projects/3ba9c0896e4547b595af047cf875be51` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:30.432190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba9c0896e4547b595af047cf875be51)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:30.434168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:30.505030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba9c0896e4547b595af047cf875be51', 'request_id': 'req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:30.517132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba9c0896e4547b595af047cf875be51', 'request_id': 'req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:30.525710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba9c0896e4547b595af047cf875be51', 'request_id': 'req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:30.548067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] The token cache is being invalidate because project 3ba9c0896e4547b595af047cf875be51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:30.548724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:30.550004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ebc848f9-7aaa-4c9b-b61e-5e1caec7ba00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:30.552118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3560/7111] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:30 2022] DELETE /identity/v3/projects/3ba9c0896e4547b595af047cf875be51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:30.558769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:30.560314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:30.560681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:30.586313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:30.587852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:30.675073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3552/7112] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:30.682727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:30.683282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:30.683735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:30.723189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:30.725808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:30.746346 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3561/7113] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:30.751037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:30.769535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf71e-80a0-40b2-b449-ab588ff9a7e7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:30.784634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:30.785732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:30.786163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:30.786469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:30.787172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:30.787445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:30.789314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:30.803943 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3553/7114] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:30.810502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:30.828778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63970b-42bf-480f-a44a-3fcc9915a899 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:30.834968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:30.836097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:30.836385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:30.836694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:30.837394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:30.839389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:30.894263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3562/7115] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:30 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:30.894639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:30.928345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd90cb-310a-4d25-912f-e2036141eb78 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:30.935737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:31.021694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:31.022981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.023450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.023923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.025311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:31.029528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:31.112782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3554/7116] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:30 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:31.117050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:31.127941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3db35-bd2c-4fed-a6d2-0a467ebd6a00 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:31.134357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:31.135443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.135904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.136186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.136982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:31.138617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:31.157664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3563/7117] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:31.161150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:31.180881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab375b-4abc-48a1-ba10-dc31f76b0510 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:31.197913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:31.199712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.200055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.200340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.201366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:31.203254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1632b-095a-4b2f-8a94-5e8367c945a1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:31.233398 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3555/7118] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:31.238140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:31.255507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26f52-615d-4c51-9032-2b77f5f8005d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:31.269696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:31.270637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.270926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.271206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] PATH_INFO: `/v3/projects/c54af41e2e45468cb048b4e60ffd6b65/users/a7fb8302222a430584c6e9155189f6a9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.281540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:31.312384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54af41e2e45468cb048b4e60ffd6b65, user_id=a7fb8302222a430584c6e9155189f6a9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:31.314391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:31.341109 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3564/7119] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:31 2022] PUT /identity/v3/projects/c54af41e2e45468cb048b4e60ffd6b65/users/a7fb8302222a430584c6e9155189f6a9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:31.351472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.351770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.352405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.400535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] MFA Rules not processed for user `a7fb8302222a430584c6e9155189f6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:31.402748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:31.533644 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3556/7120] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:31.546799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:31.550091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:31.641792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ec3c-ebcd-4ec8-b8ee-e479699e9094 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:31.645940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:31.646612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:31.646897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:31.647176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:31.657411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:31.658938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c1b9d-020e-4ea6-9c16-9702c03cd9bf service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:31.672967 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3565/7121] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:31.928801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:32.019850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd089-0f29-46ed-b19c-0869285d181f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:32.027351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:32.028568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:32.029024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:32.030735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] PATH_INFO: `/v3/users/a7fb8302222a430584c6e9155189f6a9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:32.035968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fb8302222a430584c6e9155189f6a9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:32.038561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:32.070265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:32.118170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fb8302222a430584c6e9155189f6a9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:32.133264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fb8302222a430584c6e9155189f6a9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:32.160876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fb8302222a430584c6e9155189f6a9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:32.161989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fb8302222a430584c6e9155189f6a9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:32.162925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fb8302222a430584c6e9155189f6a9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:32.183915 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3557/7122] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:31 2022] DELETE /identity/v3/users/a7fb8302222a430584c6e9155189f6a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:32.188944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:32.189380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:32.189759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:32.218911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:32.221137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:32.317984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3566/7123] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:32.352503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:32.356185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:32.526894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be027ef2-3290-4d6a-b693-bf7b66ac748b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:32.542022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:32.542212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:32.542809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:32.542809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:32.555886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:32.558542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370dac8-f17c-4a57-a6a5-591ce0979233 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:32.589948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3558/7124] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:34.271664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.273159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:34.286264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06342-006e-4657-abbb-9c37ee664c40 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.292163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.293159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.293687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.294028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] PATH_INFO: `/v3/projects/c54af41e2e45468cb048b4e60ffd6b65` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.296365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54af41e2e45468cb048b4e60ffd6b65)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.298579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.397015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54af41e2e45468cb048b4e60ffd6b65', 'request_id': 'req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:34.415384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54af41e2e45468cb048b4e60ffd6b65', 'request_id': 'req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:34.423220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54af41e2e45468cb048b4e60ffd6b65', 'request_id': 'req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:34.436236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] The token cache is being invalidate because project c54af41e2e45468cb048b4e60ffd6b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:34.436563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:34.437918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ac9b58a1-6115-43b0-84f7-0f6a95d7c0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:34.440661 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3567/7125] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:34 2022] DELETE /identity/v3/projects/c54af41e2e45468cb048b4e60ffd6b65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:34.445929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.446428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.446665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.466773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:34.468079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:34.539841 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3559/7126] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:34.549360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.549656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.549939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.571345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:34.572979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:34.584488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3568/7127] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:34.587151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.599777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403420e4-7f19-4efe-8a19-757746336b1d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.604855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.605807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.606194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.606587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.607467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:34.607862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.609733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.624670 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3560/7128] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:34.629697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.640084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:34.647166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb404-78b5-475e-aba4-74cdd4bc3036 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.653752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.654867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.655320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.655701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.656663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.658791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8935f-bbbb-461f-b7e7-920cda4356cf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.692596 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3569/7129] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:34.693231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.706442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c9fdb-492c-4a7a-a5ae-f4180019feaf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.744769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:34.785253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.786120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.786120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.786378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.787082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.790196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.829026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac57cb-44a3-4b93-abd3-60e0a86c141c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.829333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac57cb-44a3-4b93-abd3-60e0a86c141c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.829613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac57cb-44a3-4b93-abd3-60e0a86c141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.832740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3561/7130] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:34.836890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.848355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be847513-6d96-40da-a9e3-55f6a0d2e536 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.850644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0aac57cb-44a3-4b93-abd3-60e0a86c141c None None] MFA Rules not processed for user `c845f86f1b6244f7a53996329294f2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:34.852139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0aac57cb-44a3-4b93-abd3-60e0a86c141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:34.854319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.855307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.855686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.856198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.857094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.858845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.870444 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3562/7131] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:34.875012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.886904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836cf4-1259-48e3-bf4b-8d338ab6bf73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.892250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.893068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.893448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.893816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.894721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.896467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.909498 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3563/7132] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:34.914591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:34.929405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d97740-a9bf-43fa-a98f-407743e06c9e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:34.934302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:34.935249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.935528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.935829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] PATH_INFO: `/v3/projects/eb99d6583f714483b622f676db16b68a/users/6b51e1555dcc4fa4881c3b7d15c4225d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:34.949129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3570/7133] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:34.958733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb99d6583f714483b622f676db16b68a, user_id=6b51e1555dcc4fa4881c3b7d15c4225d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:34.961855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:34.977464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3564/7134] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:34 2022] PUT /identity/v3/projects/eb99d6583f714483b622f676db16b68a/users/6b51e1555dcc4fa4881c3b7d15c4225d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:34.990068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:34.990363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:34.990645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.047434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] MFA Rules not processed for user `6b51e1555dcc4fa4881c3b7d15c4225d`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:35.048799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:35.171139 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3571/7135] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:35.176803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.270236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256109d-58f9-4e8a-b5d3-50de3ba3672f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.276097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.277006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.277419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.277829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.278674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.281434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.316558 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3565/7136] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:35 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:35.319551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.332972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c75ef-d6a6-439a-ae58-4d854276935e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.410113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.410829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.411150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.411489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.412128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.415341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.456380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:35.476284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3572/7137] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:35 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:35.480646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.492836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23519-3223-4e75-a440-ca1b4c68d8f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.500783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.501836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.502134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.505406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.506356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.508817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.526903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3566/7138] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:35.528057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.543037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a638b3-4ee8-4ca0-86ec-6ffde6e2d974 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.549279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.551021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.556616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.556974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] PATH_INFO: `/v3/projects/b3964947224a43d3aafb6db45c1cb97a/users/920ef10af8c244f78d4692d3b4c53bd2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.576350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3964947224a43d3aafb6db45c1cb97a, user_id=920ef10af8c244f78d4692d3b4c53bd2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.579202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.602156 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3573/7139] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:35 2022] PUT /identity/v3/projects/b3964947224a43d3aafb6db45c1cb97a/users/920ef10af8c244f78d4692d3b4c53bd2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:35.606031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.622332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5011-a9b4-4a5a-b211-4f7b200aeb9e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.718208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:35.749280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.750329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.750881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.751413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.752735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.755061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f5fd-4c99-408e-ba73-2e46915f40fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.767963 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3567/7140] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:35.775033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:35.813259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e801723-98ea-4c33-a430-074ee2194103 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:35.819003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:35.821609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.821956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.824283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] PATH_INFO: `/v3/projects/b3964947224a43d3aafb6db45c1cb97a/users/920ef10af8c244f78d4692d3b4c53bd2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.829489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3964947224a43d3aafb6db45c1cb97a, user_id=920ef10af8c244f78d4692d3b4c53bd2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:35.836205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:35.872510 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3574/7141] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:35 2022] PUT /identity/v3/projects/b3964947224a43d3aafb6db45c1cb97a/users/920ef10af8c244f78d4692d3b4c53bd2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:35.874481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:35.874912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:35.875506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:35.937272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] MFA Rules not processed for user `920ef10af8c244f78d4692d3b4c53bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:35.940145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:36.096593 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3568/7142] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:36.109912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:36.112397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:36.203728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7d49-b1f7-4fcd-8e21-45c30ca24fb4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:36.213781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:36.214599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:36.215490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:36.217191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:36.355043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:36.357580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:36.373567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3575/7143] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:37.030844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:37.032997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:37.145966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba906f-2c4e-4dd6-b31c-5c05e71c5e3e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:37.157528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:37.158551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:37.158914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:37.159423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] PATH_INFO: `/v3/users/605aef4a67e441279246375bfe0f355a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:37.161187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605aef4a67e441279246375bfe0f355a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:37.163261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:37.213144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:37.230881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce648-dd77-4f13-84c1-4edcb209288a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:37.244234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:37.245133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:37.245561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:37.245982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:37.256706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:37.273274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058607a-6fd0-4ecd-9eb9-d4a28f2696e8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:37.274599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605aef4a67e441279246375bfe0f355a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:37.304665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3576/7144] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:37.307946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605aef4a67e441279246375bfe0f355a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:37.320713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:37.323951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605aef4a67e441279246375bfe0f355a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:37.324870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605aef4a67e441279246375bfe0f355a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:37.326072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605aef4a67e441279246375bfe0f355a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:37.349390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3569/7145] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:37 2022] DELETE /identity/v3/users/605aef4a67e441279246375bfe0f355a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:37.354768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:37.356005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:37.357006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:37.383133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:37.385166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:37.508534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3577/7146] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:37.524649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:37.525636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:37.624197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674b8bb-a160-4d97-82b4-76fb70817073 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:37.631084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:37.632491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:37.633065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:37.633775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:37.646783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:37.648793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae623-751d-4a91-91c3-0aae22dfebb5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:37.662228 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3570/7147] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:38.102228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.103713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:38.110819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:38.120550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7a29-c5cc-49b1-8e74-e7ebd783eee5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.132906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.134464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.135114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.135601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] PATH_INFO: `/v3/projects/cdc75a1d6aac4165b28f34a927541e70` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.137258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc75a1d6aac4165b28f34a927541e70)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.139810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.247853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc75a1d6aac4165b28f34a927541e70', 'request_id': 'req-09992609-9515-4ed9-8b40-e16d4ed449e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:38.262164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc75a1d6aac4165b28f34a927541e70', 'request_id': 'req-09992609-9515-4ed9-8b40-e16d4ed449e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:38.268349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc75a1d6aac4165b28f34a927541e70', 'request_id': 'req-09992609-9515-4ed9-8b40-e16d4ed449e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:38.282164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] The token cache is being invalidate because project cdc75a1d6aac4165b28f34a927541e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:38.282466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:38.283311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-09992609-9515-4ed9-8b40-e16d4ed449e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:38.285987 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3578/7148] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:38 2022] DELETE /identity/v3/projects/cdc75a1d6aac4165b28f34a927541e70 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:38.293328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.293908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.294107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.318096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:38.319547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:38.389349 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3571/7149] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:38.489446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.489979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.489979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.513701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:38.515267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:38.524253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3579/7150] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:38.529108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.539688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadd151-579c-445c-b32e-3c32081534a7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.548095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.548821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.549249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.549648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.550397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:38.550719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.552372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.568831 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3572/7151] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:38.571476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.592222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd27ac-93de-4b2b-99b9-74a2e04a6283 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.599135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.600079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.600494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.600849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.601885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.607544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.640521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3580/7152] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:38 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:38.642971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.654334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a7112-5657-473b-942f-8e9f0558bb10 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.729698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.730513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.730830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.731380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.731775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.733802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.773321 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3573/7153] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:38 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:38.774853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.790683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4410a-a51e-4df4-858a-0eede145009b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.796446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.797224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.797583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.797929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.798736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.801514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.813396 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3581/7154] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:38.818199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.828175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:38.833898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5d8bb-e483-4cf9-bd67-39d33b5f8835 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.841202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.842082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.842377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.842663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.843419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.845519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7677a3-9527-4ffb-b777-fa0255a9b827 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.864534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3574/7155] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:38.865131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:38.885294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c992-c245-4685-b09c-8144148dadf2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:38.896264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:38.897333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.897697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.898045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] PATH_INFO: `/v3/projects/5ac318b3c5ba46bca2c42d8094157344/users/9a06f573887c4762ba6c1fd9e787f04d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:38.917821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac318b3c5ba46bca2c42d8094157344, user_id=9a06f573887c4762ba6c1fd9e787f04d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:38.920813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:38.940242 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3582/7156] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:38 2022] PUT /identity/v3/projects/5ac318b3c5ba46bca2c42d8094157344/users/9a06f573887c4762ba6c1fd9e787f04d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:38.952149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289468f9-3242-493d-83f8-f7d9160c04b5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:38.952149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289468f9-3242-493d-83f8-f7d9160c04b5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:38.952149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289468f9-3242-493d-83f8-f7d9160c04b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:39.021715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-289468f9-3242-493d-83f8-f7d9160c04b5 None None] MFA Rules not processed for user `9a06f573887c4762ba6c1fd9e787f04d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:39.023077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-289468f9-3242-493d-83f8-f7d9160c04b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:39.170710 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3575/7157] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:39.190899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:39.193407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:39.285548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1d5e-05f8-4620-b2af-5ea822b6b696 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:39.290293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:39.291386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:39.291897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:39.292374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:39.309576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:39.312298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:39.324290 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3583/7158] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:48.165329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6dd79-8e1c-47f9-affb-c029f8cf32ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:48.166732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6dd79-8e1c-47f9-affb-c029f8cf32ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:48.167482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6dd79-8e1c-47f9-affb-c029f8cf32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:48.192208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d0e6dd79-8e1c-47f9-affb-c029f8cf32ec None None] MFA Rules not processed for user `871c269a6b15425d8b79a6c653c56402`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:48.193705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d0e6dd79-8e1c-47f9-affb-c029f8cf32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:48.304381 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3576/7159] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:49.319024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:49.413291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:49.414953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:49.505521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942adfc-eb64-410e-abf6-79bb17244e84 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:49.523244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:49.524364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:49.524764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:49.525525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] PATH_INFO: `/v3/users/6b51e1555dcc4fa4881c3b7d15c4225d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:49.527497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b51e1555dcc4fa4881c3b7d15c4225d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:49.529600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:49.602417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b51e1555dcc4fa4881c3b7d15c4225d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:49.603645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b51e1555dcc4fa4881c3b7d15c4225d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:49.614792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b51e1555dcc4fa4881c3b7d15c4225d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:49.633584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b51e1555dcc4fa4881c3b7d15c4225d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:49.643533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b51e1555dcc4fa4881c3b7d15c4225d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:49.654512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3584/7160] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:49 2022] DELETE /identity/v3/users/6b51e1555dcc4fa4881c3b7d15c4225d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:49.657172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:49.658238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:49.658790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:49.685952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:49.687567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:49.772691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3577/7161] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:49.814787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:49.827332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:49.894160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:49.895955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:49.918679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17374ee1-fa95-4dd6-935b-2c52e14e9fc5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:49.937915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:49.938823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:49.939103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:49.939376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] PATH_INFO: `/v3/users/9a06f573887c4762ba6c1fd9e787f04d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:49.943917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a06f573887c4762ba6c1fd9e787f04d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:49.965756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:49.977946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010c6b1-86aa-4694-b243-5b44e9416cf2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:49.983114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:49.983934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:49.984551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:49.985302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:50.005059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:50.013933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976178fb-d10d-47a5-aa81-f0b372fee6d3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:50.038637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:50.045729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3585/7162] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:50.111448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a06f573887c4762ba6c1fd9e787f04d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.129822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a06f573887c4762ba6c1fd9e787f04d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.156199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a06f573887c4762ba6c1fd9e787f04d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.157011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a06f573887c4762ba6c1fd9e787f04d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.157655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a06f573887c4762ba6c1fd9e787f04d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.186009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3578/7163] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:49 2022] DELETE /identity/v3/users/9a06f573887c4762ba6c1fd9e787f04d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:19:50.191176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:50.191370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:50.194312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:50.211858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:50.213258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:50.269218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:50.384995 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3586/7164] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:50.401797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:50.404568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:50.558748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a674-c1fd-430a-a7d4-67bb496423b3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:50.564482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:50.565448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:50.565830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:50.566201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:50.580815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:50.583397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:50.590606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:50.592842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:50.609869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3579/7165] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:50.618731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe9e7c-ffaa-4452-9a70-49b43c859601 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:50.632889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:50.633809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:50.634093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:50.634371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] PATH_INFO: `/v3/projects/eb99d6583f714483b622f676db16b68a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:50.635967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb99d6583f714483b622f676db16b68a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:50.637956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:50.749427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb99d6583f714483b622f676db16b68a', 'request_id': 'req-84849314-1619-49d6-9164-25b99b1ce611'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.763775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb99d6583f714483b622f676db16b68a', 'request_id': 'req-84849314-1619-49d6-9164-25b99b1ce611'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.777265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb99d6583f714483b622f676db16b68a', 'request_id': 'req-84849314-1619-49d6-9164-25b99b1ce611'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.803401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] The token cache is being invalidate because project eb99d6583f714483b622f676db16b68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:50.803684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.808240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:50.810184 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3587/7166] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:50 2022] DELETE /identity/v3/projects/eb99d6583f714483b622f676db16b68a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:50.814449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:50.843559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd12-8030-4624-a389-17d3af25af8f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:50.938941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:50.941641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:50.941935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:50.942214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] PATH_INFO: `/v3/users/920ef10af8c244f78d4692d3b4c53bd2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:50.945409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920ef10af8c244f78d4692d3b4c53bd2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:50.949615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:51.039256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:51.040949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.041088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:51.053050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920ef10af8c244f78d4692d3b4c53bd2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.069839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920ef10af8c244f78d4692d3b4c53bd2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.089870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920ef10af8c244f78d4692d3b4c53bd2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.090640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920ef10af8c244f78d4692d3b4c53bd2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.091680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920ef10af8c244f78d4692d3b4c53bd2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.113648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3580/7167] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:50 2022] DELETE /identity/v3/users/920ef10af8c244f78d4692d3b4c53bd2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:51.149996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849314-1619-49d6-9164-25b99b1ce611 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:51.220465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:51.253111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:51.281610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.283406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.283406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.285094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.305233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:51.307073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:51.325512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3588/7168] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:51.510458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:51.513100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.713350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd9a5d-a710-4dde-bab6-0f8a829c5107 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:51.715183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:51.716697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.720977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:51.722355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.722715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.723063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] PATH_INFO: `/v3/projects/5ac318b3c5ba46bca2c42d8094157344` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.725223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac318b3c5ba46bca2c42d8094157344)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:51.727400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:51.737690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d982c-639b-4612-9530-73167e6dab2e service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:51.751144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:51.752053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.752547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.753092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] PATH_INFO: `/v3/projects/b3964947224a43d3aafb6db45c1cb97a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.758046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3964947224a43d3aafb6db45c1cb97a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:51.761792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:51.800056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac318b3c5ba46bca2c42d8094157344', 'request_id': 'req-515254e6-f374-4dad-b644-48c491530eb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.828450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac318b3c5ba46bca2c42d8094157344', 'request_id': 'req-515254e6-f374-4dad-b644-48c491530eb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.835689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac318b3c5ba46bca2c42d8094157344', 'request_id': 'req-515254e6-f374-4dad-b644-48c491530eb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.849504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] The token cache is being invalidate because project 5ac318b3c5ba46bca2c42d8094157344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:51.849813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.850629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-515254e6-f374-4dad-b644-48c491530eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.852653 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3581/7169] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:51 2022] DELETE /identity/v3/projects/5ac318b3c5ba46bca2c42d8094157344 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:51.858686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11a5d-40e5-4273-8808-2b9c9a8e9523 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.859080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11a5d-40e5-4273-8808-2b9c9a8e9523 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.859421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be11a5d-40e5-4273-8808-2b9c9a8e9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.880072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9be11a5d-40e5-4273-8808-2b9c9a8e9523 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:51.881429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9be11a5d-40e5-4273-8808-2b9c9a8e9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.883192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3964947224a43d3aafb6db45c1cb97a', 'request_id': 'req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.897897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3964947224a43d3aafb6db45c1cb97a', 'request_id': 'req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.909026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3964947224a43d3aafb6db45c1cb97a', 'request_id': 'req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.925580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] The token cache is being invalidate because project b3964947224a43d3aafb6db45c1cb97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:51.926030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.926828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-589b345f-aa36-4d57-a77c-5bb61f2e1d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:51.929216 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3589/7170] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:51 2022] DELETE /identity/v3/projects/b3964947224a43d3aafb6db45c1cb97a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:51.934127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a53e8-e894-44e0-bd48-1b4388df3af2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.934630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a53e8-e894-44e0-bd48-1b4388df3af2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.935059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a53e8-e894-44e0-bd48-1b4388df3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.940743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:51.959128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3d6a53e8-e894-44e0-bd48-1b4388df3af2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:51.960786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d6a53e8-e894-44e0-bd48-1b4388df3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:51.972697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3590/7171] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:51.974949 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3582/7172] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:51.980849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.981077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:51.981185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.981423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:51.981620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:51.983074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.011435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:52.012199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:52.013641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:52.014552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:52.039957 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3583/7173] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:52.048760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.049915 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3591/7174] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:52.051045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.070330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3965cf1-c239-4bee-9ca6-893094c55633 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.076005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dae1c1-b3e8-406a-abde-d1da45605167 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.092110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.092381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.093172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.094583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.095517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.095900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.096401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.096806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.097646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:52.097961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.098427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:19:52.100012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.101986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.102583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.132876 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3592/7175] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:52.138822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.148099 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3584/7176] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:19:52.153030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.174361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583edeb8-3ae5-413c-806b-52701e6be9cc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.175345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f54ffb-e210-4fd8-8b3d-18a1008d1d0e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.187171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.191370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.192295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.192898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.194166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.198207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.198877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.199759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.200064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.200382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.201628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.203732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.266583 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3593/7177] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:52.273234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3585/7178] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:52.273452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.275511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.391990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03da9-8404-4831-a78d-8d754601d013 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.406529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.409723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.410794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.412514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.418062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.421694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.436249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b03f61-c49f-43b4-a6fe-e17841b9ffb9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.451322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.452088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.452379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.452674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.453735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.458583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.472923 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3586/7179] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:52.481649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.509239 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3594/7180] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/users => generated 303 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:52.513517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.526330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c31c-8fb3-47f9-8c8b-4df9f940e74e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.527595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:52.536702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3419086-50c3-4ebb-9906-955c624c14ce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.542304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.544871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.545018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.546653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.547447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.552992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.568335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3587/7181] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:52.569231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.572472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:52.573308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.574177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.574632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.575039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.575915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.577731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.617651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3595/7182] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:52.621606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.653258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c189c-04d7-4826-bd16-397bb3979771 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.670966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7b80-cad1-44b6-8f33-aa7e5e125d03 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.675666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.676583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.677045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.677466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.678342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.678484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.679800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.680184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.680589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.680747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.683348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:52.699220 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3596/7183] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:52.700504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.710019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.711764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.722631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074241a-980e-4910-b87c-9999b777f53e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.739994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.740743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.741031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.741313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.742076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.751356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.761070 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3588/7184] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:19:52.762100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.785761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3597/7185] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:52.785973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b950564-299f-416f-84d4-068cb8c97db8 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.789888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:52.826045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.826978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.827259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.827537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] PATH_INFO: `/v3/projects/b68ab381c3604a5a8a81037b72028e5f/users/469e23244299466cb5099e3f0e325032/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.831887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e44634-4c13-4983-8acb-f5a1ae4de4be admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:52.839576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:52.841079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.841382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.841684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] PATH_INFO: `/v3/projects/34d06c8bcffc4174a1619c38f2c5992a/users/9635d766cdb346158fb4aaa774c18c9b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.843770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:52.874588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68ab381c3604a5a8a81037b72028e5f, user_id=469e23244299466cb5099e3f0e325032, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.883976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada8793-99d5-4f36-8246-13109433dff1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.885598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d06c8bcffc4174a1619c38f2c5992a, user_id=9635d766cdb346158fb4aaa774c18c9b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:52.896687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad3c2f-df3a-43a4-a965-1355ccb004fb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:52.940510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3589/7186] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:52 2022] PUT /identity/v3/projects/b68ab381c3604a5a8a81037b72028e5f/users/469e23244299466cb5099e3f0e325032/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:52.951558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.952747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.953105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.975520 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3598/7187] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:52 2022] PUT /identity/v3/projects/34d06c8bcffc4174a1619c38f2c5992a/users/9635d766cdb346158fb4aaa774c18c9b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:52.980840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:52.981136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:52.981419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:52.996320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] MFA Rules not processed for user `469e23244299466cb5099e3f0e325032`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:52.998752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:53.022353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:53.024620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:53.105907 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3590/7188] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:53.123314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.126060 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3599/7189] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:53.144131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61a99-b647-49ce-85fb-41718fa81a56 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.149526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.149976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.150543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.150904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.151355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.152276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.153255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:53.154740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.202041 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3591/7190] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:53 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:53.206646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.283352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5b616-fe3f-470d-8a1a-192e248122b9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.362955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.363328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b600c4-941c-4fa7-8c78-65adb57474ee admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.364416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.365171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.365828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.379430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.380098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.380231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.380408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.380715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.381412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.382916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.386063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.398847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3600/7191] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:19:53.438354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3592/7192] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:53 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:53.439570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.449671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:53.456504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fb4-a326-4ee2-8558-420aeda8709f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.468030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.469620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.471960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.472404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.473597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.477784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.509243 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3601/7193] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:19:53.513097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.528244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62df8-cfaf-44c7-9fac-7fa29efcdec8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.541220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.542000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.542288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.542631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.543307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.545005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd4b08-3774-4103-9d31-6aa7fce926e2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.579213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3593/7194] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:53.580694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:53.595624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eac84-867a-4409-adcf-be09aa689116 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:53.604353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:53.605858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.606332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.606802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] PATH_INFO: `/v3/projects/fcd317d6c4e547bfa203452b0c389832/users/72083755060548538f0cefb0bed886ee/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.632116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd317d6c4e547bfa203452b0c389832, user_id=72083755060548538f0cefb0bed886ee, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:53.636673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:53.671199 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3602/7195] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:53 2022] PUT /identity/v3/projects/fcd317d6c4e547bfa203452b0c389832/users/72083755060548538f0cefb0bed886ee/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:53.757657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:53.758161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:53.758638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:53.797150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] MFA Rules not processed for user `72083755060548538f0cefb0bed886ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:53.799810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:53.868826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:53.970197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3594/7196] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:53.973351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.127842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e0132-3748-4911-82f8-891553b3c738 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.135295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.136099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.136548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.136923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.137736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.139904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.203619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3603/7197] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:53 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:54.208093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.219354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc6b05-4d1c-4b62-9586-c3f0958d855f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.297379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.298934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.298934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.298934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.300186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.302278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.333462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3595/7198] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:54 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:54.337112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.348553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59509c1-31f0-4f9e-99f0-dffb4368e137 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.358720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.359427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.359715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.360008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.360882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.362797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.378546 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3604/7199] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:54.382769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.394797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85b21-df38-4091-84ca-8c236fd8916f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.406080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.407264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.407721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.408146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] PATH_INFO: `/v3/projects/a629f9347a70450faa60eccac77c4787/users/c5dbd7e5c0a9482cb9248e46489ead7b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.439180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a629f9347a70450faa60eccac77c4787, user_id=c5dbd7e5c0a9482cb9248e46489ead7b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.442207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.474924 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3596/7200] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:54 2022] PUT /identity/v3/projects/a629f9347a70450faa60eccac77c4787/users/c5dbd7e5c0a9482cb9248e46489ead7b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:54.478805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.490284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb753-cce5-4508-b456-3673a83174db admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.581940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.582996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.583445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.584357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.585289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.587562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474a0a7-1465-428b-a125-c9d4f5ec5b12 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.603512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3605/7201] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:54.608611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.621863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909c0ed-3ac3-4742-a6e4-75d3d3ca0fe3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.627882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.629327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.629759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.630215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] PATH_INFO: `/v3/projects/a629f9347a70450faa60eccac77c4787/users/c5dbd7e5c0a9482cb9248e46489ead7b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.632454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a629f9347a70450faa60eccac77c4787, user_id=c5dbd7e5c0a9482cb9248e46489ead7b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:54.635517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ded5b-7173-42ca-a77c-8a67c0c994d0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:54.651210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3597/7202] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:54 2022] PUT /identity/v3/projects/a629f9347a70450faa60eccac77c4787/users/c5dbd7e5c0a9482cb9248e46489ead7b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:54.662372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368491-b433-4609-8cf6-05956799190c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.662955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368491-b433-4609-8cf6-05956799190c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.663776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368491-b433-4609-8cf6-05956799190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.726145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0368491-b433-4609-8cf6-05956799190c None None] MFA Rules not processed for user `c5dbd7e5c0a9482cb9248e46489ead7b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:54.728450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0368491-b433-4609-8cf6-05956799190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:54.754689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.755299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.755591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:54.778644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:54.811778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] MFA Rules not processed for user `9635d766cdb346158fb4aaa774c18c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:54.813153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:54.852358 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3606/7203] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:54.862262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368491-b433-4609-8cf6-05956799190c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.865055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0368491-b433-4609-8cf6-05956799190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:54.967072 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3598/7204] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:19:54.971240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368491-b433-4609-8cf6-05956799190c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:54.971624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:54.977139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:54.979236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:54.979570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:54.979890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:54.980669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.080875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4414e74-9ec0-4b5c-b1a1-a511e99f9ee5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.086319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.086932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.087081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.087443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.087854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.088594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.089947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.090675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.104706 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3607/7205] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:19:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:19:55.127492 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3599/7206] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:19:54 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:19:55.128708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:55.142952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfe2dc-66fd-4771-8d00-0335bea67684 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.244509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.245327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.245682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.246034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.246857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.249040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.280618 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3608/7207] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:19:55 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:19:55.283953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:55.300996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb656-c8d6-4cf8-b752-848af7486951 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.306411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.307109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.308974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.308974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.308974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.310721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.329290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3600/7208] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:55.334349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:55.346641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6da42f-25e2-423e-ab9a-fbf95ebd7355 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.352472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.353655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.353798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.354141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] PATH_INFO: `/v3/projects/ce3c52868ad7419c825d481575038432/users/12626a30afbc45b3892001a8ccac70b0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.359142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:55.377361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3c52868ad7419c825d481575038432, user_id=12626a30afbc45b3892001a8ccac70b0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.380797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.396516 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3609/7209] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:55 2022] PUT /identity/v3/projects/ce3c52868ad7419c825d481575038432/users/12626a30afbc45b3892001a8ccac70b0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:55.400174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:55.410774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4011e-2a03-4979-a408-b0abe1a6043a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.502230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.503533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.504094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.504547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.511317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.514760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c1a06-e6e7-40f2-809a-e32a44c8677b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.535501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:55.543996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3601/7210] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:19:55.551192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7558f-bd23-4a72-9529-f758579a3015 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:55.558245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:55.558245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:55.558930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:55.559452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] PATH_INFO: `/v3/projects/ce3c52868ad7419c825d481575038432/users/12626a30afbc45b3892001a8ccac70b0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:55.563214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3c52868ad7419c825d481575038432, user_id=12626a30afbc45b3892001a8ccac70b0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:55.567142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:55.588769 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3610/7211] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:19:55 2022] PUT /identity/v3/projects/ce3c52868ad7419c825d481575038432/users/12626a30afbc45b3892001a8ccac70b0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:57.176442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:57.176851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:57.177268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:57.208121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] MFA Rules not processed for user `12626a30afbc45b3892001a8ccac70b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:19:57.209813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:57.301605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:57.306574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3602/7212] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:19:58.979968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:59.074581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164d3d-6039-4a3b-849e-0598ed6fb4b6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:59.079467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:59.080902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:59.081193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:59.081470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] PATH_INFO: `/v3/users/9635d766cdb346158fb4aaa774c18c9b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:59.082760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9635d766cdb346158fb4aaa774c18c9b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:59.084765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:59.140159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9635d766cdb346158fb4aaa774c18c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.140804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9635d766cdb346158fb4aaa774c18c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.150079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9635d766cdb346158fb4aaa774c18c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.167243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9635d766cdb346158fb4aaa774c18c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.178577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9635d766cdb346158fb4aaa774c18c9b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.189071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3611/7213] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:58 2022] DELETE /identity/v3/users/9635d766cdb346158fb4aaa774c18c9b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:59.446725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:59.458508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be51c-4f95-44ca-b920-d5f655c0c1ae None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:59.537344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:59.538254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:59.538536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:59.538814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] PATH_INFO: `/v3/projects/34d06c8bcffc4174a1619c38f2c5992a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:59.540748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d06c8bcffc4174a1619c38f2c5992a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:59.543238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:59.608556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d06c8bcffc4174a1619c38f2c5992a', 'request_id': 'req-f33f3ea8-9434-43a2-9262-04f9868bb19f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.616701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d06c8bcffc4174a1619c38f2c5992a', 'request_id': 'req-f33f3ea8-9434-43a2-9262-04f9868bb19f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.623254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d06c8bcffc4174a1619c38f2c5992a', 'request_id': 'req-f33f3ea8-9434-43a2-9262-04f9868bb19f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.636304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] The token cache is being invalidate because project 34d06c8bcffc4174a1619c38f2c5992a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:19:59.636304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.637157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.638928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3603/7214] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:19:59 2022] DELETE /identity/v3/projects/34d06c8bcffc4174a1619c38f2c5992a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:19:59.643275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:19:59.644975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:19:59.660391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0fd6-160a-4bc0-a39c-8c05c8f51e9f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:19:59.712866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:59.724928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:19:59.726096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:19:59.727171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:19:59.727714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] PATH_INFO: `/v3/users/12626a30afbc45b3892001a8ccac70b0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:19:59.729494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12626a30afbc45b3892001a8ccac70b0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:19:59.731753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:19:59.802597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12626a30afbc45b3892001a8ccac70b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.803485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12626a30afbc45b3892001a8ccac70b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.814254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12626a30afbc45b3892001a8ccac70b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.831354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12626a30afbc45b3892001a8ccac70b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.838829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3d95985e-3b96-4b58-8390-bd55b9a7b366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12626a30afbc45b3892001a8ccac70b0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:19:59.845555 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3612/7215] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:19:59 2022] DELETE /identity/v3/users/12626a30afbc45b3892001a8ccac70b0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:00.070902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.072435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:00.097951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3ea8-9434-43a2-9262-04f9868bb19f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.186027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.187372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.188028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.188354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] PATH_INFO: `/v3/projects/ce3c52868ad7419c825d481575038432` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.190072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3c52868ad7419c825d481575038432)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.192198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:00.234733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:00.257418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3c52868ad7419c825d481575038432', 'request_id': 'req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:00.266669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3c52868ad7419c825d481575038432', 'request_id': 'req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:00.273618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3c52868ad7419c825d481575038432', 'request_id': 'req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:00.289368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] The token cache is being invalidate because project ce3c52868ad7419c825d481575038432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:00.289885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:00.290765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3d46dbcb-9853-49a2-bcd7-b4a0b535b41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:00.293061 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3604/7216] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:00 2022] DELETE /identity/v3/projects/ce3c52868ad7419c825d481575038432 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:00.298129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.298658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.298903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.320738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:00.322167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:00.413023 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3613/7217] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:00.415830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.416129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.416462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.440390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:00.442749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:00.464128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.472738 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3605/7218] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:00.477724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cfe16-971e-4f2c-bcef-21bc8be243d9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.483456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.484271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.484603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.484923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.486230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:20:00.486230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.487827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:00.509194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.520629 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3614/7219] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:20:00.520823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577361-9a4d-4044-a516-eda4ec1a3950 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.531293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.532221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.534457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.534925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.535790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.540725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:00.616165 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3606/7220] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:00.620552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.637895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9dda2-785f-4c97-a819-91fa638db05e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.787153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:00.813397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.814107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.814395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.814729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.815428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.823206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:00.866227 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3615/7221] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:00 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:00.870641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.894888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3bfc8-3684-4d25-bef2-dd08dd3c14df admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.901340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.902057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.902398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.902685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.903432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.905466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:00.938779 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3607/7222] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:00.942725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:00.960540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe132-30d5-437d-a368-32b6b7263c78 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:00.973127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:00.974419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:00.974706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:00.974988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:00.981906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:00.985107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99d3ee-90f5-444a-bbd4-305cba74d0d1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.018755 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3616/7223] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:01.020229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.043224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d929-aa08-45e2-9e37-406769b2cc13 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.066039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.066983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.067271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.067552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] PATH_INFO: `/v3/projects/4767a1106504455b84fa02a9da1f7576/users/8a382ca2e5a447d8917c352461e70c36/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.095457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4767a1106504455b84fa02a9da1f7576, user_id=8a382ca2e5a447d8917c352461e70c36, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.098998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.131816 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3608/7224] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:01 2022] PUT /identity/v3/projects/4767a1106504455b84fa02a9da1f7576/users/8a382ca2e5a447d8917c352461e70c36/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:01.134635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.135159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.135641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.179546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] MFA Rules not processed for user `8a382ca2e5a447d8917c352461e70c36`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:01.180979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:01.283380 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3617/7225] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:01.285016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.384456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3a415-543d-47ab-89cb-3032f1ec4955 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.392000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.393749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.394231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.394525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.395527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.398846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.446093 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3609/7226] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:01 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:01.448050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.465552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a2cb5-3ab7-4ce1-87e8-3ca7f7194444 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.574396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.575213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.575571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.576023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.576974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.579176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.624106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3618/7227] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:01 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:01.625625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.636955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13289d29-9153-4e6a-9bea-9a5e97fe6d47 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.643950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.644373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.644794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.645143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.645950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.647856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.666830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.678036 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3610/7228] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:01.679274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074f99-5784-4200-84ae-f63e9d4adc5d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.686944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.687946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.688297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.688670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] PATH_INFO: `/v3/projects/b8b758a3575d431eb6fb9f0201ed6577/users/d0e37b36cb6c474aaa1db9ef39a509fd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.709514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b758a3575d431eb6fb9f0201ed6577, user_id=d0e37b36cb6c474aaa1db9ef39a509fd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.712535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.740996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.741579 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3619/7229] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:01 2022] PUT /identity/v3/projects/b8b758a3575d431eb6fb9f0201ed6577/users/d0e37b36cb6c474aaa1db9ef39a509fd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:01.764240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc859-170e-4e7d-bab9-faf40e692f55 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.796367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:01.842501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.843676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.843953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.844224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.844989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.847490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70c24-17aa-4f36-b11d-fc9c324a7fd8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.862586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3611/7230] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:01.867311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:01.880541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd468d2-f142-47dd-9ee9-0cd0515ade45 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:01.886190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:01.887565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.888033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.888650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] PATH_INFO: `/v3/projects/b8b758a3575d431eb6fb9f0201ed6577/users/d0e37b36cb6c474aaa1db9ef39a509fd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.891670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b758a3575d431eb6fb9f0201ed6577, user_id=d0e37b36cb6c474aaa1db9ef39a509fd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:01.894941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:01.907167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3620/7231] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:01 2022] PUT /identity/v3/projects/b8b758a3575d431eb6fb9f0201ed6577/users/d0e37b36cb6c474aaa1db9ef39a509fd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:01.918950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:01.919242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:01.919525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:01.956764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] MFA Rules not processed for user `d0e37b36cb6c474aaa1db9ef39a509fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:01.958328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:02.093893 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3612/7232] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:02.105896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:02.109295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:02.148102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:02.383489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55a195-421b-46eb-b6be-fc3f262ab479 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:02.389798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:02.390511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:02.390800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:02.391082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:02.519683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:02.519683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:02.531101 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3621/7233] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:20:05.502329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:05.503882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:05.589201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9eaf57-bec4-48db-b359-60fc0376ef04 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:05.599185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:05.600135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:05.600452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:05.600759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:05.604279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:05.695870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:05.697544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:05.709562 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3613/7234] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:08.464002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:08.466430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:08.492861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a15a3-2c9f-4e62-9735-8cf1e463265d service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:08.497607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:08.498621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:08.499112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:08.499582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:08.511926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:08.513993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5bfa2-5e88-42b7-b2b6-d4031c3b0317 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:08.528545 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3622/7235] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:10.405463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:10.407276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:10.415378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:10.431405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e7861-6c0a-4f6f-8d7a-9bb0b9e6ddf1 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:10.436753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:10.437426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:10.437747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:10.438032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:10.439975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:10.519889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:10.521402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:10.531295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3614/7236] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:15.653473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f08c-df57-4b67-86d1-0572dcd8e4be None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:15.653949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f08c-df57-4b67-86d1-0572dcd8e4be None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:15.654074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f08c-df57-4b67-86d1-0572dcd8e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:15.680161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-05e4f08c-df57-4b67-86d1-0572dcd8e4be None None] MFA Rules not processed for user `aa2aaa29e0dd479283202bd6575b4c25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:15.681607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05e4f08c-df57-4b67-86d1-0572dcd8e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:15.799843 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3623/7237] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:19.822100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:19.823636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:19.935769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a04a85-acd1-4a43-a034-ef975b291c50 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:19.948684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:19.949839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:19.950127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:19.950422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] PATH_INFO: `/v3/users/469e23244299466cb5099e3f0e325032` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:19.952026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469e23244299466cb5099e3f0e325032)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:19.954400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:20.038485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469e23244299466cb5099e3f0e325032'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:20.051790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469e23244299466cb5099e3f0e325032'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:20.069217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469e23244299466cb5099e3f0e325032'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:20.069976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469e23244299466cb5099e3f0e325032'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:20.070787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469e23244299466cb5099e3f0e325032'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:20.107884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3615/7238] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:19 2022] DELETE /identity/v3/users/469e23244299466cb5099e3f0e325032 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:20.112777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:20.113476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:20.113476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:20.142663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:20.143927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:20.210362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:20.270827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3624/7239] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:20.280854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:20.283531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:20.334218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:20.429407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86691e13-3d8c-4046-bacb-25c27fb362f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:20.438194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:20.438899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:20.439223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:20.439544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:20.451764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:20.453456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:20.466089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3616/7240] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:20.896066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:20.898272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:20.921022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7eb82-73ad-4134-9dd1-81f6afdeea4a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:20.928932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:20.930124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:20.930614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:20.931093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] PATH_INFO: `/v3/projects/b68ab381c3604a5a8a81037b72028e5f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:20.932554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68ab381c3604a5a8a81037b72028e5f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:20.934819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:21.009921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68ab381c3604a5a8a81037b72028e5f', 'request_id': 'req-44a64daf-9ae6-47ed-99c8-d0c867c23e91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.027395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68ab381c3604a5a8a81037b72028e5f', 'request_id': 'req-44a64daf-9ae6-47ed-99c8-d0c867c23e91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.035063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68ab381c3604a5a8a81037b72028e5f', 'request_id': 'req-44a64daf-9ae6-47ed-99c8-d0c867c23e91'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.048140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] The token cache is being invalidate because project b68ab381c3604a5a8a81037b72028e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:21.048480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.049233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.051317 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3625/7241] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:20 2022] DELETE /identity/v3/projects/b68ab381c3604a5a8a81037b72028e5f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:21.055312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:21.066870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b619e-1a57-42b0-937e-47521c882404 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:21.142184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:21.143598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:21.144166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:21.144875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] PATH_INFO: `/v3/users/72083755060548538f0cefb0bed886ee` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:21.146539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72083755060548538f0cefb0bed886ee)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:21.148776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:21.201191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72083755060548538f0cefb0bed886ee'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.212544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72083755060548538f0cefb0bed886ee'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.226195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72083755060548538f0cefb0bed886ee'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.227547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72083755060548538f0cefb0bed886ee'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.228166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72083755060548538f0cefb0bed886ee'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.244896 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3617/7242] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:21 2022] DELETE /identity/v3/users/72083755060548538f0cefb0bed886ee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:21.538592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:21.540341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:21.560312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64daf-9ae6-47ed-99c8-d0c867c23e91 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:21.623178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:21.624101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:21.624383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:21.624756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] PATH_INFO: `/v3/projects/fcd317d6c4e547bfa203452b0c389832` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:21.625948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd317d6c4e547bfa203452b0c389832)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:21.627923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:21.681962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd317d6c4e547bfa203452b0c389832', 'request_id': 'req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.691203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd317d6c4e547bfa203452b0c389832', 'request_id': 'req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.695725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:21.698448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd317d6c4e547bfa203452b0c389832', 'request_id': 'req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.711709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] The token cache is being invalidate because project fcd317d6c4e547bfa203452b0c389832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:21.712000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.712660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.714224 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3626/7243] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:21 2022] DELETE /identity/v3/projects/fcd317d6c4e547bfa203452b0c389832 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:21.718236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:21.719686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:21.734059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166251e3-55e4-4e3c-b332-f0258feb7a81 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:21.777432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:21.802321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:21.803217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:21.803603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:21.804001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] PATH_INFO: `/v3/users/c5dbd7e5c0a9482cb9248e46489ead7b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:21.805641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5dbd7e5c0a9482cb9248e46489ead7b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:21.807572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:21.857035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5dbd7e5c0a9482cb9248e46489ead7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.864713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5dbd7e5c0a9482cb9248e46489ead7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.877405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5dbd7e5c0a9482cb9248e46489ead7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.878031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5dbd7e5c0a9482cb9248e46489ead7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.878622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b1d2e942-5006-42e9-b38e-b0191c585c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5dbd7e5c0a9482cb9248e46489ead7b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:21.891229 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3618/7244] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:21 2022] DELETE /identity/v3/users/c5dbd7e5c0a9482cb9248e46489ead7b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:22.206690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.209437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:22.233159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df7cf3-90b2-44f9-9fc3-aa71153ee843 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.301724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.302690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.303044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.303389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] PATH_INFO: `/v3/projects/a629f9347a70450faa60eccac77c4787` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.304753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a629f9347a70450faa60eccac77c4787)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.307508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.356541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a629f9347a70450faa60eccac77c4787', 'request_id': 'req-474a7ebc-9b07-497b-930d-be80c1b42aab'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:22.364495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a629f9347a70450faa60eccac77c4787', 'request_id': 'req-474a7ebc-9b07-497b-930d-be80c1b42aab'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:22.370101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a629f9347a70450faa60eccac77c4787', 'request_id': 'req-474a7ebc-9b07-497b-930d-be80c1b42aab'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:22.381641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] The token cache is being invalidate because project a629f9347a70450faa60eccac77c4787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:22.381924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:22.382661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-474a7ebc-9b07-497b-930d-be80c1b42aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:22.384462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3627/7245] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:22 2022] DELETE /identity/v3/projects/a629f9347a70450faa60eccac77c4787 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:22.389183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.389672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.389782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.409046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:22.410275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:22.477166 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3619/7246] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:22.485554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.485878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.486261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.515398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:22.516753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:22.526269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3628/7247] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:22.530761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.543580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363eb93-ac59-4c25-a205-04853cfb9fca None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.549789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.550572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.550957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.551332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.552223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:20:22.553157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.554403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.567120 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3620/7248] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:20:22.571903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.582534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997859-8c69-4fff-95e1-049415cfb3ac None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.587783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.588557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.588848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.589124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.589819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.591786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.622633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3629/7249] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:22.628050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.640312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1f430-f314-44b8-a154-d2d972a3d8c9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.699376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:22.719569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.720269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.720742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.721022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.722017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.723954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.744306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3621/7250] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:22.748411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.759480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c367-5a3f-409e-9e50-eeda4f6fc068 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.764300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.765099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.765362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.765663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.766388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.768071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.778659 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3630/7251] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:22.782766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.793037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fc95-aecf-4f37-b865-48cb868146a4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.797908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.798623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.798912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.799189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.799918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.801568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298282df-e901-4ed5-bae8-3566be55d50a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.811920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3622/7252] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:22.816384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:22.827892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e2c1d-0e00-4498-8bef-175ef6b61f2b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:22.833943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:22.834850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.835134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.835414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] PATH_INFO: `/v3/projects/d5cf5dc5bf8345338696d505f92897f5/users/9eb72fb27ff04ba88ac5f14b607b118b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.852683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5cf5dc5bf8345338696d505f92897f5, user_id=9eb72fb27ff04ba88ac5f14b607b118b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:22.856493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:22.872257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3631/7253] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:22 2022] PUT /identity/v3/projects/d5cf5dc5bf8345338696d505f92897f5/users/9eb72fb27ff04ba88ac5f14b607b118b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:22.884383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:22.884725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:22.885008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:22.919003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] MFA Rules not processed for user `9eb72fb27ff04ba88ac5f14b607b118b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:22.920960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:22.995384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3623/7254] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:23.000557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.021766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:23.080139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c23d78-b632-4a66-bb23-43d6f723c504 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.084962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.085642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.085927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.086207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.086901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.088837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.118345 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3632/7255] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:22 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:23.119342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.130295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e12bff-7720-45f2-9edd-c29682c28b07 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.187096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.189333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.189333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.189333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.189333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.191002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.217546 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3624/7256] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:23 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:20:23.218801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.231445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd595e-66f7-475e-9d0e-271204a8e73e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.238190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.238878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.239164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.239454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.240188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.242014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.259307 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3633/7257] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:23.263185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.282957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968522-85d9-42f2-8052-f8afcd8426ac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.288177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.289318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.290464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.290754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] PATH_INFO: `/v3/projects/2f2aabc90f6143f88f339a816a3c56c8/users/1a5ed41e81ac4343ab54db3cea678dd8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.307437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2aabc90f6143f88f339a816a3c56c8, user_id=1a5ed41e81ac4343ab54db3cea678dd8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.310151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.329445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3625/7258] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:23 2022] PUT /identity/v3/projects/2f2aabc90f6143f88f339a816a3c56c8/users/1a5ed41e81ac4343ab54db3cea678dd8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:23.331110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.347148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47c55d-7adf-4e35-8b8a-9b1ce82b7289 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.410137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.410862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.411300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.411742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.412508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.414397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481f762-7743-4818-aca3-a3d3788cbe30 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.430823 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3634/7259] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:20:23.435043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.447006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0a8f-f1f4-4b82-943b-7da6d7420fb9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.453053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.454130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.454412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.455078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] PATH_INFO: `/v3/projects/2f2aabc90f6143f88f339a816a3c56c8/users/1a5ed41e81ac4343ab54db3cea678dd8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.457998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2aabc90f6143f88f339a816a3c56c8, user_id=1a5ed41e81ac4343ab54db3cea678dd8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.461072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.473337 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3626/7260] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:23 2022] PUT /identity/v3/projects/2f2aabc90f6143f88f339a816a3c56c8/users/1a5ed41e81ac4343ab54db3cea678dd8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:23.488067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.488491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.488902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.522019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] MFA Rules not processed for user `1a5ed41e81ac4343ab54db3cea678dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:23.523288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:23.597468 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3635/7261] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:23.608130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:23.610083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:23.621146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:23.670963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806f8d-8d29-4182-9c49-ac722d25bb1b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:23.675010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:23.675654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:23.675935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:23.676175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:23.686554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:23.688054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:23.698215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3627/7262] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:25.305302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:25.321651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3615a5-e5d4-4376-8dcd-a92626b6b28d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:25.325447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:25.326227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:25.326508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:25.326784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:25.336848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:25.391803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:25.393408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bac82-9be7-45e2-98c5-b451662f8208 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:25.402715 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3636/7263] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:26.247097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:26.327431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e128-7559-438f-bd92-863cccf56276 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:26.333457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:26.334444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:26.335315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:26.335315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] PATH_INFO: `/v3/users/9eb72fb27ff04ba88ac5f14b607b118b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:26.336416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb72fb27ff04ba88ac5f14b607b118b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:26.338747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:26.392960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb72fb27ff04ba88ac5f14b607b118b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.403229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb72fb27ff04ba88ac5f14b607b118b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.423293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb72fb27ff04ba88ac5f14b607b118b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.424283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb72fb27ff04ba88ac5f14b607b118b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.425144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb72fb27ff04ba88ac5f14b607b118b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.439526 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3628/7264] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:26 2022] DELETE /identity/v3/users/9eb72fb27ff04ba88ac5f14b607b118b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:26.444754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:26.445235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:26.445235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:26.464898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:26.466301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:26.545045 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3637/7265] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:26.554602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:26.556484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:26.593369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:26.622239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa733040-bc45-447f-bdaf-f6e3d674d740 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:26.627255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:26.627917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:26.628204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:26.628514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:26.638266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:26.639739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618542b3-2643-477b-bb5a-2f7e54c85940 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:26.649665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3629/7266] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:20:26.750017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:26.751655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:26.764507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0cda0-92ce-4fc2-916c-41a6cc64fbca None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:26.769829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:26.770974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:26.771241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:26.771668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] PATH_INFO: `/v3/users/8a382ca2e5a447d8917c352461e70c36` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:26.773103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a382ca2e5a447d8917c352461e70c36)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:26.775080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:26.858231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a382ca2e5a447d8917c352461e70c36'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.859411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a382ca2e5a447d8917c352461e70c36'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.871617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a382ca2e5a447d8917c352461e70c36'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.890443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a382ca2e5a447d8917c352461e70c36'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.900258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a382ca2e5a447d8917c352461e70c36'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:26.910046 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3638/7267] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:26 2022] DELETE /identity/v3/users/8a382ca2e5a447d8917c352461e70c36 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:26.914638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:26.914935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:26.915218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:26.938618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:26.940089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:26.983527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:26.985659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.037436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:27.040997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3630/7268] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:27.056234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:27.057752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.092893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c149-9156-4813-a12c-60f34d59ee4d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.100865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.102026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.102402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.102730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] PATH_INFO: `/v3/projects/d5cf5dc5bf8345338696d505f92897f5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.105417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5cf5dc5bf8345338696d505f92897f5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.107398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.136254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2096e-683d-4207-9551-2ac0cfd81db2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.140296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.140986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.141291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.141547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.151648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.153058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.164812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5cf5dc5bf8345338696d505f92897f5', 'request_id': 'req-e42b16d2-1e46-46ca-84f0-2f9dd238357f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.165612 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3631/7269] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:27.178410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5cf5dc5bf8345338696d505f92897f5', 'request_id': 'req-e42b16d2-1e46-46ca-84f0-2f9dd238357f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.192902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5cf5dc5bf8345338696d505f92897f5', 'request_id': 'req-e42b16d2-1e46-46ca-84f0-2f9dd238357f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.210718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] The token cache is being invalidate because project d5cf5dc5bf8345338696d505f92897f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:27.211021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.211749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.216397 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3639/7270] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:26 2022] DELETE /identity/v3/projects/d5cf5dc5bf8345338696d505f92897f5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:27.217627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:27.229516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140276-dd96-4c5d-a861-13de159cfaff service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.295316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.296403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.296790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.297639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] PATH_INFO: `/v3/users/1a5ed41e81ac4343ab54db3cea678dd8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.298902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5ed41e81ac4343ab54db3cea678dd8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.301073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.325602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:27.377508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5ed41e81ac4343ab54db3cea678dd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.389868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5ed41e81ac4343ab54db3cea678dd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.404393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5ed41e81ac4343ab54db3cea678dd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.405171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5ed41e81ac4343ab54db3cea678dd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.405806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5ed41e81ac4343ab54db3cea678dd8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.419987 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3632/7271] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:27 2022] DELETE /identity/v3/users/1a5ed41e81ac4343ab54db3cea678dd8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:27.514474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:27.516148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.537066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b16d2-1e46-46ca-84f0-2f9dd238357f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.624197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.625440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.625831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.626376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] PATH_INFO: `/v3/projects/4767a1106504455b84fa02a9da1f7576` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.627909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4767a1106504455b84fa02a9da1f7576)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.629982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.680801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4767a1106504455b84fa02a9da1f7576', 'request_id': 'req-19a55cde-53c3-4785-8c44-2f0ec42730cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.685973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:27.691052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4767a1106504455b84fa02a9da1f7576', 'request_id': 'req-19a55cde-53c3-4785-8c44-2f0ec42730cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.700862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4767a1106504455b84fa02a9da1f7576', 'request_id': 'req-19a55cde-53c3-4785-8c44-2f0ec42730cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.715226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] The token cache is being invalidate because project 4767a1106504455b84fa02a9da1f7576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:27.715529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.716213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.717845 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3640/7272] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:27 2022] DELETE /identity/v3/projects/4767a1106504455b84fa02a9da1f7576 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:27.722141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:27.723921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.737702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111659bf-5987-45de-8138-1b280bd44268 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.747214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:27.748861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.810429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.811356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.811710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.812061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] PATH_INFO: `/v3/users/d0e37b36cb6c474aaa1db9ef39a509fd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.813433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e37b36cb6c474aaa1db9ef39a509fd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.815623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.826346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a55cde-53c3-4785-8c44-2f0ec42730cd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:27.832857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:27.833730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.834013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.834293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] PATH_INFO: `/v3/projects/2f2aabc90f6143f88f339a816a3c56c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.835558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2aabc90f6143f88f339a816a3c56c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:27.837528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:27.864956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e37b36cb6c474aaa1db9ef39a509fd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.874522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e37b36cb6c474aaa1db9ef39a509fd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.887311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e37b36cb6c474aaa1db9ef39a509fd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.887963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e37b36cb6c474aaa1db9ef39a509fd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.888617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-20aed02c-d988-477b-a097-b406077e195c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e37b36cb6c474aaa1db9ef39a509fd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.891892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2aabc90f6143f88f339a816a3c56c8', 'request_id': 'req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.900015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2aabc90f6143f88f339a816a3c56c8', 'request_id': 'req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.902180 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3633/7273] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:27 2022] DELETE /identity/v3/users/d0e37b36cb6c474aaa1db9ef39a509fd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:27.909417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2aabc90f6143f88f339a816a3c56c8', 'request_id': 'req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.920896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] The token cache is being invalidate because project 2f2aabc90f6143f88f339a816a3c56c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:27.921379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.922541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11cbb33d-1099-4bdf-ba7b-b2e934fcd2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:27.924248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3641/7274] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:27 2022] DELETE /identity/v3/projects/2f2aabc90f6143f88f339a816a3c56c8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:27.929175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:27.929541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:27.929912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:27.948235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:27.949528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:27.961962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.027944 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3634/7275] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:28.030142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.030877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.031168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.053390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:28.054754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.070408 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3642/7276] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:20:28.071268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.083160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f028378-e90d-404c-899e-98300a1b9463 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.090721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.091403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.091704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.092308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.093330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:20:28.093649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.095425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.112472 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3635/7277] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:20:28.114742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.125192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359716a-20bb-4542-80fb-b0d3c184d4b2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.130220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.130895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.131180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.131467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.132147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.134154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.165925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3643/7278] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:28.167137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.186459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38670a4-e6a9-49e7-acb2-4fa9db6bebb6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.252467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.253540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.253540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.253838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.254603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.256940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.288623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3636/7279] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:28.291391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.306842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.307754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b552512-38e5-4a07-8076-fba607360a66 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.309976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.314243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.315162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.315697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.316235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.317200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.319152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.323414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a2a2-c710-4692-bbcf-9407a066c591 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.329068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.330554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.331167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.333405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] PATH_INFO: `/v3/projects/b8b758a3575d431eb6fb9f0201ed6577` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.334860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b758a3575d431eb6fb9f0201ed6577)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.336765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.353604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3644/7280] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:28.356687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.368532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15c3ee-236b-4f97-8505-72bf7d3689b7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.375066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.375737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.376021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.376301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.377517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.379265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.395232 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3645/7281] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:20:28.396683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.409850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41429-7209-4695-946c-8f7a38dc62d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.414683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b758a3575d431eb6fb9f0201ed6577', 'request_id': 'req-6f704e41-2c19-4523-9497-ec152ecd4199'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:28.423727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b758a3575d431eb6fb9f0201ed6577', 'request_id': 'req-6f704e41-2c19-4523-9497-ec152ecd4199'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:28.432949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.438857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b758a3575d431eb6fb9f0201ed6577', 'request_id': 'req-6f704e41-2c19-4523-9497-ec152ecd4199'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:28.456478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] The token cache is being invalidate because project b8b758a3575d431eb6fb9f0201ed6577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:28.456781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:28.457456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6f704e41-2c19-4523-9497-ec152ecd4199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:28.459758 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3637/7282] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:28 2022] DELETE /identity/v3/projects/b8b758a3575d431eb6fb9f0201ed6577 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:28.465949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54003-3b6f-472a-9f3d-715826a345ad None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.466231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54003-3b6f-472a-9f3d-715826a345ad None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.466513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54003-3b6f-472a-9f3d-715826a345ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.480710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.481707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.481995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.482281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] PATH_INFO: `/v3/projects/2c833571bec448f99dd6aef98714f668/users/a968e34f692142a3bcc5cade9a62be21/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.487476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b5b54003-3b6f-472a-9f3d-715826a345ad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:28.488742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b5b54003-3b6f-472a-9f3d-715826a345ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.502498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c833571bec448f99dd6aef98714f668, user_id=a968e34f692142a3bcc5cade9a62be21, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.505457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44201ab-0a3f-4ae7-b909-87c6599f0661 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.512210 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3638/7283] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:20:28.520327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.520860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.521274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.525027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3646/7284] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:28 2022] PUT /identity/v3/projects/2c833571bec448f99dd6aef98714f668/users/a968e34f692142a3bcc5cade9a62be21/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:28.536055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.536349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.536735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.542677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:28.544178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.549001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.573031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] MFA Rules not processed for user `a968e34f692142a3bcc5cade9a62be21`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:28.574548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.620879 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3639/7285] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:20:28.625148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.636143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5fdf1-9a2b-45e0-9967-07e40ca49ef3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.641310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.642049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.642526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.642991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.643892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:20:28.644466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.646050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.666473 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3647/7286] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:20:28.666708 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3640/7287] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:20:28.667270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.673894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.676324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:28.679208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8295a5c-130c-48ff-ad36-7440618adbfa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.684296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.685324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.685442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.686092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.686794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.688748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.718609 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3648/7288] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:20:28.723037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.753383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a418-dc68-4def-8741-1cd7a285d81d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.803262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5449fc-3939-4849-b757-5daf457e0113 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.809822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.810709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.811003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.811274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.814725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.816108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.821978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.824814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.825105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.825385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.850671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3649/7289] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:28 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:20:28.854527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.867609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.875606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8e0d-d733-4523-ae07-9d4e47b0c169 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.887590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.888724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.889056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.892687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.893563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.895301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.907106 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3650/7290] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:28.911138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.913847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.915596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.922254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e95e4-cd62-41ae-94d6-5382e1b3a87e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.927487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.928367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.928535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.928763 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3641/7291] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:20:28.929013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.929771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.931479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6fbc6-e497-4f7a-be79-fbea4a541f39 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:28.948326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3651/7292] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:28.952928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:28.966940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a446-e625-438b-bfc6-bca43f25271b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:28.972827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:28.973861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:28.974173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:28.974695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] PATH_INFO: `/v3/projects/a1be4fc8c2ab441a866c9a978586757b/users/286c216433364aeb962724d5933ee244/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:28.977387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.993459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1be4fc8c2ab441a866c9a978586757b, user_id=286c216433364aeb962724d5933ee244, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:28.997459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:29.019782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3642/7293] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:28 2022] PUT /identity/v3/projects/a1be4fc8c2ab441a866c9a978586757b/users/286c216433364aeb962724d5933ee244/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:29.030531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6678bd-a777-4b16-b293-66551a99557c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:29.031410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6678bd-a777-4b16-b293-66551a99557c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:29.031877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6678bd-a777-4b16-b293-66551a99557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:29.071345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-df6678bd-a777-4b16-b293-66551a99557c None None] MFA Rules not processed for user `286c216433364aeb962724d5933ee244`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:29.073215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df6678bd-a777-4b16-b293-66551a99557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:29.188753 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3652/7294] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:29.197309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:29.199543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:29.300653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d6ea-f0d2-4330-b462-86e8ddc57c72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:29.304780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:29.305724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:29.306102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:29.306475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:29.316826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:29.319188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:29.331253 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3643/7295] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:39.178999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=41 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:39.325526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:41.986571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:41.987072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:41.987183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:42.068994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:42.070370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:42.166164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3653/7296] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:42.173306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:42.249870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:42.251570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:42.305669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46d8d9-9b3a-4c34-8669-c4f5b0081830 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:42.321427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:42.322357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:42.322635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:42.322914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] PATH_INFO: `/v3/users/286c216433364aeb962724d5933ee244` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:42.324583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286c216433364aeb962724d5933ee244)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:42.327196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:42.426067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405aa20-fb8c-4fe9-bc50-809fa3777324 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:42.440677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:42.441195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:42.443280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:42.443582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:42.447822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286c216433364aeb962724d5933ee244'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:42.455234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:42.457151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730451bb-36f6-4ebf-b2be-874f43abddac service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:42.458997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286c216433364aeb962724d5933ee244'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:42.471251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3654/7297] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:20:42.479441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286c216433364aeb962724d5933ee244'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:42.480210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286c216433364aeb962724d5933ee244'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:42.480927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286c216433364aeb962724d5933ee244'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:42.551457 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3644/7298] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:20:42 2022] DELETE /identity/v3/users/286c216433364aeb962724d5933ee244 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:20:42.556087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:42.556374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:42.557392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:42.595795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:42.597546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:42.700957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:42.744525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3655/7299] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:42.755847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:42.757569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:42.884912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c46787-0765-416b-8029-1e59cf587109 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:42.893416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:42.894675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:42.895134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:42.895509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:42.925340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:42.927972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99425-5620-4103-9be9-4a4bd464ce5f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:42.940944 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3645/7300] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:43.553248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:43.555225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:43.585192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646461d-dc9e-44f9-b801-7a5a5032eaee None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:43.606461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:43.607052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:43.607341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:43.607982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] PATH_INFO: `/v3/projects/a1be4fc8c2ab441a866c9a978586757b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:43.609947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1be4fc8c2ab441a866c9a978586757b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:43.613464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:43.715219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1be4fc8c2ab441a866c9a978586757b', 'request_id': 'req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:43.731245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1be4fc8c2ab441a866c9a978586757b', 'request_id': 'req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:43.754249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1be4fc8c2ab441a866c9a978586757b', 'request_id': 'req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:43.776218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] The token cache is being invalidate because project a1be4fc8c2ab441a866c9a978586757b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:20:43.776942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:43.778401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-db7010eb-1ea9-4ba3-b9a8-4d52a224c451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:20:43.787289 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3656/7301] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:20:43 2022] DELETE /identity/v3/projects/a1be4fc8c2ab441a866c9a978586757b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:43.788891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:43.789361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:43.789446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:43.831094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:43.833104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:43.861883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:43.924471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3646/7302] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:43.930381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:43.930863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:43.931282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:43.952970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:43.954896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:43.971960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3657/7303] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:43.973595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:43.990963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2b33-c81d-4b16-9514-5a82bb88888f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:43.996537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:43.997227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:43.997516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:43.998822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:43.998822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:20:43.999063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.000819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.019335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3647/7304] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:20:44.020517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.031707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4b35-d036-4798-b3bd-73e2f51a56c4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.040238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.041352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.041352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.041647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.042767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.045398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.085025 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3658/7305] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:44 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:44.089090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.103690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28c04-28f1-4268-810c-b8af76e6834d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.186707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.188121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.188992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.189421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.190589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.192835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.227403 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3648/7306] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:44 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:44.231281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.246909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0efc5a-2af3-404b-9413-38915b7bb94b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.273873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.274604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.274892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.275173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.275926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.279744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.302619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3659/7307] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:44.306132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.318985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e693-a930-4ac5-add3-3dfb7388f788 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.324216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.324939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.325231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.325649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.326382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.330371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4d139-2eb9-4b89-b2e8-cf3a558e0621 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.357147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.363458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3649/7308] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:44.372917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d039-14aa-4efb-aa1a-676df6b35beb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.380360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.381239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.382028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.382322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] PATH_INFO: `/v3/projects/0293ee04883e4c2b95776200fa0b5862/users/9ffe5cc15fe246e28cfff1fdb071dff5/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.403916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0293ee04883e4c2b95776200fa0b5862, user_id=9ffe5cc15fe246e28cfff1fdb071dff5, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.406638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.435479 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3660/7309] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:44 2022] PUT /identity/v3/projects/0293ee04883e4c2b95776200fa0b5862/users/9ffe5cc15fe246e28cfff1fdb071dff5/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:44.446619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.446991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.447860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.502380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] MFA Rules not processed for user `9ffe5cc15fe246e28cfff1fdb071dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:44.503691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:44.615144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3650/7310] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:44.616657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.738026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b087ce-1292-445b-abfd-eac83e0026f2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.745760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.747409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.747581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.748049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.749999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.753015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.758338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:44.793392 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3661/7311] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:20:44 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:44.797654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.811940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39778-3cc3-4d1f-afb0-adc38b17d86c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.840991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:44.901949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.903094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.903483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.903920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.905003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.908171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:44.952696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:44.963144 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3651/7312] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:20:44 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:20:44.966108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deab04-27ba-4a70-bc6a-a84bba43b3ca admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:44.974650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:44.975903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:44.976414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:44.977010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:44.978023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:44.980578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:45.001900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:45.010363 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3662/7313] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:45.015920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50620d08-154e-4f02-bfcd-2054c0dae30d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:45.021497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:45.023336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:45.023911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:45.024289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] PATH_INFO: `/v3/projects/237fc8ece20b4b219545d03483d35c62/users/12fd6fb842634d31a397f8de8650bbf6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:45.084753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237fc8ece20b4b219545d03483d35c62, user_id=12fd6fb842634d31a397f8de8650bbf6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:45.088711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:45.118475 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3652/7314] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:45 2022] PUT /identity/v3/projects/237fc8ece20b4b219545d03483d35c62/users/12fd6fb842634d31a397f8de8650bbf6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:45.122486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:45.137574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f30a3-f3c7-48f6-ae2a-45819cea62b8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:45.233140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:45.234167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:45.235472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:45.235948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:45.237119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:45.239344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3bb9-2174-4c2e-9ec0-5dc1e6222ca9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:45.255765 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3663/7315] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:20:45.259315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:45.274835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a538b2-fcb5-4611-90e7-b617c30cbda9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:45.281706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:45.283389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:45.284074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:45.284861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] PATH_INFO: `/v3/projects/237fc8ece20b4b219545d03483d35c62/users/12fd6fb842634d31a397f8de8650bbf6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:45.287303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237fc8ece20b4b219545d03483d35c62, user_id=12fd6fb842634d31a397f8de8650bbf6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:45.290744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:45.311004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3653/7316] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:20:45 2022] PUT /identity/v3/projects/237fc8ece20b4b219545d03483d35c62/users/12fd6fb842634d31a397f8de8650bbf6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:20:45.323640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:45.324238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:45.325045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:45.363406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] MFA Rules not processed for user `12fd6fb842634d31a397f8de8650bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:20:45.365540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:45.495933 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3664/7317] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:20:45.512415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:45.514517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:45.615062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f1f5-e0a3-4433-b193-17b33e9aaf22 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:45.620592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:45.621364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:45.621815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:45.622711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:45.741314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:45.742809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:45.777045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3654/7318] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:50.356410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:50.358845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:50.379650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdea3f-4c6b-4c80-9f81-d928ecad926d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:50.386648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:50.387452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:50.387807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:50.388157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:50.399322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:50.400962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:50.415883 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3665/7319] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:51.541688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:51.553545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20f26d-6d3a-4e8f-90dd-1658964fc162 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:51.569418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:51.570728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:51.571116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:51.571493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:51.577692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:51.619820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:51.665922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:51.668524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcc3ef-8ddf-4afe-a959-fe95772831cf service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:51.681098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3655/7320] 10.222.0.39 () {60 vars in 1396 bytes} [Sat Jun 25 21:20:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:20:56.076634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:20:56.079124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:56.239589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:56.399678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9ab7-6352-4a4f-a6ba-8e162b5b94ac service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:20:56.411410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:20:56.412216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:20:56.413165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:20:56.429180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:20:56.432099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:20:56.592581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:20:56.594304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:20:56.620795 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3666/7321] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:00.689758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:00.690391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:00.690391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:00.723588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] MFA Rules not processed for user `9ffe5cc15fe246e28cfff1fdb071dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:00.725334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:00.741426 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3656/7322] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:01.580235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:01.602615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9d49-2b30-48bf-b67f-cc84d39acdf0 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:01.622030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:01.622714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:01.623003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:01.623282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:01.626308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:01.658932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:01.660612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb8e5b-bf7b-4d04-aecf-18e209838e3c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:01.703428 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3667/7323] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:08.428175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:08.445142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170ea61-dc4a-498a-bb13-64b74ad2a068 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:08.451028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:08.452999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:08.455449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:08.455955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:08.463342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:08.501833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:08.503516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:08.524348 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3657/7324] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:11.668417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=46 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:13.417126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:13.417811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:13.417811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:13.473163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:13.474443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:13.575868 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3668/7325] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:13.588921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:13.590963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:13.690919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dd1-7c79-442d-93e9-e00074f5c37a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:13.700944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:13.701635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:13.701912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:13.702189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:13.745060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:13.746884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:13.769748 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3658/7326] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:21:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:18.238350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:18.263980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0d78-d57e-4989-9a24-443cd7930142 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:18.269452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:18.270787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:18.271470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:18.278536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:18.281554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:18.462111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:18.467135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:18.494570 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3669/7327] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:23.764414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=58 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:27.166818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:27.169571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:27.258935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dc9c9-9d74-4d2c-b198-28f5892e18b1 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:27.264631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:27.265408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:27.265822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:27.266188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:27.268101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:27.286826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:27.288946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:27.304227 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3659/7328] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:27.326856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:27.328629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:27.343870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1e6a2-3a1a-433c-aabc-fe8cf9bc1fab service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:27.349135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:27.350194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:27.350577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:27.351238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] PATH_INFO: `/v3/users/3648405427d14f91a4bb44bd81f2195b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:27.352982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3648405427d14f91a4bb44bd81f2195b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:27.355926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:27.433206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3648405427d14f91a4bb44bd81f2195b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:27.434350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3648405427d14f91a4bb44bd81f2195b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:27.469878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3648405427d14f91a4bb44bd81f2195b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:27.499549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3648405427d14f91a4bb44bd81f2195b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:27.524243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5584a273-dbf7-405d-9576-ab6212058409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3648405427d14f91a4bb44bd81f2195b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:27.533258 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3670/7329] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:27 2022] DELETE /identity/v3/users/3648405427d14f91a4bb44bd81f2195b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:27.971525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:27.990388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d452792-85da-4947-87ad-5a24e4870dd0 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.104295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.105228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.105511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.105790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] PATH_INFO: `/v3/projects/d32f25e6afd2425db488a9387869da19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.108312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32f25e6afd2425db488a9387869da19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.110325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.174332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32f25e6afd2425db488a9387869da19', 'request_id': 'req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:28.188213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32f25e6afd2425db488a9387869da19', 'request_id': 'req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:28.218754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32f25e6afd2425db488a9387869da19', 'request_id': 'req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:28.236129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] The token cache is being invalidate because project d32f25e6afd2425db488a9387869da19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:28.237099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:28.237849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37f92a1f-54dc-4b6d-9aab-594e60b48cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:28.239852 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3660/7330] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:27 2022] DELETE /identity/v3/projects/d32f25e6afd2425db488a9387869da19 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:28.245262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.245652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.246013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.269040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:28.271142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:28.277947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:28.359100 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3671/7331] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:28.367902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.368191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.368699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.393099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:28.395121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:28.404211 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3661/7332] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:28.409677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.420202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c085dc-c212-4f37-a116-ae8d7ec5fdcf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.425671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.426369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.426649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.426922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.427951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:28.428351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.430106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.447029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3672/7333] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:28.453334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.466240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92d5d-fda5-4405-aeaa-f8077ddcaa0f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.493310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.494307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.494796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.495146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.498127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.501804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.523345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:28.562131 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3662/7334] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:28 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:28.566619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.578130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0d54-d9aa-415f-98b8-d81cf3581b03 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.667369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.668233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.668564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.668858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.669637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.672781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.709562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.710320 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3673/7335] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:28 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:28.721117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf01c-870a-4971-aa4b-85c3c136f23d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.730385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.731029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.731370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.731595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.733318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.736043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.751545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3663/7336] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:28.753380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.772844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a2cb-b385-4312-9cd9-8f328cdf6b39 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.782714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.783763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.784253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.784754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.788594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.791168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a0657-518b-4e54-9944-47a043048942 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.831596 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3674/7337] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:28.835506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:28.852234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2296f03-c3a5-4d20-9126-f4daab73d268 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:28.863031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:28.864536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.864813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.865173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] PATH_INFO: `/v3/projects/5f75c45713fc4e92ad67006618affaed/users/ac9837e4f56e425f98876f480392245c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.882874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f75c45713fc4e92ad67006618affaed, user_id=ac9837e4f56e425f98876f480392245c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:28.885991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:28.908529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3664/7338] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:28 2022] PUT /identity/v3/projects/5f75c45713fc4e92ad67006618affaed/users/ac9837e4f56e425f98876f480392245c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:28.916904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:28.917340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:28.917739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:28.950040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] MFA Rules not processed for user `ac9837e4f56e425f98876f480392245c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:28.951365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:29.040778 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3675/7339] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:21:29.043485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.116854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c511c8b-1a47-40bc-ac2a-3b7ec89b70d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.122173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.123216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.123702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.124055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.124914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.126902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.164595 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3665/7340] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:29.166532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.181511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6735025-f333-41b5-96b9-418f06272b43 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.185594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:29.257523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.258495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.259079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.259455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.260264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.262390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.290111 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3676/7341] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:29.294372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.309806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516a37-f909-4629-be42-245e57bb374d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.314704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.315416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.315685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.315962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.316715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.318350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.331096 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3666/7342] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:29.335896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.347616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39e8e-8935-4bde-be52-4b6890765a17 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.353374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.354298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.354584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.354864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] PATH_INFO: `/v3/projects/852d414b47984f4390758e238025eb0a/users/abf2952f9e9d4fa6aad89a002f46572a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.373196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d414b47984f4390758e238025eb0a, user_id=abf2952f9e9d4fa6aad89a002f46572a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.376410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.392832 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3677/7343] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:29 2022] PUT /identity/v3/projects/852d414b47984f4390758e238025eb0a/users/abf2952f9e9d4fa6aad89a002f46572a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:29.397354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.411650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607f56-cf9a-44f2-8e8c-4ddde40d99b4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.482231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.483100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.483386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.483702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.484449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.487353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a99c-299a-491a-b328-f444ef4cced7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.504336 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3667/7344] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:29.505821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.530953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5801-4207-4bec-a4b3-005a59c638be admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.541958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.542815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.543092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.543369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] PATH_INFO: `/v3/projects/852d414b47984f4390758e238025eb0a/users/abf2952f9e9d4fa6aad89a002f46572a/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.546595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d414b47984f4390758e238025eb0a, user_id=abf2952f9e9d4fa6aad89a002f46572a, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.549490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.569804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3678/7345] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:29 2022] PUT /identity/v3/projects/852d414b47984f4390758e238025eb0a/users/abf2952f9e9d4fa6aad89a002f46572a/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:29.582167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.582463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.583049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.651308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] MFA Rules not processed for user `abf2952f9e9d4fa6aad89a002f46572a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:29.654183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:29.689188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:29.759957 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3668/7346] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:29.765772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.779589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd47b17-1fab-4626-aa9a-f432f9a12bee admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.785106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.785948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.786240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.786518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.787380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.789375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.817120 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3679/7347] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/domains => generated 246 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:29.822491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.838867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be293-55f8-453c-9024-a6ef7db9e438 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:29.921727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:29.922558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:29.922854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:29.923136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:29.923843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:29.925821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:29.973273 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3669/7348] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:29.977928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:29.996234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7bebf-f93c-4c29-8c93-74dc7b646305 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.104115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.104898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.105194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.105499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.107823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.108478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.133948 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3680/7349] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:29 2022] POST /identity/v3/users => generated 348 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:30.138137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.149346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff9e4-a3e4-424c-838a-a320120e0810 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.154675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.155027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.155379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.155799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.156640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.158359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5903e-68d5-4381-9ee4-2bd9f97f9aab tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.172488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3670/7350] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:30.176151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.189267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d04d6-4b6f-45a5-a991-bed22f1188fa tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.194808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.195797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.196147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.196447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/projects/e0eb7c19f3e24d689208a8c55043baa2/users/80a79a7b35434264bb468e7b6356c63f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.214210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e0eb7c19f3e24d689208a8c55043baa2, user_id=80a79a7b35434264bb468e7b6356c63f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.217126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f618df6-bde8-467f-b3b2-e7417db1d14a tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.235956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3681/7351] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:30 2022] PUT /identity/v3/projects/e0eb7c19f3e24d689208a8c55043baa2/users/80a79a7b35434264bb468e7b6356c63f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:30.237808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.238101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.238379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.342852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:30.353357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] MFA Rules not processed for user `80a79a7b35434264bb468e7b6356c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:30.355136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:30.371877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3671/7352] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:30.381696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.382238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.382238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.401147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] MFA Rules not processed for user `80a79a7b35434264bb468e7b6356c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:30.402364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:30.412511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3682/7353] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:30.415493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.425923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d6a08-140e-450e-8e24-15e74f286553 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.431010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a79a7b35434264bb468e7b6356c63f', 'user_domain_id': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'system_scope': None, 'project_id': 'e0eb7c19f3e24d689208a8c55043baa2', 'project_domain_id': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.431704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.431963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.432243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.441963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.445318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.464762 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3672/7354] 10.222.0.39 () {56 vars in 1283 bytes} [Sat Jun 25 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3352 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:30.467156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.476657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:30.551252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0563459-823f-4a1b-b398-750e40f3292f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.559910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.560938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.561226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.561504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/users/80a79a7b35434264bb468e7b6356c63f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.563038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80a79a7b35434264bb468e7b6356c63f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.564903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.621217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a79a7b35434264bb468e7b6356c63f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.625833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a79a7b35434264bb468e7b6356c63f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.644304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a79a7b35434264bb468e7b6356c63f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.672591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a79a7b35434264bb468e7b6356c63f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.682909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a79a7b35434264bb468e7b6356c63f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.690251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3683/7355] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:30 2022] DELETE /identity/v3/users/80a79a7b35434264bb468e7b6356c63f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:30.694398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.705915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc18be-1745-4ba9-90d9-563d9fdef600 tempest-test_project-180124521 tempest-user-1804702589] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.777065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.777957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.778241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.778523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/projects/e0eb7c19f3e24d689208a8c55043baa2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.779890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0eb7c19f3e24d689208a8c55043baa2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.781966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:30.844266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0eb7c19f3e24d689208a8c55043baa2', 'request_id': 'req-b11fd974-0f14-4463-905c-1495a560c51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.854200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0eb7c19f3e24d689208a8c55043baa2', 'request_id': 'req-b11fd974-0f14-4463-905c-1495a560c51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.861420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0eb7c19f3e24d689208a8c55043baa2', 'request_id': 'req-b11fd974-0f14-4463-905c-1495a560c51f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.878423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] The token cache is being invalidate because project e0eb7c19f3e24d689208a8c55043baa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:30.878866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.879642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:30.881384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3673/7356] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:30 2022] DELETE /identity/v3/projects/e0eb7c19f3e24d689208a8c55043baa2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:30.885690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:30.887132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:30.906015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e26c8-6017-41c0-881e-d5167551119f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:30.979576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:30.980619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:30.980979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:30.981327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/domains/bb464ad4411c4ab1bbaea12adc8a7be3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:30.982820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bb464ad4411c4ab1bbaea12adc8a7be3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:30.984711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:31.009562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.010366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.019732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:31.042020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.042633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.048129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3684/7357] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:30 2022] PATCH /identity/v3/domains/bb464ad4411c4ab1bbaea12adc8a7be3 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:31.049404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:31.051055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:31.065222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd974-0f14-4463-905c-1495a560c51f tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:31.141602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf2952f9e9d4fa6aad89a002f46572a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '852d414b47984f4390758e238025eb0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:31.142571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:31.143498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:31.143798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] PATH_INFO: `/v3/domains/bb464ad4411c4ab1bbaea12adc8a7be3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:31.156983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:31.164346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bb464ad4411c4ab1bbaea12adc8a7be3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:31.166671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:31.213032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.218951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.286485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.299872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.307460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.325340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] The token cache is being invalidate because project bb464ad4411c4ab1bbaea12adc8a7be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:31.325912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.326700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.337051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.343872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.344823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b3983bd-7799-462c-bc20-40ce98734aa2 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bb464ad4411c4ab1bbaea12adc8a7be3', 'request_id': 'req-7b3983bd-7799-462c-bc20-40ce98734aa2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.354151 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3674/7358] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:31 2022] DELETE /identity/v3/domains/bb464ad4411c4ab1bbaea12adc8a7be3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:31.359234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:31.361481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:31.444238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46698d-520e-4031-b1c5-f6b98774c635 tempest-TestDefaultProjectId-1245703026 tempest-TestDefaultProjectId-1245703026-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:31.542800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:31.544115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:31.544765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:31.545059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] PATH_INFO: `/v3/users/ac9837e4f56e425f98876f480392245c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:31.546641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9837e4f56e425f98876f480392245c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:31.548888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:31.614478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9837e4f56e425f98876f480392245c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.615574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9837e4f56e425f98876f480392245c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.625938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9837e4f56e425f98876f480392245c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.640094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9837e4f56e425f98876f480392245c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.651835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9837e4f56e425f98876f480392245c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:31.663005 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3685/7359] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:31 2022] DELETE /identity/v3/users/ac9837e4f56e425f98876f480392245c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:31.667489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:31.667841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:31.668126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:31.729371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:31.730644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:31.842247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3675/7360] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:31.849799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:31.851556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:31.872884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:UPDATE=1,keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:31.928388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935cea0-8a64-4f5a-8d72-e05bf5585612 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:31.933069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:31.934373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:31.934790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:31.935154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:31.945706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:31.947292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:31.960469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3686/7361] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:32.323590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:32.325375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:32.355773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55687b54-de8d-4c5b-b20e-54ddd24e514a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:32.362738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:32.363655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:32.363939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:32.364220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] PATH_INFO: `/v3/projects/5f75c45713fc4e92ad67006618affaed` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:32.365492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f75c45713fc4e92ad67006618affaed)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:32.367648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:32.427249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:32.440968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f75c45713fc4e92ad67006618affaed', 'request_id': 'req-52de0680-c565-4263-b419-118a4b3d98b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.452534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f75c45713fc4e92ad67006618affaed', 'request_id': 'req-52de0680-c565-4263-b419-118a4b3d98b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.460110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f75c45713fc4e92ad67006618affaed', 'request_id': 'req-52de0680-c565-4263-b419-118a4b3d98b1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.474351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] The token cache is being invalidate because project 5f75c45713fc4e92ad67006618affaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:32.474676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.475321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.477327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3676/7362] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:32 2022] DELETE /identity/v3/projects/5f75c45713fc4e92ad67006618affaed => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:32.482009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:32.492413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e2fe1-cacb-4c0a-addb-8372e9c2dc9f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:32.569707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:32.571493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:32.572034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:32.572414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] PATH_INFO: `/v3/users/abf2952f9e9d4fa6aad89a002f46572a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:32.575585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf2952f9e9d4fa6aad89a002f46572a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:32.579052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:32.658198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf2952f9e9d4fa6aad89a002f46572a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.658847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf2952f9e9d4fa6aad89a002f46572a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.668073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf2952f9e9d4fa6aad89a002f46572a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.683256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf2952f9e9d4fa6aad89a002f46572a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.691129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-efccba30-10b6-4f48-9870-11f6f71a3e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf2952f9e9d4fa6aad89a002f46572a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:32.699784 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3687/7363] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:32 2022] DELETE /identity/v3/users/abf2952f9e9d4fa6aad89a002f46572a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:33.165435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.167957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:33.198546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de0680-c565-4263-b419-118a4b3d98b1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.281792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.283093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.283438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.283821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] PATH_INFO: `/v3/projects/852d414b47984f4390758e238025eb0a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.285193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852d414b47984f4390758e238025eb0a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.288379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.349808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852d414b47984f4390758e238025eb0a', 'request_id': 'req-2f6997a1-de46-4244-aac5-7bac1de06279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:33.364349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852d414b47984f4390758e238025eb0a', 'request_id': 'req-2f6997a1-de46-4244-aac5-7bac1de06279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:33.382967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852d414b47984f4390758e238025eb0a', 'request_id': 'req-2f6997a1-de46-4244-aac5-7bac1de06279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:33.403321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] The token cache is being invalidate because project 852d414b47984f4390758e238025eb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:33.403906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:33.404841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2f6997a1-de46-4244-aac5-7bac1de06279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:33.407518 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3677/7364] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:33 2022] DELETE /identity/v3/projects/852d414b47984f4390758e238025eb0a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:33.412413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.412904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.413244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.436713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:33.438191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:33.482573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:33.521917 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3688/7365] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:33.530221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.530567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.530856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.569540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:33.571152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:33.581752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3678/7366] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:33.586423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.599576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45837a0e-be07-447b-befa-036c727ad7f6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.605540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.606473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.606915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.607345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.608332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:33.608885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.611315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.628583 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3689/7367] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:33.634109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.646598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4a378-798e-4fdf-b54b-da99b60e9bbe None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.654405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.655026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.656680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.657202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.658178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.660354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.697402 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3679/7368] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:33 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:33.701951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.715090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1363e-9881-4058-8c8a-6b4d8b9df124 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.820482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.820482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.820482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.820482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.821003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.822778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.850478 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3690/7369] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:33 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:33.854581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.867057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674794a-002c-4fb9-834c-472ad9157fed admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.872377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.873117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.873399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.873676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.874475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.876834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.892628 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3680/7370] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:21:33.893357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.906378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410dea5-55b4-4bc1-8027-b94c679d4e1e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.911732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.912535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.912885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.913167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.913907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.915789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f9e4-1117-4e68-bbd4-f47fa3a19186 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.930797 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3691/7371] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:33.932146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:33.947066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce944ff6-686e-4e6f-92ac-53bb1f7129d9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:33.952774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:33.954889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:33.955210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:33.955489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] PATH_INFO: `/v3/projects/a9bba93a98b14cc99563068c5e87f6ff/users/89237caa0e0e45b49f243ef5ed5551de/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:33.971646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:33.976575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bba93a98b14cc99563068c5e87f6ff, user_id=89237caa0e0e45b49f243ef5ed5551de, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:33.979422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:33.998026 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3681/7372] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:33 2022] PUT /identity/v3/projects/a9bba93a98b14cc99563068c5e87f6ff/users/89237caa0e0e45b49f243ef5ed5551de/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:34.009695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.010092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.010475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.056751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] MFA Rules not processed for user `89237caa0e0e45b49f243ef5ed5551de`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:34.058067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:34.138150 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3692/7373] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:34.142795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.223180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d37e-6546-49a0-9036-8064689cb2b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.228036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.229106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.229502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.229790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.230511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.232522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.265150 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3682/7374] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:34 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:34.269399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.282285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31fb6-5d6a-4658-b0a9-e8005415b421 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.320191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:34.358735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.359578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.359964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.360557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.361373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.363574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.389015 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3693/7375] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:34 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:34.393258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.404293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3df00-2bf8-47b6-937c-af5806449190 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.409623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.410369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.410755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.411256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.412099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.413862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.429167 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3683/7376] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:21:34.430360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.442915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1edb1-a641-4b18-8793-89c1e4b39e2b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.448541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.449459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.449749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.450029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] PATH_INFO: `/v3/projects/3fd4ca0450654830adda6cad546e2923/users/44ae7f81ee184da997c69253e6f2dfb3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.469948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd4ca0450654830adda6cad546e2923, user_id=44ae7f81ee184da997c69253e6f2dfb3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.474522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.503867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3694/7377] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:34 2022] PUT /identity/v3/projects/3fd4ca0450654830adda6cad546e2923/users/44ae7f81ee184da997c69253e6f2dfb3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:34.508416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.526437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfdcd-9aba-40a3-9f23-aa20fe405842 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.601757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.602822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.602822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.603249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.604297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.606170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933589e-6358-48a4-bbcd-82a230ff66c6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.618800 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3684/7378] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:34.623375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.634499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe48ba-93ea-49db-99e2-3683b512e88c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.639685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.640647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.640937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.641246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] PATH_INFO: `/v3/projects/3fd4ca0450654830adda6cad546e2923/users/44ae7f81ee184da997c69253e6f2dfb3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.643836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd4ca0450654830adda6cad546e2923, user_id=44ae7f81ee184da997c69253e6f2dfb3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.646551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.660768 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3695/7379] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:34 2022] PUT /identity/v3/projects/3fd4ca0450654830adda6cad546e2923/users/44ae7f81ee184da997c69253e6f2dfb3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:34.671244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.671541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.671826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.704188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] MFA Rules not processed for user `44ae7f81ee184da997c69253e6f2dfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:34.705476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:34.766775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:34.800462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3685/7380] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:34.804961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.819194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19389865-88c4-4742-bfd8-21df53533848 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.826978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.828060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.828481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.829225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.830321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.832112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.855939 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3696/7381] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:21:34 2022] POST /identity/v3/domains => generated 275 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:34.860861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:34.871676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2fe6a-45a6-47e9-81fa-5ebd18f16051 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:34.943774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:34.944606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:34.944898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:34.945206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:34.945970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:34.947049 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:34.947049 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:21:34.947049 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:34.947931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:34.995757 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3686/7382] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:21:34 2022] PUT /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config => generated 138 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:34.997313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.008822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59dde4-007d-4313-8246-476e82d736d5 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.016634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.017268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.017561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.017844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.019536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850, group=identity)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.023506 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:35.023506 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:35.023506 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:35.023506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.035061 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3697/7383] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:21:34 2022] GET /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/identity => generated 45 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:35.036045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.056321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d354-6bdb-4a59-b01e-efddfd3c72ef tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.063490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.064521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.064703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.064981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/identity/driver` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.066391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850, group=identity, option=driver)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.067426 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:35.067426 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:21:35.067426 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:35.068483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c07c-3b6d-4783-a425-7ba0f85c0942 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.076749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3687/7384] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 21:21:35 2022] GET /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/identity/driver => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:35.080995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.093632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0e78-3ee5-4034-9fc2-b31d2aa8b644 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.109238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.110140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.110431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.110715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.113066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850, group=ldap)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.114126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.114591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.114714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.115105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.127268 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3698/7385] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:21:35 2022] GET /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap => generated 106 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:35.133454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.150524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:35.152874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.162121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b16c-29e3-4bbd-b226-259a75ca982e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.185058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.186280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.186619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.188070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap/url` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.189725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850, group=ldap, option=url)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.191359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.199831 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3699/7386] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:21:35 2022] GET /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap/url => generated 46 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:35.204378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.225202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2577ba-4fd4-45a7-9daf-79028a312461 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.231118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.232238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.232735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.233187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap/user_tree_dn` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.235219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850, group=ldap, option=user_tree_dn)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.237494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.242977 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3688/7387] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:21:35.245437 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3700/7388] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:21:35 2022] GET /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config/ldap/user_tree_dn => generated 63 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:35.249640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.258790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.261730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.273674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb86f-324b-442e-bbb3-2a953db84bf5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.280412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.281293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.282606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.282606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.283070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.284589 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:35.284589 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:21:35.284589 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:35.286586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.301535 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3689/7389] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:35 2022] DELETE /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:35.305600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.321593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db847-24e9-4a78-a285-2d698aebb43e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.341442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.342400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.342993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.343118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.347794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.350063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.386607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474780e8-2f27-4f59-b34d-1a97ef747c07 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.387586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.388638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.394466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.395181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.395484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.395993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.398342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.416763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.418530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.425922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.427756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.431190 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3701/7390] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:35.434626 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3690/7391] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:35 2022] PATCH /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850 => generated 276 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:21:35.439420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.441666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.457942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf974d-ae49-4664-bd43-52952043de13 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.486166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:35.523071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.524043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.524313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.524630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.536758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=55ee0dfdc3844d048cd4fe92bd7b0850)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.538408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.573436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.577039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.639116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.654387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.668077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.682947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] The token cache is being invalidate because project 55ee0dfdc3844d048cd4fe92bd7b0850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:35.683532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.684216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.702724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.708373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.709291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '55ee0dfdc3844d048cd4fe92bd7b0850', 'request_id': 'req-87b3e562-490a-4f23-976a-c0e168b813b3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:35.724886 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3702/7392] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:35 2022] DELETE /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:35.729849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.731394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.745225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:35.751423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b24d8-c9ae-4de6-9957-d73ebb0eec62 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:35.853631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:35.855156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:35.855520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:35.855883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:35.856737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:35.861178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:35.912050 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3691/7393] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:21:35 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:35.912400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:35.913985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:35.931413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e562-490a-4f23-976a-c0e168b813b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.012270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.013283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.014259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.014733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.016188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.016904 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:36.016904 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:36.016904 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:36.018123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.026181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:36.069344 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3703/7394] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:21:35 2022] PUT /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 138 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:36.074705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.094736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07af1-fc7b-4ee5-ac4c-78ff2c1278e0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.100228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.101278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.101770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.102039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.102906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.104367 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:36.104367 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:21:36.104367 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:36.105626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.154549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3692/7395] 10.222.0.39 () {60 vars in 1270 bytes} [Sat Jun 25 21:21:36 2022] PATCH /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 142 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:36.156008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.170264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e5a61-23d3-4632-afcb-5e46e3df51bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.176663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.177898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.178289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.179340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.180185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.182668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.188705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3704/7396] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:36 2022] GET /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 142 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:36.192744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.204408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0874-9751-4ba9-85d0-e9a5ab37f316 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.214540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.214540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.214540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.214867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.215798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.217546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.232604 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3693/7397] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:36 2022] DELETE /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:36.237698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.253361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ab0d0-260a-4135-acc1-cbce2c05b08a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.272014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.273024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.273379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.275303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.277508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.280564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find any options in domain configuration for domain 3219ccb0167b49bc952cb803559981c3.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 3219ccb0167b49bc952cb803559981c3. Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:36.294745 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 3219ccb0167b49bc952cb803559981c3. Jun 25 21:21:36.295769 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:36.299878 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3705/7398] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:36 2022] GET /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 151 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:21:36.301009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.314450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bf782-3b69-457f-be16-c4810d123a9d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.325361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.328274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.328274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.329027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.329809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.331491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.349983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3694/7399] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:36 2022] DELETE /identity/v3/domains/3219ccb0167b49bc952cb803559981c3/config => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:36.351172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.362751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584754e-ec37-4604-9494-e54c37f437ca tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.374627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.375905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.376358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.377072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.378616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.381625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.406647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.408002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.443086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.444058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.450191 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3706/7400] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:36 2022] PATCH /identity/v3/domains/3219ccb0167b49bc952cb803559981c3 => generated 277 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:21:36.451771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.454673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:36.469273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf4d5-5019-48ba-a7e1-cecfd6b1efec tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.534395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.535422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.535826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.536214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.549364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3219ccb0167b49bc952cb803559981c3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.551177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.577124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.581882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3219ccb0167b49bc952cb803559981c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.596391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:36.646175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.658855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.668549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.701714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] The token cache is being invalidate because project 3219ccb0167b49bc952cb803559981c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:36.702354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.703250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.715230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.719088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.720364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3219ccb0167b49bc952cb803559981c3', 'request_id': 'req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:36.727003 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3695/7401] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:36 2022] DELETE /identity/v3/domains/3219ccb0167b49bc952cb803559981c3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:36.732008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.744405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857f9e-3ff9-467b-bb2f-832ee41c687b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:36.850597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:36.851594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:36.852069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:36.852547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:36.854538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:36.856791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:36.914002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:36.914219 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3707/7402] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:21:36 2022] POST /identity/v3/domains => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:36.915461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:36.935087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7dbbc-10c4-470d-a5d7-d07cbfbb060a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.021308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.022548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.023034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.023503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.025081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.028027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.071858 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3696/7403] 10.222.0.39 () {60 vars in 1268 bytes} [Sat Jun 25 21:21:36 2022] PUT /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config => generated 138 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:37.073446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.085428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59b006-00f9-48c8-bbd5-a074db5000b0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.090407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.091333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.091616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.091904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.092809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.093840 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:37.093840 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:37.093840 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:37.094800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.289799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3708/7404] 10.222.0.39 () {60 vars in 1296 bytes} [Sat Jun 25 21:21:37 2022] PATCH /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity => generated 177 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:37.290933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.307153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c9c80-3a63-4b94-af32-b846a0416d3e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.312396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.313380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.313667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.313947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.314718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity, option=driver)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.316579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.351792 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3697/7405] 10.222.0.39 () {60 vars in 1317 bytes} [Sat Jun 25 21:21:37 2022] PATCH /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver => generated 176 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:37.355806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.366366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cdac-2c10-4991-9e46-30c6241bd7fd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.371121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.372253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.372587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.372863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.373660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity, option=driver)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.374629 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:37.374629 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:37.374629 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:37.375503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.396523 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3709/7406] 10.222.0.39 () {58 vars in 1298 bytes} [Sat Jun 25 21:21:37 2022] DELETE /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:37.399527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.411234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad7c3-1cba-44c6-96e7-12a676540fe4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.421723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.422851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.423330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.423782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.425312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity, option=driver)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.427374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find option driver in group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:37.442567 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:37.443616 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:37.446758 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3698/7407] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 21:21:37 2022] GET /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity/driver => generated 171 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:21:37.451486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.462539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0a5c-c912-45ea-9f97-6f8d15d667f6 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.468694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.470150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.470455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.470807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.471466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.473129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.488622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:37.504482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3710/7408] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 21:21:37 2022] DELETE /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:37.507881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.521549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b08220-39a1-4406-a9d2-3951012d16fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.526645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.527559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.527847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.528130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.530177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479, group=identity)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.531966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:37.550765 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:37.551729 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:37.557299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3699/7409] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:21:37 2022] GET /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config/identity => generated 154 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:21:37.561833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.574227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee4c79-0e8d-4596-a95f-686349849d06 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.580038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.580946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.581237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.581503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.582161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a4ae911e79554c65acc1d198ccd5d479)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.583772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.597703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3711/7410] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:37 2022] DELETE /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479/config => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:37.602016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.615037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419c1c-b726-46fd-bc79-a6cab2890a57 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.621081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.622078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.622435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.622934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.624620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a4ae911e79554c65acc1d198ccd5d479)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.626326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.630447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:37.660403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.661956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.714026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.714953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.719436 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3700/7411] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:37 2022] PATCH /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479 => generated 276 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:37.724288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:37.727453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:37.747015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ee25-f84a-4531-ab42-632e01988227 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:37.856890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:37.858018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:37.858380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:37.858923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:37.877461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a4ae911e79554c65acc1d198ccd5d479)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:37.879259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:37.907802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.912120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.969597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.978394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:37.985821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.003073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] The token cache is being invalidate because project a4ae911e79554c65acc1d198ccd5d479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:38.003490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.004676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.014807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.018342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.019416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a4ae911e79554c65acc1d198ccd5d479', 'request_id': 'req-3ad32f82-4ca8-4832-b87d-797ae84e7b12'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:38.027940 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3712/7412] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:37 2022] DELETE /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:38.033716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.046712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9288a-d4eb-40eb-ac9b-9a982d21eefd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.116734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.117417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.117710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.118024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.118763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.119747 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:38.119747 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:21:38.119747 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:38.120800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.125228 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3701/7413] 10.222.0.39 () {58 vars in 1172 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:38.129380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.130826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:38.144177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad32f82-4ca8-4832-b87d-797ae84e7b12 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.149854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.150659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.150951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.151222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.151885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.152944 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:38.152944 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:38.152944 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:38.154046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.156821 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3713/7414] 10.222.0.39 () {58 vars in 1199 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.160956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.171950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a67d-02d4-42ea-b45c-575700f30468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.176705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.178674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.178674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.178674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.178984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.180530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.181865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3702/7415] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:38.185961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.196464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86614-983c-4f8a-a91a-111613417fc1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.201380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.202271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.202561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.202841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.203505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.205522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.206861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3714/7416] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.211062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.224354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e47c43-a1d7-4abb-a686-b0a22fb999d1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.229688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.230525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.230814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.231098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.231764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.233721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.235553 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3703/7417] 10.222.0.39 () {58 vars in 1187 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:38.239576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.252709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13bac-8e66-49db-b0b0-2a0f95556aa8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.259068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.259848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.260147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.260447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.261128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.262764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.264032 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3715/7418] 10.222.0.39 () {58 vars in 1199 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.270949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.279443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8152-d2db-44ca-bdc2-798210f02310 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.286564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.287390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.287676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.287955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.288668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.290518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.292467 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3704/7419] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.295921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.307800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86923fe-b222-426b-b40d-82478927d367 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.312759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.313565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.313849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.314124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.314788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.316444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.317733 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3716/7420] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.321987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.335569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a566a6f-4ae9-4c30-aafe-cebf16294259 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.340751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.341615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.341904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.342214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.342932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.344602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.345950 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3705/7421] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.349986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.360832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3cd8-3cce-4a68-a1d4-1e0c7ee29cfc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.365927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.367240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.367240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.367240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.367974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.369663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.372598 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3717/7422] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.378902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.389507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff0401-280a-4f8d-8900-b0e4f74f37eb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.397619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.398571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.398925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.399278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.400032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.402103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.403843 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3706/7423] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.407597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.413151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:38.420704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd792-a611-4526-acf0-fd12d0157042 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.427980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.429216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.429620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.430221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.430884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.432536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.434264 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3718/7424] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.437977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.449082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b271-1127-4c52-a0c4-7d6f5785cf21 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.454264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.455355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.455706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.456051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.456855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.458546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.462736 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3707/7425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.464381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.475349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec5056-6e24-4779-954d-46d853171ed4 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.482217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.483018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.483338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.483617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.484957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.487977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.491894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3719/7426] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.493312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.504697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8923a-fa90-42e9-a4ba-e3dd22fc91ff tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.510237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.511047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.511326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.511605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.512461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.514447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.516462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3708/7427] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.519716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.531114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8205e1d-ef16-40f2-bf4a-77eb8b598762 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.536091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.536985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.537268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.537551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.538207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.539816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.545203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.546259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3720/7428] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.556767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a40d4-1da7-4851-9b9c-29fd7edca774 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.562203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.563024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.563340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.563623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.564291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.565960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.570592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3709/7429] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.571310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.582330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03cbf4-35d8-4f88-851f-463e8fff8179 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.587053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.587864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.588179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.588614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.589172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.590772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.592029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3721/7430] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:38.596112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.606898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c56d58-078c-4e2d-90dc-c0533de47b70 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.611910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.612862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.613206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.613581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.614323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.616023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.617489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3710/7431] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.621529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.631962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e19757-1c8d-40cf-a907-d5bfc2a1f9dd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.637793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.638521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.638843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.639162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.639939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.641609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.643253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3722/7432] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.647540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.659083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d3c2-932b-4c26-948d-d0f3aff7453d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.669564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.670422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.670876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.671233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.671816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.673523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.675037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3711/7433] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:38.678845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.692647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6cc08-6b36-4b22-8799-e5cc1c0235cd tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.700287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.701592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.701936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.702314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.703048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.705362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.707956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3723/7434] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.712141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.723071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef87a8-50bf-460a-b64e-65777cf62761 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.728205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.729075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.729490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.729776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.730443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.732246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.733655 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3712/7435] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.737565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.751029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb82f-2823-4446-a2cd-842b791e5691 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.757162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.758076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.758339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.758608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.759289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.761196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.762983 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3724/7436] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:38.768931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.782305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca194-5652-47e8-b9bc-dbd2070e07aa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.789296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.790418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.790862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.791274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.792043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.794293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.797487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3713/7437] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.803537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.816696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfdcf-4dfa-4f3e-8d7a-f46050c11d27 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.821628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.822968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.823273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.824660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.824840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.826791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.828274 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3725/7438] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.832941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.843627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800b2a0-c863-4620-8789-d783a214ce63 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.849065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.849904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.850189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.850475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.851144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.852845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.858014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.863918 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3714/7439] 10.222.0.39 () {58 vars in 1289 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.870617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f742b-82ed-46cd-8b56-b320229093fc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.875704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.876864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.877400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.877779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.878547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.880270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.881839 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3726/7440] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.885750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.900568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5932cb-3608-4a62-b09a-486064930fbf tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.908397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.909351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.909642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.909925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.910598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.912219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.916375 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3715/7441] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.917502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.927839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa06-4f18-4648-9103-b4b8abf2b099 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.932540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.933367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.933653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.933932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.934588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.936285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.941067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3727/7442] 10.222.0.39 () {58 vars in 1307 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.945112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.956576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6fd7-6fbf-411d-9f73-9128dc132fd2 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.962460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.963385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.963874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.964268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.965075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.967381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:38.970533 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3716/7443] 10.222.0.39 () {58 vars in 1289 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:38.974782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:38.986581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d655-9ccc-4fe4-af24-ce80a9e79435 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:38.993896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:38.995457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:38.995908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:38.996271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:38.997270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:38.999195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.000577 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3728/7444] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:38 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.004812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.016651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc8aa-f9f9-4688-9cef-b0f3d6383f5c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.021561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.022447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.022803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.023158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.023916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.025660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.026910 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3717/7445] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.031050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.042192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cbf65-15b5-4ac9-bbe4-d27689e7a37c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.047394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.048488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.049428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.049428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.049713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.052016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.053184 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3729/7446] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.058444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.069061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abbbf-a341-4521-8a1a-05174edf0677 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.074260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.075418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.075814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.076239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.077135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.080082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.081004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3718/7447] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.084850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.095315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aaa6-6444-4a4c-bd7b-caf45656e1b3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.100901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.101841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.102232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.102754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.103414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.105177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.106732 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3730/7448] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.110799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.124043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6417b-03e6-45a5-9975-ef5eea9448d9 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.131715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.133446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.133810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.134165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.134910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.137697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.139317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3719/7449] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.143475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.157865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e123fb-3c15-40df-9b0c-07ce0569ab2e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.163443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.164266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.165652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.165652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.166649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.167912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.170195 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3731/7450] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.174104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.188048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86cbe-cd00-4641-ba98-3a3c2808ff7b tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.194610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.195513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.195804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.196133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.196839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.198801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.200323 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3720/7451] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.204865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.216217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecb95e-a60b-49f6-ba52-f709e65346d3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.222676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.223491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.223903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.224187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.224905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.226775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.228025 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3732/7452] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.233164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.244726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3b2d-561b-4fa7-b445-59c3914deb9c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.251161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.253322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.253596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.253964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.254793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.257084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.262701 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3721/7453] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.266783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.277529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d832-28d0-4404-ae28-ad53706182c1 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.283492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.287033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.287033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.287033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.287033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.287536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.288361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3733/7454] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.292611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.302907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a7592-3359-4d23-ab22-4f2046032c4d tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.307914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.308747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.309034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.309314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.309976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.311660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.312848 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3722/7455] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.317273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.327419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2955-391f-4453-bdb8-dbcd32c9d443 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.332395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.333212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.333498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.333809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.334589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.336257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.337453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3734/7456] 10.222.0.39 () {58 vars in 1211 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.341476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.352378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb9c23-b928-4f93-92a1-7dfad21d4f23 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.357221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.358102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.358353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.358632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.359293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.361135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.362338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3723/7457] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.366643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.378239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf92ed-818d-4d50-b12f-9d858472d175 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.383029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.383826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.384117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.384615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.385278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.386891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.388118 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3735/7458] 10.222.0.39 () {58 vars in 1214 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.392148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.403141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fa447-6708-4a58-afab-6ecb065ffc05 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.408596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.409398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.409720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.410016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.410675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.412295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.416257 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3724/7459] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.419537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.429776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f03d-9a36-403d-a8ce-c99255b64fe3 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.434317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.435135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.435419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.435697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.436377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.438023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.439244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3736/7460] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.443391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.456113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363a76-96b2-4e24-abea-31b86b1a681a tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.461745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.462443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.462735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.463022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.463692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.465373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.466734 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3725/7461] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.470692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.482153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa28d5-1e03-4394-a960-bf6fea8d7adc tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.487185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.488189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.488791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.489186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.489953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.491661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.493061 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3737/7462] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.497622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.510004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a472b-8640-4eb5-b6c7-556cea352fba tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.515265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.516031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.516315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.516802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.517472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.519098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.520601 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3726/7463] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.524847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.538064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecdd0-aa68-4ff6-99cd-38710e817468 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.543821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.544752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.545108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.545570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.546370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.548207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.549571 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3738/7464] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.553876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.564365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711d002-c3e4-4dbb-9541-56272b6eb813 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.569676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.570475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.570771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.571058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.571719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.573376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.574523 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3727/7465] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 25 21:21:39.579165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.589861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52941f3-fb6d-4d82-a8ae-aaa7cdbaa0f0 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.595623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.596881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.597238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.597677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.598535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.600225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.606092 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3739/7466] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 21:21:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 25 21:21:39.609203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.623507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc30c9-e090-46f0-b1a6-9c0b57e2b7a8 tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.628682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.629580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.629948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.630236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/a4ae911e79554c65acc1d198ccd5d479` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.638162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find domain: a4ae911e79554c65acc1d198ccd5d479.: keystone.exception.DomainNotFound: Could not find domain: a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:39.648547 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:39.649860 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:21:39.650773 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a4ae911e79554c65acc1d198ccd5d479. Jun 25 21:21:39.651798 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.651798 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3728/7467] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:39 2022] PATCH /identity/v3/domains/a4ae911e79554c65acc1d198ccd5d479 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:21:39.653875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.664564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d682f-2bbc-4c07-af38-01d6247af7bb tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.669405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.670290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.670557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.670951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/3219ccb0167b49bc952cb803559981c3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.678581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find domain: 3219ccb0167b49bc952cb803559981c3.: keystone.exception.DomainNotFound: Could not find domain: 3219ccb0167b49bc952cb803559981c3. Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3219ccb0167b49bc952cb803559981c3. Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:39.688547 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:39.689709 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:21:39.690793 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3219ccb0167b49bc952cb803559981c3. Jun 25 21:21:39.691808 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:39.691808 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3740/7468] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:39 2022] PATCH /identity/v3/domains/3219ccb0167b49bc952cb803559981c3 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:21:39.693872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.704646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce95c-f051-447d-b6d2-48dbf0016a9e tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.709337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44ae7f81ee184da997c69253e6f2dfb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fd4ca0450654830adda6cad546e2923', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.710209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.710502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.710781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] PATH_INFO: `/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.713133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:39.719091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-342cf712-cc91-45fd-874a-dba15362a6fa tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Could not find domain: 55ee0dfdc3844d048cd4fe92bd7b0850.: keystone.exception.DomainNotFound: Could not find domain: 55ee0dfdc3844d048cd4fe92bd7b0850. Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 55ee0dfdc3844d048cd4fe92bd7b0850. Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:39.730305 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:21:39.731481 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:21:39.736078 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 55ee0dfdc3844d048cd4fe92bd7b0850. Jun 25 21:21:39.737323 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:39.737323 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3729/7469] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:39 2022] PATCH /identity/v3/domains/55ee0dfdc3844d048cd4fe92bd7b0850 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:21:39.737495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:39.738591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:39.815426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7fcb-c70c-4117-b416-b3ec1b23714c tempest-DomainConfigurationTestJSON-1188074092 tempest-DomainConfigurationTestJSON-1188074092-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:39.821004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:39.822043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.822188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.822431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] PATH_INFO: `/v3/users/89237caa0e0e45b49f243ef5ed5551de` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.823665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89237caa0e0e45b49f243ef5ed5551de)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:39.825687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:39.882032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89237caa0e0e45b49f243ef5ed5551de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:39.882741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89237caa0e0e45b49f243ef5ed5551de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:39.897744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89237caa0e0e45b49f243ef5ed5551de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:39.907727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:39.918913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89237caa0e0e45b49f243ef5ed5551de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:39.928836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89237caa0e0e45b49f243ef5ed5551de'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:39.936482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3741/7470] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:39 2022] DELETE /identity/v3/users/89237caa0e0e45b49f243ef5ed5551de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:39.940915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:39.942324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:39.942838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:39.972583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:39.974014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:40.053078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3730/7471] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:40.065731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:40.068239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:40.141047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7efb8c-3dd2-40f0-a8cf-5c1e1258748e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:40.144642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:40.145299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:40.145578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:40.145857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:40.155329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:40.156866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:40.167954 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3742/7472] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:40.484954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:40.486536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:40.499096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291bc0-a408-49e9-bb95-3933cfaaa776 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:40.505703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:40.506871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:40.507245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:40.507616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] PATH_INFO: `/v3/projects/a9bba93a98b14cc99563068c5e87f6ff` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:40.509293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bba93a98b14cc99563068c5e87f6ff)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:40.512603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:40.572918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bba93a98b14cc99563068c5e87f6ff', 'request_id': 'req-a19558e9-2c21-4e63-badc-82b75449a1ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.584332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bba93a98b14cc99563068c5e87f6ff', 'request_id': 'req-a19558e9-2c21-4e63-badc-82b75449a1ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.604701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bba93a98b14cc99563068c5e87f6ff', 'request_id': 'req-a19558e9-2c21-4e63-badc-82b75449a1ab'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.621084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] The token cache is being invalidate because project a9bba93a98b14cc99563068c5e87f6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:40.621384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.622070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.624055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3731/7473] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:40 2022] DELETE /identity/v3/projects/a9bba93a98b14cc99563068c5e87f6ff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:40.628100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:40.639820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5a902-af15-4c64-b51b-900520281a64 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:40.711699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:40.712625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:40.712906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:40.713226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] PATH_INFO: `/v3/users/44ae7f81ee184da997c69253e6f2dfb3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:40.714394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ae7f81ee184da997c69253e6f2dfb3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:40.716315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:40.791411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ae7f81ee184da997c69253e6f2dfb3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.792114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ae7f81ee184da997c69253e6f2dfb3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.814331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ae7f81ee184da997c69253e6f2dfb3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.865463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ae7f81ee184da997c69253e6f2dfb3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.873528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-266544cf-1fc6-46a9-a04c-bacf2eb6f821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ae7f81ee184da997c69253e6f2dfb3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:40.875290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:40.881801 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3743/7474] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:40 2022] DELETE /identity/v3/users/44ae7f81ee184da997c69253e6f2dfb3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:41.211980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.213614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:41.228065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19558e9-2c21-4e63-badc-82b75449a1ab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.292694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.293680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.294030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.294374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] PATH_INFO: `/v3/projects/3fd4ca0450654830adda6cad546e2923` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.295717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd4ca0450654830adda6cad546e2923)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.297691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.323339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:41.354365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd4ca0450654830adda6cad546e2923', 'request_id': 'req-f198cda9-bda5-4aef-9f26-52cfa0547b4c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:41.363586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd4ca0450654830adda6cad546e2923', 'request_id': 'req-f198cda9-bda5-4aef-9f26-52cfa0547b4c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:41.371483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd4ca0450654830adda6cad546e2923', 'request_id': 'req-f198cda9-bda5-4aef-9f26-52cfa0547b4c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:41.385882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] The token cache is being invalidate because project 3fd4ca0450654830adda6cad546e2923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:41.386047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:41.386949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f198cda9-bda5-4aef-9f26-52cfa0547b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:41.389099 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3732/7475] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:41 2022] DELETE /identity/v3/projects/3fd4ca0450654830adda6cad546e2923 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:41.394152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.395395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.395667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.415606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:41.417089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:41.512796 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3744/7476] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:41.520775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.521989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.522452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.554301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:41.556624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:41.566569 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3733/7477] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:41.573160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.590285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97554990-6a02-4d8c-ae1f-a23fdb437ff0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.596326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.597044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.597326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.597601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.598506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:41.598812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.600499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.634164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3745/7478] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:41.638042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.653732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcff794-3cbf-457d-927b-5ad5910be13e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.666265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.667303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.667739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.668030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.668915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.671264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.713468 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3734/7479] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:41.715345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.730703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6732e-28ce-4d11-b926-a9d603a8c59d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.813294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.813989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.814273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.814544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.820474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.820474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.842188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3746/7480] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:41 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:41.846436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.859038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7592-152a-4f93-9ec9-f79be1f6fa1b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.865059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.865675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.865968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.866259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.866981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.868645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.888198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3735/7481] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:41.892135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.903867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c96c7-877b-4a9b-a212-7a84e7782aba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.909976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.910579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.910777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.911055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.911807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.913476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c21a63-11cc-4011-bcb8-738ee082b874 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:41.926421 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3747/7482] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:21:41.930624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:41.941832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cc2f4-2976-49a5-a6ab-d54b98fb9c20 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:41.952476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:41.954227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:41.954786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:41.955224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] PATH_INFO: `/v3/projects/f093d997b3db42e89638a3a1bb5054c8/users/6d7cb96e3c7f4337a648ee813a6c7d62/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:41.975958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f093d997b3db42e89638a3a1bb5054c8, user_id=6d7cb96e3c7f4337a648ee813a6c7d62, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:41.979431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.008625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3736/7483] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:41 2022] PUT /identity/v3/projects/f093d997b3db42e89638a3a1bb5054c8/users/6d7cb96e3c7f4337a648ee813a6c7d62/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:42.020662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.020958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.021239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.055471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] MFA Rules not processed for user `6d7cb96e3c7f4337a648ee813a6c7d62`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:42.056862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:42.134903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:42.140878 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3748/7484] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:42.145551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.215936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01558-52b6-4445-8426-ce20548754c6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.220981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.221721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.222068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.222510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.223305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.225328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.257006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3737/7485] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:42.261188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.273184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1ad3-fa44-4fa2-99e0-69f018c957c7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.338440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.339225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.340016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.340016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.341186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.342915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.370595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3749/7486] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:42.379291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.386568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf4a8-7896-4b67-8b3c-985502be5888 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.391595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.392317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.392687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.393033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.393809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.395517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.407156 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3738/7487] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:21:42.411446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.423036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a7eae-de30-4fc9-82aa-481f101419a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.429002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.430754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.430754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.430754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] PATH_INFO: `/v3/projects/c3c8ecd6e01f4bbda112235b9578782b/users/107e58c6a0ae4859863660883fddc0f1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.449787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c8ecd6e01f4bbda112235b9578782b, user_id=107e58c6a0ae4859863660883fddc0f1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.452879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.469589 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3750/7488] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:42 2022] PUT /identity/v3/projects/c3c8ecd6e01f4bbda112235b9578782b/users/107e58c6a0ae4859863660883fddc0f1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:42.473505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.484493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e08d-9bff-41ae-9b14-fb0419144849 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.508054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:42.563216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.563917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.564204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.564515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.565257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.566892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325d51-929e-4862-a0ad-8965cf2ae7d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.577749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3739/7489] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:42.582342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.593276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d904f-adc2-45c5-9171-fff63cf9f476 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.599229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.600150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.600448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.600751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] PATH_INFO: `/v3/projects/c3c8ecd6e01f4bbda112235b9578782b/users/107e58c6a0ae4859863660883fddc0f1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.603261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c8ecd6e01f4bbda112235b9578782b, user_id=107e58c6a0ae4859863660883fddc0f1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.605705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.617165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3751/7490] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:42 2022] PUT /identity/v3/projects/c3c8ecd6e01f4bbda112235b9578782b/users/107e58c6a0ae4859863660883fddc0f1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:42.627323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.627924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.628480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.671312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] MFA Rules not processed for user `107e58c6a0ae4859863660883fddc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:42.673479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:42.761094 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3740/7491] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:21:42.767187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.782005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b5486-38bf-4e87-bb06-61e4d35c9526 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.787545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.788512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.788909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.789396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.790224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.792310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.823825 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3752/7492] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/services => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:42.825411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.835123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f7d47-ac87-4d01-9e37-786a42f1beda None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.850946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.851605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.851893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.852171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.853032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.854696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: On instance['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: On instance['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: 'False' Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise error Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application 'False' Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.863237 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:21:42.865206 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application 'False' Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:42.866472 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3741/7493] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/endpoints => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:21:42.871184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.882092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da562b-8566-41bf-88f0-5ebb72632b9f tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.886853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.887527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.887815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.888099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.888891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.890561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: On instance['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: On instance['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: 'True' Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise error Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'True' Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.896861 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:21:42.898869 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'True' Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:42.900041 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3753/7494] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/endpoints => generated 281 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 25 21:21:42.904292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.915823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235353dd-e752-4333-923a-0dcb814043cb tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:42.920995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:42.921872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:42.922162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:42.922473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:42.923231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:42.924879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:42.940532 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1299427805. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:21:42.940532 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:21:42.940532 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:21:42.971502 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3742/7495] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:21:42 2022] POST /identity/v3/endpoints => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:42.972802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:42.983102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ec126-88b7-4985-acad-0ceb22377e6b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.006953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.007816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.008108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.008384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/regions/tempest-region-1299427805` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.009150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1299427805)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.010240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.013193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3754/7496] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:21:42 2022] GET /identity/v3/regions/tempest-region-1299427805 => generated 180 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:43.017475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.029331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bf24-013f-4649-ac91-9bf03645e045 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.034441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.035327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.035736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.036227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints/aac9fad952c0435581020e508f5d57fd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.042956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=aac9fad952c0435581020e508f5d57fd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.044676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: On instance['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: On instance['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: 'False' Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise error Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application 'False' Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.056613 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:21:43.058187 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application 'False' Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:21:43.059806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3743/7497] 10.222.0.39 () {60 vars in 1254 bytes} [Sat Jun 25 21:21:43 2022] PATCH /identity/v3/endpoints/aac9fad952c0435581020e508f5d57fd => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:21:43.062415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.077220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ea4a-1787-4d77-be9b-ced9a75c4db1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.094022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.095241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.095630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.096158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints/aac9fad952c0435581020e508f5d57fd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.098599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=aac9fad952c0435581020e508f5d57fd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.100708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.121410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'aac9fad952c0435581020e508f5d57fd', 'request_id': 'req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.163286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3755/7498] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/endpoints/aac9fad952c0435581020e508f5d57fd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.165315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.179866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70561f57-eaff-4025-83bc-bde2c4ebc70e tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.199948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.200857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.201438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.201438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/regions/tempest-region-1299427805` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.202091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1299427805)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.205522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.241610 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3744/7499] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/regions/tempest-region-1299427805 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.246639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.258550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5dd9b-c16d-4dbc-84e1-3784a62e9bc1 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.278609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.279291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.279586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.279866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.280896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.282529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.307265 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-776280073. To ensure interoperability, identifiers should be a valid uuid. Jun 25 21:21:43.307265 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 25 21:21:43.307265 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:43.344166 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3756/7500] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:21:43 2022] POST /identity/v3/endpoints => generated 358 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:43.345122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.359955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0dcc-f71e-410d-843f-9b27fa35f070 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.386734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:43.394733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.397071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.397889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.398276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/regions/tempest-region-776280073` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.399110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-776280073)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.401652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.408702 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3745/7501] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 21:21:43 2022] GET /identity/v3/regions/tempest-region-776280073 => generated 178 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:21:43.410067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.425008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92113-bded-479b-8a8a-9e9743f0b3bc tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.432650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.434847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.435186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.435471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints/fe40aea10af24416a82453918130ae4f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.444176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=fe40aea10af24416a82453918130ae4f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.445253 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:21:43.445253 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:21:43.445253 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:21:43.446160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: On instance['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: On instance['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: 'True' Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise error Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'True' Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.461899 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:21:43.463560 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['enabled']: Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'True' Jun 25 21:21:43.464775 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:21:43.467777 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3757/7502] 10.222.0.39 () {60 vars in 1254 bytes} [Sat Jun 25 21:21:43 2022] PATCH /identity/v3/endpoints/fe40aea10af24416a82453918130ae4f => generated 281 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:21:43.472984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.487530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80acc7-4a7c-498f-8d09-64ac047db49b tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.493530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.494809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.495095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.495372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/endpoints/fe40aea10af24416a82453918130ae4f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.497321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fe40aea10af24416a82453918130ae4f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.499430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.517804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fe40aea10af24416a82453918130ae4f', 'request_id': 'req-8ffbba25-bfb3-410e-a35a-878e2b11c735'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.536568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.545100 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3746/7503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/endpoints/fe40aea10af24416a82453918130ae4f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.545344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:43.552876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222a95-9eaf-48a4-8332-263b479e59ab tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.575085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.575944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.576225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.577005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/regions/tempest-region-776280073` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.577716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-776280073)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.582363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.606287 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3758/7504] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/regions/tempest-region-776280073 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.610953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.623557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbba25-bfb3-410e-a35a-878e2b11c735 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.642439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '107e58c6a0ae4859863660883fddc0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3c8ecd6e01f4bbda112235b9578782b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.643520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.644388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.644919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] PATH_INFO: `/v3/services/1fdec245efd54a50854c83996f4d9923` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.646541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1fdec245efd54a50854c83996f4d9923)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.649381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3e28-9ae9-4176-942f-9c2fb5bae1e0 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.678377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3747/7505] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/services/1fdec245efd54a50854c83996f4d9923 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.683625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:43.779579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705268d-4238-4648-b7be-3c003d4b1809 tempest-EndpointsNegativeTestJSON-1070979488 tempest-EndpointsNegativeTestJSON-1070979488-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:43.798066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:43.799052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.799377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.800068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] PATH_INFO: `/v3/users/6d7cb96e3c7f4337a648ee813a6c7d62` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.802304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7cb96e3c7f4337a648ee813a6c7d62)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:43.808746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:43.873604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7cb96e3c7f4337a648ee813a6c7d62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.874988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7cb96e3c7f4337a648ee813a6c7d62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.884134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7cb96e3c7f4337a648ee813a6c7d62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.899103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7cb96e3c7f4337a648ee813a6c7d62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.906357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7cb96e3c7f4337a648ee813a6c7d62'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:43.912692 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3759/7506] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:43 2022] DELETE /identity/v3/users/6d7cb96e3c7f4337a648ee813a6c7d62 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:43.917491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:43.917798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:43.918100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:43.939867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:43.941370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:44.040834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3748/7507] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:44.053463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:44.056817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:44.105194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:44.145296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84225-a97e-40a4-86db-e2f485708da3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:44.150269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:44.151008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:44.151502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:44.151886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:44.171968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:44.176681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:44.189637 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3760/7508] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:44.513159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:44.514472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:44.530226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ff07-10ba-4b6f-9762-aa8b83cd0b7e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:44.535821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:44.536997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:44.537446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:44.537902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] PATH_INFO: `/v3/projects/f093d997b3db42e89638a3a1bb5054c8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:44.539275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f093d997b3db42e89638a3a1bb5054c8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:44.541544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:44.598668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f093d997b3db42e89638a3a1bb5054c8', 'request_id': 'req-4c03ec9a-685e-46d9-9d96-88763366c240'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.607562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f093d997b3db42e89638a3a1bb5054c8', 'request_id': 'req-4c03ec9a-685e-46d9-9d96-88763366c240'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.619472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f093d997b3db42e89638a3a1bb5054c8', 'request_id': 'req-4c03ec9a-685e-46d9-9d96-88763366c240'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.632336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] The token cache is being invalidate because project f093d997b3db42e89638a3a1bb5054c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:44.632969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.633926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.635568 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3749/7509] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:44 2022] DELETE /identity/v3/projects/f093d997b3db42e89638a3a1bb5054c8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:44.639608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:44.650933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e65ea-101f-4b9b-b48d-a84ed0c1b783 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:44.716773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:44.717996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:44.718374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:44.718778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] PATH_INFO: `/v3/users/107e58c6a0ae4859863660883fddc0f1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:44.720230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=107e58c6a0ae4859863660883fddc0f1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:44.722397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:44.776920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107e58c6a0ae4859863660883fddc0f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.778692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107e58c6a0ae4859863660883fddc0f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.791392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107e58c6a0ae4859863660883fddc0f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.805553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107e58c6a0ae4859863660883fddc0f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.817022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2d880a58-7ffa-4ccb-971b-8edfdbadbb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107e58c6a0ae4859863660883fddc0f1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:44.824812 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3761/7510] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:44 2022] DELETE /identity/v3/users/107e58c6a0ae4859863660883fddc0f1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:45.313639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.316788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:45.356961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:45.405888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ec9a-685e-46d9-9d96-88763366c240 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.465195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.466213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.466496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.466771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] PATH_INFO: `/v3/projects/c3c8ecd6e01f4bbda112235b9578782b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.468130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c8ecd6e01f4bbda112235b9578782b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.470266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.524542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c8ecd6e01f4bbda112235b9578782b', 'request_id': 'req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:45.535571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c8ecd6e01f4bbda112235b9578782b', 'request_id': 'req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:45.553293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c8ecd6e01f4bbda112235b9578782b', 'request_id': 'req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:45.567035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] The token cache is being invalidate because project c3c8ecd6e01f4bbda112235b9578782b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:45.567332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:45.568005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ec4c475f-abe1-473d-bc28-fb01bf8a81d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:45.569608 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3750/7511] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:45 2022] DELETE /identity/v3/projects/c3c8ecd6e01f4bbda112235b9578782b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:45.574971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.575467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.575593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.596191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:45.597786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:45.649966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:45.674302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3762/7512] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:21:45.682240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.682834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.683117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.701692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:45.703009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:45.711860 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3751/7513] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:45.716219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.727061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb430e09-d57f-483b-94f0-3adb3bb98aca None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.731898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.732681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.733001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.733345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.734084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:45.734397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.736080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.748817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3763/7514] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:45.753300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.762772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292021ba-da5f-441b-be59-74d1457dd697 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.767661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.768328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.768648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.768928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.769619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.771544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.798979 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3752/7515] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:45 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:45.803249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.815134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6680c-a8cc-453b-8a76-7a83e590ff7d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.879427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.880113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.880564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.880845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.881542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.883461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.904586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3764/7516] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:45 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:45.908833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.921194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad029-8ff9-4ef5-b393-1fad1795bb16 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.926090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.926798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.927173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.927328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.928060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.929894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.944458 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3753/7517] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:21:45.946346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.958453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e74e2-1627-43fc-ac09-61db90920de0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.964005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:45.964807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:45.965116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:45.965395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:45.966124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:45.967923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ad143-7f7c-4887-87ce-f0f323c87234 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:45.979157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3765/7518] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:45.983061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:45.993879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258adc3-abcf-4003-baf4-31c2c4f69dc4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:45.999225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.000323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.000729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.001074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] PATH_INFO: `/v3/projects/d692ba8d72794af1a9b13604d9cb302e/users/3d81423871b6456e8b1ee5e75d106bac/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.018355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d692ba8d72794af1a9b13604d9cb302e, user_id=3d81423871b6456e8b1ee5e75d106bac, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.022202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.048481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3754/7519] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:45 2022] PUT /identity/v3/projects/d692ba8d72794af1a9b13604d9cb302e/users/3d81423871b6456e8b1ee5e75d106bac/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:46.057118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.057879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.058177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.085960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] MFA Rules not processed for user `3d81423871b6456e8b1ee5e75d106bac`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:46.087173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:46.165253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3766/7520] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:46.169984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.174604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:46.251806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c0cc-00f0-46a7-b0dc-8ecad25bedca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.257630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.258279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.258571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.258852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.259694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.261732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.301909 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3755/7521] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:46.303478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.315580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8cd84-ff1d-42cb-a96b-3b0cd6f090f8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.370848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:46.394312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.394943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.395229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.395509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.396207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.400241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.429452 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3767/7522] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:46.430757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.442125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201394c5-bd39-42e5-ac87-44dec2a0253a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.446910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.447601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.447877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.448151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.448914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.450658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.465749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3756/7523] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:46.467114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.478467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089360d8-93f4-4b35-85b6-95775da8ee22 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.483662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.484719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.485072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.485382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] PATH_INFO: `/v3/projects/fcc7e980faf345908f82e9c3dfba0762/users/4edefff202264aba99ff0c1666043d92/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.502648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc7e980faf345908f82e9c3dfba0762, user_id=4edefff202264aba99ff0c1666043d92, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.505487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.519817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3768/7524] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:46 2022] PUT /identity/v3/projects/fcc7e980faf345908f82e9c3dfba0762/users/4edefff202264aba99ff0c1666043d92/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:46.524455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.536009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3201-bc7a-44f6-b538-405cfacffac4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.613859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.617362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.618018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.618398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.619248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.621036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd1847-1f72-4e99-84d7-87d41116ebb8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.637320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.644531 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3757/7525] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:46.649043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16efd0-e8e5-476a-b36d-ffe2b78e64c3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.654100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.655206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.655561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.655944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] PATH_INFO: `/v3/projects/fcc7e980faf345908f82e9c3dfba0762/users/4edefff202264aba99ff0c1666043d92/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.658125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc7e980faf345908f82e9c3dfba0762, user_id=4edefff202264aba99ff0c1666043d92, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.661098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.673857 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3769/7526] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:46 2022] PUT /identity/v3/projects/fcc7e980faf345908f82e9c3dfba0762/users/4edefff202264aba99ff0c1666043d92/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:46.684460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.684743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.685033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.721467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] MFA Rules not processed for user `4edefff202264aba99ff0c1666043d92`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:46.723075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:46.793111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:46.800583 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3758/7527] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:46.808489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.825159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d9e77-6000-4865-9245-46ce0436b8db admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.833275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.835262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.835262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.835262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.835262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.836977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:46.858633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3770/7528] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/domains => generated 275 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:46.864414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:46.882138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eed9f-2729-4257-8cb1-c41a798ef4d9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:46.946512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:46.947192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:46.947479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:46.947757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:46.948600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:46.950440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.159515 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3759/7529] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:46 2022] POST /identity/v3/projects => generated 401 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:47.161110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.173710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef377c0-2fe9-420a-95de-54863767dc2c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.265201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.266685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.267189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.267638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.268607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.270917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.298811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.299691 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3771/7530] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:21:47 2022] POST /identity/v3/groups => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:47.314387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f425c0-f445-4788-9fc9-802a8d79ecf8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.322873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.323711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.323988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.324276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.325032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.327870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.351902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3760/7531] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:47 2022] POST /identity/v3/users => generated 445 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:47.357214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.371446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b53b-ae12-4e81-9166-af62a3da0f12 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.376864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.377540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.377816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.378095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.378848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.380551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.400627 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3772/7532] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:47 2022] POST /identity/v3/roles => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:47.405506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.422248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48976-e0b2-4878-bf86-47d13a3c2f38 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.430233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.431915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.432526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.432947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.446183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=2bdaa2e28b2a4a8e9a529427fbc5fcc9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.449446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.478383 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3761/7533] 10.222.0.39 () {60 vars in 1584 bytes} [Sat Jun 25 21:21:47 2022] PUT /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:47.483973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.501054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54832c9e-850b-4bb4-85f1-1502a6d74c5e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.567377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.568707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.569096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.569651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.573392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=2bdaa2e28b2a4a8e9a529427fbc5fcc9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.576450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.582015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:47.590136 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3773/7534] 10.222.0.39 () {58 vars in 1566 bytes} [Sat Jun 25 21:21:47 2022] HEAD /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:47.595508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.609212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e569-b82b-46c2-912a-c22f6dc5cc7a tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.616753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.617831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.618269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.618848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.621394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=2bdaa2e28b2a4a8e9a529427fbc5fcc9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.625368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.634378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 2bdaa2e28b2a4a8e9a529427fbc5fcc9 was removed from group f7ae64bec57344c3b1ffcc90badf8e44 on project 6140819bb4dc44289b3124b9bf0152ed. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:47.635147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:47.636182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:47.659493 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3762/7535] 10.222.0.39 () {58 vars in 1568 bytes} [Sat Jun 25 21:21:47 2022] DELETE /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9/inherited_to_projects => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:47.661371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.663485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:47.685075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b0b2-ad61-47d1-a720-e89e45cfada3 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.768628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.769670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.770052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.770425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.772035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2bdaa2e28b2a4a8e9a529427fbc5fcc9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.773811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.820656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 2bdaa2e28b2a4a8e9a529427fbc5fcc9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:47.821351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:47.822409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:47.831165 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3774/7536] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:47 2022] DELETE /identity/v3/roles/2bdaa2e28b2a4a8e9a529427fbc5fcc9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:47.832576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.846439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2753a6-5998-48cf-893a-44eca43ad128 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.916209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.916935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.917225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.917505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.918270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.920132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:47.940728 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3763/7537] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:47 2022] POST /identity/v3/roles => generated 240 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:47.944823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:47.946668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:47.964357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024cb0-538d-48b6-8f3b-a555bbca0333 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:47.970922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:47.971822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:47.972110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:47.972386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:47.993430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=40811f43a07a4eda8fdcd524c036399e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:47.996489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.020410 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3775/7538] 10.222.0.39 () {60 vars in 1581 bytes} [Sat Jun 25 21:21:47 2022] PUT /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.023346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.034729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e156-26f7-4ca3-b04c-7fbfaf7a810c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.046409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:48.101365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.102302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.102674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.103002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.105553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=40811f43a07a4eda8fdcd524c036399e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.108382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.115206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3764/7539] 10.222.0.39 () {58 vars in 1563 bytes} [Sat Jun 25 21:21:48 2022] HEAD /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.119550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.132364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13dd88-a03c-4d7e-9c08-adba4e47a02c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.138779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.139873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.140010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.140258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.143243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=40811f43a07a4eda8fdcd524c036399e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.146052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.151940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 40811f43a07a4eda8fdcd524c036399e was removed from user f508cdeebeb1496cb7c73c45ad251cf1 on project 6140819bb4dc44289b3124b9bf0152ed. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:48.152236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.153043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.172760 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3776/7540] 10.222.0.39 () {58 vars in 1565 bytes} [Sat Jun 25 21:21:48 2022] DELETE /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/40811f43a07a4eda8fdcd524c036399e/inherited_to_projects => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:48.175697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.178146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:48.193039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79601c9e-429f-44f1-9e7f-5fd61e300f75 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.263919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.264847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.265258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.265548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/40811f43a07a4eda8fdcd524c036399e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.267937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=40811f43a07a4eda8fdcd524c036399e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.270596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.316634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 40811f43a07a4eda8fdcd524c036399e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:48.316992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.317898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.321498 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3765/7541] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:48 2022] DELETE /identity/v3/roles/40811f43a07a4eda8fdcd524c036399e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.326860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.340975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5c35-8dcf-4e9a-a522-66651b2d9974 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.439903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.440726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.441012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.441287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.442044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.443897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.460912 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3777/7542] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:48 2022] POST /identity/v3/roles => generated 239 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:48.465161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.467135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:48.480739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e927-a1b5-4657-9398-91ac9a71616f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.485608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.487236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.487591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.487953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.490265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=a955dea093b343d3b32a6f2344c0015e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.493153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.510221 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3766/7543] 10.222.0.39 () {60 vars in 1581 bytes} [Sat Jun 25 21:21:48 2022] PUT /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.516668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.527897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00bb4-3d8f-4446-8961-4c3a20c051ae tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.543640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:48.616097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.616963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.617290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.617663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.619510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=ee7c73fff14544e38b732af4fddcda3f, group_id=f7ae64bec57344c3b1ffcc90badf8e44)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.622109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.640645 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3778/7544] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Jun 25 21:21:48 2022] GET /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/inherited_to_projects => generated 447 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:48.645003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.655830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6b22-8fc4-4cc6-8e23-9b541a7c8346 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.661116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.662045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.662421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.662779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.665225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=a955dea093b343d3b32a6f2344c0015e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.668006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.675480 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3767/7545] 10.222.0.39 () {58 vars in 1563 bytes} [Sat Jun 25 21:21:48 2022] HEAD /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.679874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.691219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770fc66-73d9-49e6-82eb-e277da5fc4a7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.696779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.697760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.698154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.698544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.701144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, group_id=f7ae64bec57344c3b1ffcc90badf8e44, role_id=a955dea093b343d3b32a6f2344c0015e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.705155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.712145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role a955dea093b343d3b32a6f2344c0015e was removed from group f7ae64bec57344c3b1ffcc90badf8e44 on domain ee7c73fff14544e38b732af4fddcda3f. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:48.712490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.713241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.736839 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3779/7546] 10.222.0.39 () {58 vars in 1565 bytes} [Sat Jun 25 21:21:48 2022] DELETE /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/groups/f7ae64bec57344c3b1ffcc90badf8e44/roles/a955dea093b343d3b32a6f2344c0015e/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.740859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.744190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:48.758833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc0a1-97bb-4ed5-bacd-0d38448c5fd7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:48.864993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:48.874959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:48.881115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:48.883180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:48.883510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/a955dea093b343d3b32a6f2344c0015e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:48.886206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a955dea093b343d3b32a6f2344c0015e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:48.888626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:48.940667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role a955dea093b343d3b32a6f2344c0015e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:48.941042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.941717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:48.945335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3768/7547] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:48 2022] DELETE /identity/v3/roles/a955dea093b343d3b32a6f2344c0015e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:48.950152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:48.974691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2ad6-19ec-4c17-9f05-828a5aefe0d8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.104651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.105816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.106705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.107313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.108539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.110351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.135403 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3780/7548] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:48 2022] POST /identity/v3/roles => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:49.139329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.140838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:49.154982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac957-5779-467b-866e-36a047f2f7c6 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.161138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.162375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.163028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.163564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.166683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=1be3fd9010db4bed9ed2ec278a783026)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.170040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.188971 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3769/7549] 10.222.0.39 () {60 vars in 1578 bytes} [Sat Jun 25 21:21:49 2022] PUT /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:49.192970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.208282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee390fc6-d36d-40ec-ae08-04957d003b1c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.292290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.293253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.293609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.293954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.295935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.298717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.314269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3781/7550] 10.222.0.39 () {58 vars in 1460 bytes} [Sat Jun 25 21:21:49 2022] GET /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/inherited_to_projects => generated 447 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:21:49.315826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.326814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa8268-4ec7-4721-8d96-7b82f45bd458 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.332974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.336246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.336246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.336246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.336743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=1be3fd9010db4bed9ed2ec278a783026)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.339561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.345982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3770/7551] 10.222.0.39 () {58 vars in 1560 bytes} [Sat Jun 25 21:21:49 2022] HEAD /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:49.350183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.360460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3d350-0044-498d-ad7d-408dd50ebd59 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.365943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.366838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.367124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.367403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.369674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=1be3fd9010db4bed9ed2ec278a783026)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.372620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.377962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 1be3fd9010db4bed9ed2ec278a783026 was removed from user f508cdeebeb1496cb7c73c45ad251cf1 on domain ee7c73fff14544e38b732af4fddcda3f. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:49.378254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:49.378978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:49.389407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:49.394662 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3782/7552] 10.222.0.39 () {58 vars in 1562 bytes} [Sat Jun 25 21:21:49 2022] DELETE /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/1be3fd9010db4bed9ed2ec278a783026/inherited_to_projects => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:49.398673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.400839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:49.414835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da477690-3f5d-4782-9898-074bbc11fb25 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.485227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.486561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.486685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.487049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/1be3fd9010db4bed9ed2ec278a783026` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.489019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1be3fd9010db4bed9ed2ec278a783026)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.491112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.536793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 1be3fd9010db4bed9ed2ec278a783026 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:49.537101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:49.538072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:49.540460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3771/7553] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:49 2022] DELETE /identity/v3/roles/1be3fd9010db4bed9ed2ec278a783026 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:49.545775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.557604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98744c-ff23-49af-a66b-b8b88cc37b09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.644915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.645668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.645965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.646253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.647020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.648680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.670466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3783/7554] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:49 2022] POST /identity/v3/roles => generated 239 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:49.674656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.676308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:49.695555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f22643-6439-4dfe-9d43-ca1c3234679c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.702870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.704310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.704654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.705146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.705680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.707967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.763731 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3772/7555] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:49 2022] POST /identity/v3/projects => generated 409 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:49.764315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.791558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48413429-030a-4df1-8f08-f22c9122fc7e tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.889988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:49.890921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:49.891203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:49.891477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/37058629b6894d65893cdf4267b146d0/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:49.893861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=37058629b6894d65893cdf4267b146d0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:49.897000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:49.914187 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3784/7556] 10.222.0.39 () {60 vars in 1578 bytes} [Sat Jun 25 21:21:49 2022] PUT /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/37058629b6894d65893cdf4267b146d0/inherited_to_projects => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:49.919767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:49.937479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffcffb-9b37-47d7-b67e-80017d1640bb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:49.990300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:50.030719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.031408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.031695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.031974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.032854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=6140819bb4dc44289b3124b9bf0152ed, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:50.033172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.035112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.088843 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3773/7557] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:49 2022] GET /identity/v3/role_assignments?scope.project.id=6140819bb4dc44289b3124b9bf0152ed&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 648 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:50.092909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.105383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a40df8-9a81-4b8c-bd51-f192c4fcae56 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.112756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.113942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.114434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.114919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.116017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=48d3d03903fb4cc099632be456d5c1d5, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:50.116840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.119187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.209832 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3785/7558] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:50 2022] GET /identity/v3/role_assignments?scope.project.id=48d3d03903fb4cc099632be456d5c1d5&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 648 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:50.211045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.221928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e1e0c-4cc4-460e-80eb-d377020f9cd8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.227148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.228036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.228323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.228761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/37058629b6894d65893cdf4267b146d0/inherited_to_projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.231023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ee7c73fff14544e38b732af4fddcda3f, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=37058629b6894d65893cdf4267b146d0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.234190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.242393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 37058629b6894d65893cdf4267b146d0 was removed from user f508cdeebeb1496cb7c73c45ad251cf1 on domain ee7c73fff14544e38b732af4fddcda3f. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:50.243305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.243617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.259788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3774/7559] 10.222.0.39 () {58 vars in 1562 bytes} [Sat Jun 25 21:21:50 2022] DELETE /identity/v3/OS-INHERIT/domains/ee7c73fff14544e38b732af4fddcda3f/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/37058629b6894d65893cdf4267b146d0/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:50.265131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.274081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:50.294398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5d736-bfca-4fd4-adc5-470bb63ead50 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.337221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:50.385597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.386390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.386687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.386975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.387864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=6140819bb4dc44289b3124b9bf0152ed, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:50.388183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.390325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.443404 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3786/7560] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:50 2022] GET /identity/v3/role_assignments?scope.project.id=6140819bb4dc44289b3124b9bf0152ed&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 228 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:50.447249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.458537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151a76-2211-4a12-97f5-f726e4068c0f tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.463608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.464458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.464753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.465037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.465859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=48d3d03903fb4cc099632be456d5c1d5, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:50.466173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.468377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.528524 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3775/7561] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:50 2022] GET /identity/v3/role_assignments?scope.project.id=48d3d03903fb4cc099632be456d5c1d5&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 228 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:50.532505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.552045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1c4f-010b-45ef-be89-b2dc3a704deb tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.556878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.557765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.558050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.558328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects/48d3d03903fb4cc099632be456d5c1d5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.559534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48d3d03903fb4cc099632be456d5c1d5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.561677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.611154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d3d03903fb4cc099632be456d5c1d5', 'request_id': 'req-a0c5cd04-bdc8-4600-aac1-982112d471e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.621047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d3d03903fb4cc099632be456d5c1d5', 'request_id': 'req-a0c5cd04-bdc8-4600-aac1-982112d471e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.626683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d3d03903fb4cc099632be456d5c1d5', 'request_id': 'req-a0c5cd04-bdc8-4600-aac1-982112d471e8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.638058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] The token cache is being invalidate because project 48d3d03903fb4cc099632be456d5c1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:50.638356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.639774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.644564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3787/7562] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:50 2022] DELETE /identity/v3/projects/48d3d03903fb4cc099632be456d5c1d5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:50.645822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.648275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:50.664162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162b419-7dca-46a4-b594-1d8c503efdbe tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.730738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.731624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.732008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.732293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/37058629b6894d65893cdf4267b146d0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.733932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=37058629b6894d65893cdf4267b146d0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.735639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.763414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:50.782914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 37058629b6894d65893cdf4267b146d0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:50.783215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.783893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:50.786111 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3776/7563] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:50 2022] DELETE /identity/v3/roles/37058629b6894d65893cdf4267b146d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:50.791053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.803897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5cd04-bdc8-4600-aac1-982112d471e8 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.929043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.929851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.929851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.930055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.930762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.932616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:50.955824 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3788/7564] 10.222.0.39 () {60 vars in 1142 bytes} [Sat Jun 25 21:21:50 2022] POST /identity/v3/roles => generated 239 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:50.959955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:50.962410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:50.978559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835f61f-5560-46c0-a4ef-8e52e8dd488c tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:50.984447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:50.985270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:50.985558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:50.985836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:50.986537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:50.988545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.025651 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3777/7565] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:50 2022] POST /identity/v3/projects => generated 409 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:51.030109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.042279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592993a-85e0-4afc-b33e-b6a1e20fa7af tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.052826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:51.111980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.113442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.113731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.114405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/44bb2324e580403398a711cab877866f/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.118219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=44bb2324e580403398a711cab877866f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.121084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.145091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3789/7566] 10.222.0.39 () {60 vars in 1581 bytes} [Sat Jun 25 21:21:51 2022] PUT /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/44bb2324e580403398a711cab877866f/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:51.146358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.158312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313b5c6-6b06-48e5-9850-1cb24c506941 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.233887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.234665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.235032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.235379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.236277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=65a785b1603245cfa37a83dc169fa7a5, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:51.236696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.238632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.303621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3778/7567] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:51 2022] GET /identity/v3/role_assignments?scope.project.id=65a785b1603245cfa37a83dc169fa7a5&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 649 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:51.303875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.313526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970fac9-e690-4c47-8d48-4393eba07624 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.319653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.320675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.320943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.321555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/44bb2324e580403398a711cab877866f/inherited_to_projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.323931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6140819bb4dc44289b3124b9bf0152ed, user_id=f508cdeebeb1496cb7c73c45ad251cf1, role_id=44bb2324e580403398a711cab877866f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.326670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.333284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 44bb2324e580403398a711cab877866f was removed from user f508cdeebeb1496cb7c73c45ad251cf1 on project 6140819bb4dc44289b3124b9bf0152ed. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:51.333578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.334453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.355727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3790/7568] 10.222.0.39 () {58 vars in 1565 bytes} [Sat Jun 25 21:21:51 2022] DELETE /identity/v3/OS-INHERIT/projects/6140819bb4dc44289b3124b9bf0152ed/users/f508cdeebeb1496cb7c73c45ad251cf1/roles/44bb2324e580403398a711cab877866f/inherited_to_projects => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:51.359981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.361737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:51.375540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49222-2f9c-4ba4-abcb-27c68d071a09 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.435367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.436183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.437308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.437600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.438430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Adding query filter params (scope.project.id=65a785b1603245cfa37a83dc169fa7a5, user.id=f508cdeebeb1496cb7c73c45ad251cf1) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:51.438741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.440648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.469406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:51.524229 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3779/7569] 10.222.0.39 () {58 vars in 1355 bytes} [Sat Jun 25 21:21:51 2022] GET /identity/v3/role_assignments?scope.project.id=65a785b1603245cfa37a83dc169fa7a5&user.id=f508cdeebeb1496cb7c73c45ad251cf1&effective => generated 228 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:51.528679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.545912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9d7-23b3-4a4d-aa83-fc73d2cc6d9b tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.552506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.553397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.553681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.553960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects/65a785b1603245cfa37a83dc169fa7a5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.555624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65a785b1603245cfa37a83dc169fa7a5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.557348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.653185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a785b1603245cfa37a83dc169fa7a5', 'request_id': 'req-1b00f6a6-77d1-485c-ac1c-5116bda9d553'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.669023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a785b1603245cfa37a83dc169fa7a5', 'request_id': 'req-1b00f6a6-77d1-485c-ac1c-5116bda9d553'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.679467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a785b1603245cfa37a83dc169fa7a5', 'request_id': 'req-1b00f6a6-77d1-485c-ac1c-5116bda9d553'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.694975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] The token cache is being invalidate because project 65a785b1603245cfa37a83dc169fa7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:51.695802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.704757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.707657 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3791/7570] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:51 2022] DELETE /identity/v3/projects/65a785b1603245cfa37a83dc169fa7a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:51.713462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.715310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:51.737999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bb644-a02a-4a24-bdbd-5569e169d673 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.739853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.741317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:51.880263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.882330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.882625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.883206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/roles/44bb2324e580403398a711cab877866f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.884946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=44bb2324e580403398a711cab877866f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:51.886608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:51.910249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f6a6-77d1-485c-ac1c-5116bda9d553 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:51.916650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:51.917377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:51.917665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:51.917943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:51.920401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:51.941772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:51.973636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invalidating the token cache because role 44bb2324e580403398a711cab877866f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:51.973990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.974828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:51.980538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3780/7571] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:51 2022] DELETE /identity/v3/roles/44bb2324e580403398a711cab877866f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:51.988374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:51.991755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:52.038757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.040903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.070746 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3792/7572] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:21:52.084776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3b2c5-b80b-4b3d-9bbb-647a14c6c677 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:52.089975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:52.091005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:52.091355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:52.091711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/users/f508cdeebeb1496cb7c73c45ad251cf1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:52.093273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f508cdeebeb1496cb7c73c45ad251cf1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.095318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.149804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:52.156708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f508cdeebeb1496cb7c73c45ad251cf1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.167937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f508cdeebeb1496cb7c73c45ad251cf1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.185236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f508cdeebeb1496cb7c73c45ad251cf1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.186249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f508cdeebeb1496cb7c73c45ad251cf1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.187083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f508cdeebeb1496cb7c73c45ad251cf1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.204796 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3781/7573] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:51 2022] DELETE /identity/v3/users/f508cdeebeb1496cb7c73c45ad251cf1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:52.205800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:52.219937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1f98-4f58-4692-a237-564c190e5d8e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:52.295432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:52.296541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:52.296915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:52.297024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/groups/f7ae64bec57344c3b1ffcc90badf8e44` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:52.298288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f7ae64bec57344c3b1ffcc90badf8e44)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.301167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.370568 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3793/7574] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:21:52 2022] DELETE /identity/v3/groups/f7ae64bec57344c3b1ffcc90badf8e44 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:21:52.374773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:52.381873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:52.407429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66c65-dd7c-4150-b6b6-a0dbaeb1c385 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:52.489972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:52.491453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:52.492724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:52.493242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/projects/6140819bb4dc44289b3124b9bf0152ed` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:52.495591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6140819bb4dc44289b3124b9bf0152ed)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.498863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.558769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6140819bb4dc44289b3124b9bf0152ed', 'request_id': 'req-09b74a4a-f97e-476e-ba77-01e9395a63ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.568959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6140819bb4dc44289b3124b9bf0152ed', 'request_id': 'req-09b74a4a-f97e-476e-ba77-01e9395a63ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.576708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6140819bb4dc44289b3124b9bf0152ed', 'request_id': 'req-09b74a4a-f97e-476e-ba77-01e9395a63ac'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.590530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] The token cache is being invalidate because project 6140819bb4dc44289b3124b9bf0152ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:52.590530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.591251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.593222 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3782/7575] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:52 2022] DELETE /identity/v3/projects/6140819bb4dc44289b3124b9bf0152ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:52.597809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:52.599755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:52.614314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308030d-e869-4242-9b14-15507d56a2dd tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:52.679599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:52.707555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:52.708542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:52.708840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:52.709127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/domains/ee7c73fff14544e38b732af4fddcda3f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:52.710617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ee7c73fff14544e38b732af4fddcda3f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.712918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.747622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.748518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.777367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.778071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.783143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3794/7576] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:21:52 2022] PATCH /identity/v3/domains/ee7c73fff14544e38b732af4fddcda3f => generated 276 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:21:52.787262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:52.798017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74a4a-f97e-476e-ba77-01e9395a63ac tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:52.883240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:52.904778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edefff202264aba99ff0c1666043d92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc7e980faf345908f82e9c3dfba0762', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:52.905928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:52.906211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:52.906520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] PATH_INFO: `/v3/domains/ee7c73fff14544e38b732af4fddcda3f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:52.925614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ee7c73fff14544e38b732af4fddcda3f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:52.927379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:52.956765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:52.960530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.020079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.032037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.040580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.057693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] The token cache is being invalidate because project ee7c73fff14544e38b732af4fddcda3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:53.058257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.059306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.067186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.070937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.071279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e0d47118-52f8-478b-9780-33b3a1da29b7 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ee7c73fff14544e38b732af4fddcda3f', 'request_id': 'req-e0d47118-52f8-478b-9780-33b3a1da29b7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.078732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3783/7577] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:21:52 2022] DELETE /identity/v3/domains/ee7c73fff14544e38b732af4fddcda3f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:53.083279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:53.085654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:53.163755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61688-8655-4cd5-b876-d1f0708a54f5 tempest-InheritsV3TestJSON-676460551 tempest-InheritsV3TestJSON-676460551-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:53.245802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:53.246491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:53.246828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:53.247112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] PATH_INFO: `/v3/users/3d81423871b6456e8b1ee5e75d106bac` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:53.248894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d81423871b6456e8b1ee5e75d106bac)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:53.251229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:53.319710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d81423871b6456e8b1ee5e75d106bac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.320446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d81423871b6456e8b1ee5e75d106bac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.330728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d81423871b6456e8b1ee5e75d106bac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.338984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:53.345525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d81423871b6456e8b1ee5e75d106bac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.360473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d81423871b6456e8b1ee5e75d106bac'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:53.384103 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3795/7578] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:53 2022] DELETE /identity/v3/users/3d81423871b6456e8b1ee5e75d106bac => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:53.388459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:53.388745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:53.389439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:53.412881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:53.414451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:53.502618 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3784/7579] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:53.512949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:53.514857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:53.670965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677961c-d925-4229-8f33-85e4364bc57b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:53.676353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:53.678925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:53.679237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:53.679567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:53.694001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:53.696142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:53.718942 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3796/7580] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:54.219799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:54.221577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:54.235658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd530b-a619-43f0-bf2a-d78bd816b4b8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:54.241487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:54.242487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:54.242911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:54.243193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] PATH_INFO: `/v3/projects/d692ba8d72794af1a9b13604d9cb302e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:54.244835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d692ba8d72794af1a9b13604d9cb302e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:54.246987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:54.279616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:54.311675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd692ba8d72794af1a9b13604d9cb302e', 'request_id': 'req-814a396b-c2c7-492c-9851-f6cd66c64054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.324225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd692ba8d72794af1a9b13604d9cb302e', 'request_id': 'req-814a396b-c2c7-492c-9851-f6cd66c64054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.333129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd692ba8d72794af1a9b13604d9cb302e', 'request_id': 'req-814a396b-c2c7-492c-9851-f6cd66c64054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.347420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] The token cache is being invalidate because project d692ba8d72794af1a9b13604d9cb302e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:54.347838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.348525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.351630 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3785/7581] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:54 2022] DELETE /identity/v3/projects/d692ba8d72794af1a9b13604d9cb302e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:54.355841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:54.366222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb85d0-8563-456b-b254-3024456b71ab service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:54.427550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:54.428563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:54.428912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:54.429369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] PATH_INFO: `/v3/users/4edefff202264aba99ff0c1666043d92` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:54.431186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edefff202264aba99ff0c1666043d92)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:54.433573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:54.501349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edefff202264aba99ff0c1666043d92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.502263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edefff202264aba99ff0c1666043d92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.513130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edefff202264aba99ff0c1666043d92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.533066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edefff202264aba99ff0c1666043d92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.541116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3b20e2c7-2d2e-411c-9b13-a3a66977b885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edefff202264aba99ff0c1666043d92'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:54.548677 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3797/7582] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:54 2022] DELETE /identity/v3/users/4edefff202264aba99ff0c1666043d92 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:55.041273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.044219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:55.064068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a396b-c2c7-492c-9851-f6cd66c64054 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.138477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.139462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.139752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.140074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] PATH_INFO: `/v3/projects/fcc7e980faf345908f82e9c3dfba0762` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.141358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc7e980faf345908f82e9c3dfba0762)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.143307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.212643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc7e980faf345908f82e9c3dfba0762', 'request_id': 'req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:55.223593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc7e980faf345908f82e9c3dfba0762', 'request_id': 'req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:55.230456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc7e980faf345908f82e9c3dfba0762', 'request_id': 'req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:55.245991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] The token cache is being invalidate because project fcc7e980faf345908f82e9c3dfba0762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:55.246928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:55.247642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7aba098d-b15a-4871-b7c0-4c4bbe0d33e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:55.249745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3786/7583] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:55 2022] DELETE /identity/v3/projects/fcc7e980faf345908f82e9c3dfba0762 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:55.256580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.257010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.257383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.265241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:55.292714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:55.294412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:55.375574 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3798/7584] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:55.379145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.379965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.380439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.408778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:55.411019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:55.425522 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3787/7585] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:21:55.429631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.442747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13504381-7716-40dc-9884-f5f3cf1671d1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.449679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.450750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.451769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.451769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.461141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:21:55.461470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.463476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.485278 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3799/7586] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:21:55.489562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.506953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e557512-b45f-4259-9ff0-aa6d69282870 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.512946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.513914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.514394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.515831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.516763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.518921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.551607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3788/7587] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:55 2022] POST /identity/v3/projects => generated 395 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:55.555754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.567898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f08cd-0b37-49f9-9815-87bad2d6efd5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.642532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.643229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.643514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.643885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.644522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.646477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.705974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.706493 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3800/7588] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:55 2022] POST /identity/v3/users => generated 304 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:55.718347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cdf40-e8ea-4357-b9a8-f6b5cf0171cf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.723194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.724108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.724452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.727844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.729050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.731097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.738278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:55.750124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.751528 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3789/7589] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:55.771260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f338b26-a715-466a-91ae-c1ca016644d0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.777438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.778472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.778753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.779028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] PATH_INFO: `/v3/projects/ff80482d9e194770a401f57c912ea572/users/b937658ab31e482da3b8160f5b8ff054/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.800041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff80482d9e194770a401f57c912ea572, user_id=b937658ab31e482da3b8160f5b8ff054, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.804558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.835902 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3801/7590] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:55 2022] PUT /identity/v3/projects/ff80482d9e194770a401f57c912ea572/users/b937658ab31e482da3b8160f5b8ff054/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:55.837352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.854823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b338cd5-104d-4b9a-acfd-3970d408c4bf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.916946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.917541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.917826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.918102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.918827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.920991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74aa14-3bc7-4394-9fcd-a6edda068215 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.932026 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3790/7591] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:55.937478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:55.957170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac390c3-e6ba-4f18-bf8a-660a25ddd36f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:55.967423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:55.968559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:55.968947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:55.969342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] PATH_INFO: `/v3/projects/ff80482d9e194770a401f57c912ea572/users/b937658ab31e482da3b8160f5b8ff054/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:55.972178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff80482d9e194770a401f57c912ea572, user_id=b937658ab31e482da3b8160f5b8ff054, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:55.975877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:55.989366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3802/7592] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:55 2022] PUT /identity/v3/projects/ff80482d9e194770a401f57c912ea572/users/b937658ab31e482da3b8160f5b8ff054/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:56.000348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.000761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.001257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.033277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] MFA Rules not processed for user `b937658ab31e482da3b8160f5b8ff054`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:56.034562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:56.117819 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3791/7593] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:56.122929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.176904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:56.211460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ecb20-d3b0-4112-abec-0ab2408ef18a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.217187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.217880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.218166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.218488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.219142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.221571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.261081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3803/7594] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:21:56 2022] POST /identity/v3/projects => generated 397 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:21:56.262075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.277675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432a13-747e-4144-b330-5c7e2a00a8e5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.342773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.351750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.352125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.352411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.353557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.355175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.383656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3792/7595] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:21:56 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:21:56.388223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.399462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdd56f-50cf-4774-a92e-e7d42c3956ea admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.405713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.406558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.406938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.407313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.408184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.410273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.425230 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3804/7596] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:56.426723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.437432 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413670-293e-4ecc-af43-0c6aca58178e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.443015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.443228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.443468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.443746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.444514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.446162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a216f-85f3-4912-b485-dd69f46b9770 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.452841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:56.461942 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3793/7597] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:21:56.463299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.474675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe463af-8bba-4cab-90d6-decfe5433093 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.479974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.481395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.481839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.482263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] PATH_INFO: `/v3/projects/ec70ab57360c4c0cb1b665934fc9df8d/users/3d219429105041e1ae40dba64bcd3018/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.508373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec70ab57360c4c0cb1b665934fc9df8d, user_id=3d219429105041e1ae40dba64bcd3018, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.511558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.531169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3805/7598] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:21:56 2022] PUT /identity/v3/projects/ec70ab57360c4c0cb1b665934fc9df8d/users/3d219429105041e1ae40dba64bcd3018/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:56.542307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.542831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.543118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.581292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] MFA Rules not processed for user `3d219429105041e1ae40dba64bcd3018`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:56.582577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:56.661185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3794/7599] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:56.674320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:56.676551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:56.786032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a90-f856-4a2b-a1cb-3b260a577429 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:56.789894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:56.790564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:56.790848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:56.791128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:56.888225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:56.890387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a7ef7-3ff5-410e-a263-ca2bff95f603 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:56.901171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3806/7600] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:57.383457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:57.587296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c9921-db5c-4b0c-812f-3f41f5851dc1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:57.604372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:57.605665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:57.606175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:57.606633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] PATH_INFO: `/v3/users/b937658ab31e482da3b8160f5b8ff054` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:57.608238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b937658ab31e482da3b8160f5b8ff054)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:57.610894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:57.710647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b937658ab31e482da3b8160f5b8ff054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:57.720840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b937658ab31e482da3b8160f5b8ff054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:57.743222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b937658ab31e482da3b8160f5b8ff054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:57.744167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b937658ab31e482da3b8160f5b8ff054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:57.746113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b937658ab31e482da3b8160f5b8ff054'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:57.773700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3795/7601] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:57 2022] DELETE /identity/v3/users/b937658ab31e482da3b8160f5b8ff054 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:57.778295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:57.779222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:57.780751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:57.811088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:21:57.820762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:57.837283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:57.930772 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3807/7602] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:21:57.957926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:57.959626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:57.975942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:58.080278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4490f-a408-4f7a-a518-17bca42b8d0d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:58.085852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:58.086625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:58.086984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:58.087332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:58.102068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:58.103478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:58.117983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3796/7603] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:21:58.641693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:58.643455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:58.671709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94f05d-4fb7-4a41-a157-52186345ef0a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:58.685954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:58.687039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:58.687734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:58.688409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] PATH_INFO: `/v3/projects/ff80482d9e194770a401f57c912ea572` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:58.691025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff80482d9e194770a401f57c912ea572)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:58.695688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:58.766090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff80482d9e194770a401f57c912ea572', 'request_id': 'req-d3028983-12d4-4dc3-aa62-f943c602f6cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:58.780913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff80482d9e194770a401f57c912ea572', 'request_id': 'req-d3028983-12d4-4dc3-aa62-f943c602f6cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:58.797800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff80482d9e194770a401f57c912ea572', 'request_id': 'req-d3028983-12d4-4dc3-aa62-f943c602f6cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:58.842940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] The token cache is being invalidate because project ff80482d9e194770a401f57c912ea572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:21:58.843177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:58.844031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:58.845818 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3808/7604] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:58 2022] DELETE /identity/v3/projects/ff80482d9e194770a401f57c912ea572 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:58.849934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:58.862830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b9ae-8e09-4aa6-8962-e527cbed3281 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:21:58.946200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:21:58.947559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:21:58.947848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:21:58.948122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] PATH_INFO: `/v3/users/3d219429105041e1ae40dba64bcd3018` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:21:58.949900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d219429105041e1ae40dba64bcd3018)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:21:58.952120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:21:59.033316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d219429105041e1ae40dba64bcd3018'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:59.043911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d219429105041e1ae40dba64bcd3018'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:59.068377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d219429105041e1ae40dba64bcd3018'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:59.069437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d219429105041e1ae40dba64bcd3018'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:59.069855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-133496c5-3fe6-4acc-b0e7-7c6fb37f5736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d219429105041e1ae40dba64bcd3018'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:21:59.092483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3797/7605] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:21:58 2022] DELETE /identity/v3/users/3d219429105041e1ae40dba64bcd3018 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:21:59.923586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:21:59.926140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:21:59.962902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028983-12d4-4dc3-aa62-f943c602f6cd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.059365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.060448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.061377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.061743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] PATH_INFO: `/v3/projects/ec70ab57360c4c0cb1b665934fc9df8d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.063436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec70ab57360c4c0cb1b665934fc9df8d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.066237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.145619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:00.153251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec70ab57360c4c0cb1b665934fc9df8d', 'request_id': 'req-42c0fb61-9547-4c40-b09a-3f99893a849b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:00.174069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec70ab57360c4c0cb1b665934fc9df8d', 'request_id': 'req-42c0fb61-9547-4c40-b09a-3f99893a849b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:00.185810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec70ab57360c4c0cb1b665934fc9df8d', 'request_id': 'req-42c0fb61-9547-4c40-b09a-3f99893a849b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:00.205691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] The token cache is being invalidate because project ec70ab57360c4c0cb1b665934fc9df8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:00.206100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:00.206937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-42c0fb61-9547-4c40-b09a-3f99893a849b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:00.212034 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3809/7606] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:21:59 2022] DELETE /identity/v3/projects/ec70ab57360c4c0cb1b665934fc9df8d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:00.214415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.214965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.215310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.238305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:00.239928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:00.258844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:00.347463 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3798/7607] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:00.353007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.353007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.353007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.372299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:00.374153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:00.382981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3810/7608] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:00.387499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.398110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76329-627c-4df8-8b3e-396c87437753 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.404874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.405592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.405856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.406144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.407150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:00.407458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.409135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.422167 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3799/7609] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:00.426796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.436316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951884d-f861-448b-a8b7-0fc43b461a36 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.441560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.442321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.442596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.442995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.443691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.445645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.477894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3811/7610] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:00.481815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.494836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f2e71-2110-4ed5-aea4-15fb69a8d937 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.566015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.567364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.567364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.567364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.568209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.570978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.597335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3800/7611] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:00.599551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.615616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef947740-eb2c-406c-b7c6-488ac6a281ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.622591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.623489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.623763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.624041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.624991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.626619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.638091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3812/7612] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:00.643519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.657008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7126fa-9f3f-4c70-ae8e-dc5027446999 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.662032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.662969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.663249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.663647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] PATH_INFO: `/v3/projects/11b73560b1fa4cc1b27bf43464760429/users/6e2ccf8110764ad28832972b878b01fa/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.680265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b73560b1fa4cc1b27bf43464760429, user_id=6e2ccf8110764ad28832972b878b01fa, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.683745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.697797 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3801/7613] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:00 2022] PUT /identity/v3/projects/11b73560b1fa4cc1b27bf43464760429/users/6e2ccf8110764ad28832972b878b01fa/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:00.701961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.713228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badcb10-f8c2-4e8c-a74a-9e57dcc3aa09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.773485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.774723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.774723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.775211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.776221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.778151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf895-ff41-46d1-8030-a106461e28b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.792837 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3813/7614] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:00.794460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:00.813890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26432a14-20ab-431f-adea-3fd77b33751e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:00.826320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:00.827249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.827540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.827808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] PATH_INFO: `/v3/projects/11b73560b1fa4cc1b27bf43464760429/users/6e2ccf8110764ad28832972b878b01fa/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.830634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b73560b1fa4cc1b27bf43464760429, user_id=6e2ccf8110764ad28832972b878b01fa, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:00.834622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:00.849004 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3802/7615] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:00 2022] PUT /identity/v3/projects/11b73560b1fa4cc1b27bf43464760429/users/6e2ccf8110764ad28832972b878b01fa/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:00.859360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:00.859671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:00.860221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:00.891850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] MFA Rules not processed for user `6e2ccf8110764ad28832972b878b01fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:00.893534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:00.980489 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3814/7616] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:00.984863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.079876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758cd23-c9eb-4edb-8503-aac46510a6b1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.090889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.091642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.092041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.092350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.093097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:01.095104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:01.109474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:01.150026 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3803/7617] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:00 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:01.150656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.163263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0252ffa-f966-4ff2-84dd-8fc7aec3956f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.183136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:01.281965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.283419 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.283718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.283995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.286383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:01.288361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:01.318467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3815/7618] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:01 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:01.322169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.335265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd82c61-f51c-4aa5-8a0e-96bf7d38da63 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.343607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.348553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.349555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.350703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.352624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:01.355067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:01.371214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3804/7619] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:01.375224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.395317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c7f0-26b1-4b46-82f1-0b8ee05476bb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.400933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.401726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.401899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.402184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.402927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:01.406054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a744-7f22-45da-9f14-f65258ac76a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:01.439102 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3816/7620] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:01.443721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.458368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ab340-9217-48dd-9765-dcba0e006bf9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.477017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.478070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.478469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.478843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] PATH_INFO: `/v3/projects/b43bd2b0760a4882ade6d1aba1b55436/users/a6ae3f7f7ab94e4ba8b0703a8c0286fc/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.530675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43bd2b0760a4882ade6d1aba1b55436, user_id=a6ae3f7f7ab94e4ba8b0703a8c0286fc, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:01.539177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:01.580806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3805/7621] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:01 2022] PUT /identity/v3/projects/b43bd2b0760a4882ade6d1aba1b55436/users/a6ae3f7f7ab94e4ba8b0703a8c0286fc/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:01.591168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.592288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.592763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:01.651258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] MFA Rules not processed for user `a6ae3f7f7ab94e4ba8b0703a8c0286fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:01.653433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:01.836056 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3817/7622] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:01.859352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:01.861181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:01.969883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c678-1751-473c-b9ae-07d54d44e813 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:01.974886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:01.975738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:01.976346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:01.976912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:02.082207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:02.083668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d10fb-0117-42ea-bbfb-d8fcd2afc387 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:02.116173 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3806/7623] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:02.391482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:02.490435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1efeb-0b96-4d4b-9e12-6e42535b76b6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:02.496695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:02.499710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:02.500168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:02.500969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] PATH_INFO: `/v3/users/6e2ccf8110764ad28832972b878b01fa` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:02.503994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2ccf8110764ad28832972b878b01fa)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:02.506314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:02.546441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:02.599374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2ccf8110764ad28832972b878b01fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:02.600377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2ccf8110764ad28832972b878b01fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:02.614521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2ccf8110764ad28832972b878b01fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:02.634464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2ccf8110764ad28832972b878b01fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:02.645999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2ccf8110764ad28832972b878b01fa'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:02.654671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3818/7624] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:02 2022] DELETE /identity/v3/users/6e2ccf8110764ad28832972b878b01fa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:02.659632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:02.660206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:02.660306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:02.680880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:02.682428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:02.768981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:02.791921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3807/7625] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:02.812880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:02.815019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:02.911915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e2108-dfc7-4ba1-8e55-b056466b123b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:02.916652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:02.917462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:02.917813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:02.918154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:02.930990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:02.932790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:02.945909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3819/7626] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:03.921834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:03.923516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:03.958850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be83f-f371-436b-ad91-3afd40f7d94d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:03.973389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:03.975234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:03.975529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:03.976762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] PATH_INFO: `/v3/projects/11b73560b1fa4cc1b27bf43464760429` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:03.979267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b73560b1fa4cc1b27bf43464760429)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:03.984867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:04.084505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b73560b1fa4cc1b27bf43464760429', 'request_id': 'req-099a114b-87b3-432a-8f1a-347771d93616'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.114394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b73560b1fa4cc1b27bf43464760429', 'request_id': 'req-099a114b-87b3-432a-8f1a-347771d93616'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.123545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b73560b1fa4cc1b27bf43464760429', 'request_id': 'req-099a114b-87b3-432a-8f1a-347771d93616'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.141268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] The token cache is being invalidate because project 11b73560b1fa4cc1b27bf43464760429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:04.141718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.143425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.146068 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3808/7627] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:03 2022] DELETE /identity/v3/projects/11b73560b1fa4cc1b27bf43464760429 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:04.151204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:04.168569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40296cc4-c1e8-4810-847b-4fba6eabb7f7 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:04.275996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:04.279917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:04.280396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:04.281728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] PATH_INFO: `/v3/users/a6ae3f7f7ab94e4ba8b0703a8c0286fc` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:04.284602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ae3f7f7ab94e4ba8b0703a8c0286fc)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:04.287853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:04.435746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:04.439929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ae3f7f7ab94e4ba8b0703a8c0286fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.441059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ae3f7f7ab94e4ba8b0703a8c0286fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.457336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ae3f7f7ab94e4ba8b0703a8c0286fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.511881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ae3f7f7ab94e4ba8b0703a8c0286fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.527182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ae3f7f7ab94e4ba8b0703a8c0286fc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:04.540472 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3820/7628] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:04 2022] DELETE /identity/v3/users/a6ae3f7f7ab94e4ba8b0703a8c0286fc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:05.544525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:05.546920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:05.571236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a114b-87b3-432a-8f1a-347771d93616 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:05.630742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:05.634870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:05.688480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:05.689556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:05.689904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:05.690245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] PATH_INFO: `/v3/projects/b43bd2b0760a4882ade6d1aba1b55436` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:05.693220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43bd2b0760a4882ade6d1aba1b55436)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:05.697042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:05.846910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43bd2b0760a4882ade6d1aba1b55436', 'request_id': 'req-1122cd64-a123-4258-ad2e-899ab7303fe5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:05.863401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111211-5b93-448f-8623-0c8ce88c409b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:05.868579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43bd2b0760a4882ade6d1aba1b55436', 'request_id': 'req-1122cd64-a123-4258-ad2e-899ab7303fe5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:05.888967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43bd2b0760a4882ade6d1aba1b55436', 'request_id': 'req-1122cd64-a123-4258-ad2e-899ab7303fe5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:05.951554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] The token cache is being invalidate because project b43bd2b0760a4882ade6d1aba1b55436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:05.951856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:05.957199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1122cd64-a123-4258-ad2e-899ab7303fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:05.960883 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3809/7629] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:05 2022] DELETE /identity/v3/projects/b43bd2b0760a4882ade6d1aba1b55436 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:05.965955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fb6-0393-4464-a6ea-843cde6614a1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:05.968923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fb6-0393-4464-a6ea-843cde6614a1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:05.971048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fb6-0393-4464-a6ea-843cde6614a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.005630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:06.034516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.035475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.037298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.037472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.043919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:06.079613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-40fe0fb6-0393-4464-a6ea-843cde6614a1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:06.084671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40fe0fb6-0393-4464-a6ea-843cde6614a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:06.257147 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3810/7630] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:06.287925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.289706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.311744 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3821/7631] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:06.335933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.336227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.336546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.367113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:06.368442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:06.401203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3811/7632] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:06.405434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.419989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785c28-c3bf-4817-b016-7d48e42e57ac service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.437903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.438615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.438924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.439304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.440215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:06.442722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.444486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.469123 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3822/7633] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:06.473213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.486126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964e599-1337-41c3-a66a-c7adbf4ff6ff None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.493795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.496052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.496343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.496975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.497703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.499720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.551694 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3812/7634] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:06 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:06.555560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.563234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:06.567804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e4a54-a58a-413e-bbe1-a6825ac121f9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.724692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.725399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.725692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.725977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.726700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.731916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.799298 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3823/7635] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:06 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:06.808647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.833322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1176-486a-4be9-b2e7-58c596efe591 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.846879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.847945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.848483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.850702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.851646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.853903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.880301 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3813/7636] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:06.884690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.897348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37be475-f99d-4366-8027-ded713b7a66b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.910848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.911620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.911910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.912190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:06.913501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:06.917255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620628c-ad92-4771-9c9a-1b026a24a3b5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:06.946004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3824/7637] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:06.947561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:06.963334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121caec-c08b-4023-9f42-19118d2439c4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:06.970108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:06.971048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:06.971334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:06.971613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] PATH_INFO: `/v3/projects/6dbebeb05973485aa7abde9f2b4d4bf0/users/3b5db092d3be4c3d9f723106ade0a886/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:07.005838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbebeb05973485aa7abde9f2b4d4bf0, user_id=3b5db092d3be4c3d9f723106ade0a886, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:07.013276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:07.053152 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3814/7638] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:06 2022] PUT /identity/v3/projects/6dbebeb05973485aa7abde9f2b4d4bf0/users/3b5db092d3be4c3d9f723106ade0a886/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:07.062634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d181-919a-4a1e-8370-53c1e2c9da44 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:07.062993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d181-919a-4a1e-8370-53c1e2c9da44 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:07.063209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503d181-919a-4a1e-8370-53c1e2c9da44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:07.137046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8503d181-919a-4a1e-8370-53c1e2c9da44 None None] MFA Rules not processed for user `3b5db092d3be4c3d9f723106ade0a886`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:07.138894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8503d181-919a-4a1e-8370-53c1e2c9da44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:07.313920 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3825/7639] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:07.331691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:07.333944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:07.373331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:07.373725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:07.374389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:07.406579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] MFA Rules not processed for user `9ffe5cc15fe246e28cfff1fdb071dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:07.408109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:07.463441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f1c-0e33-49af-86d5-9b6deb895c9b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:07.475074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:07.475825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:07.476122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:07.476408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:07.508201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:07.515407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523e84e-4ca5-47b8-99b4-9fa4b186e2ae service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:07.539301 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3815/7640] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:07.577206 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3826/7641] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:07.741225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b2f-fbdd-47fb-a22f-093ed644f64a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:07.742609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b2f-fbdd-47fb-a22f-093ed644f64a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:07.743115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b2f-fbdd-47fb-a22f-093ed644f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:07.767436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b4522b2f-fbdd-47fb-a22f-093ed644f64a None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:07.769252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b4522b2f-fbdd-47fb-a22f-093ed644f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:07.880651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:07.985877 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3816/7642] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:08.013896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:08.015608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:08.034853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:08.247623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6401e-45c4-401c-a6db-60a1f56c2887 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:08.260637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:08.261847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:08.262143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:08.262425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:08.290463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:08.292089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:08.317164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3827/7643] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:09.005090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea389f-2088-4f82-a955-59104fc8b0b8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:09.005686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea389f-2088-4f82-a955-59104fc8b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:09.005686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea389f-2088-4f82-a955-59104fc8b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:09.038365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-85ea389f-2088-4f82-a955-59104fc8b0b8 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:09.040210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-85ea389f-2088-4f82-a955-59104fc8b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:09.072472 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3817/7644] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:09.073150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:09.094330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb14b6-9e84-4134-afa7-528db6015bb5 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:09.110724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:09.111839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:09.112363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:09.113029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:09.135253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:09.142345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:09.163701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3828/7645] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:09.888515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78690c-888b-44b5-a414-21381152ad03 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:09.888801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78690c-888b-44b5-a414-21381152ad03 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:09.889277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78690c-888b-44b5-a414-21381152ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:09.948566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3b78690c-888b-44b5-a414-21381152ad03 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:09.949907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3b78690c-888b-44b5-a414-21381152ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:09.975446 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3818/7646] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:09.989696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:10.011125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9997-7edd-4cc4-aac7-7968928ad698 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:10.024852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:10.026142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:10.028057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:10.028553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:10.053081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:10.055204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:10.077275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3829/7647] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:10.438506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dcb06-1c67-4d4b-a21f-840c0e71e5f3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:10.439674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dcb06-1c67-4d4b-a21f-840c0e71e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:10.440147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dcb06-1c67-4d4b-a21f-840c0e71e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:10.476198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d39dcb06-1c67-4d4b-a21f-840c0e71e5f3 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:10.477903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d39dcb06-1c67-4d4b-a21f-840c0e71e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:10.518270 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3819/7648] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:10.519816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:10.538789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f0ad-3518-4426-8ea6-4ec9f687c93d service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:10.551700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:10.552747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:10.553875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:10.558218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:10.583310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:10.591153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:10.611186 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3830/7649] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:11.291047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:11.291491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:11.292740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:11.337621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:11.338966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:11.353692 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3820/7650] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:11.371126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:11.397933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55900-b74f-4d06-b968-2cf175fd98c4 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:11.422502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:11.423623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:11.424125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:11.424976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:11.460384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:11.467731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075a02-aed4-47f5-8d4d-cb8f1b3eec50 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:11.524862 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3831/7651] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:11.888728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:11.890327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:11.949659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:11.949957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:11.950243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:11.993551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:11.995240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:12.010688 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3832/7652] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:12.029426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:12.074172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d444a0-635c-4897-a48f-4f330263fad3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:12.098369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26717f9-3464-45a5-8981-4bb8f845df55 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:12.103742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:12.105207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:12.106017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:12.107250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:12.114790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:12.125026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:12.125693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:12.126078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:12.126447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:12.149423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:12.157119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:12.198537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3833/7653] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:12.352087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:12.353663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a133cfa-51f4-4591-8706-3e6fb5608019 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:12.406806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3821/7654] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:12.421221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:12.627191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292c39-ded0-42b1-a298-6324e55e0241 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:12.641897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:12.642962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:12.643252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:12.643529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] PATH_INFO: `/v3/users/3b5db092d3be4c3d9f723106ade0a886` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:12.647781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5db092d3be4c3d9f723106ade0a886)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:12.651812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:12.682209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:12.778637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5db092d3be4c3d9f723106ade0a886'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:12.785421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5db092d3be4c3d9f723106ade0a886'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:12.799096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5db092d3be4c3d9f723106ade0a886'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:12.832181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5db092d3be4c3d9f723106ade0a886'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:12.841397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5db092d3be4c3d9f723106ade0a886'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:12.850078 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3834/7655] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:12 2022] DELETE /identity/v3/users/3b5db092d3be4c3d9f723106ade0a886 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:12.855329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:12.855700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:12.856037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:12.896203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:12.905620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:13.021514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:13.060105 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3822/7656] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:13.098580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:13.100151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:13.240826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e13b2-429f-4d4c-89a7-0f432a443390 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:13.255582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:13.256331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:13.257344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:13.257639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:13.278078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:13.280728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:13.298944 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3835/7657] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:14.577194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:14.579928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:14.602244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee10fe-073d-4f4f-a6a0-5160753708c9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:14.611627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:14.612303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:14.612611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:14.612890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:14.622257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:14.655982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:14.658555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:14.741776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44efcf-453e-474c-a10d-d9345da4a40a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:14.750962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:14.752397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:14.752945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:14.753578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] PATH_INFO: `/v3/projects/6dbebeb05973485aa7abde9f2b4d4bf0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:14.755453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbebeb05973485aa7abde9f2b4d4bf0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:14.761457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:14.846833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:14.849139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13060c03-d1c7-445c-97bc-26de412bb9d4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:14.868846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbebeb05973485aa7abde9f2b4d4bf0', 'request_id': 'req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:14.889727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbebeb05973485aa7abde9f2b4d4bf0', 'request_id': 'req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:14.898440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbebeb05973485aa7abde9f2b4d4bf0', 'request_id': 'req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:14.904990 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3823/7658] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:14.910682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] The token cache is being invalidate because project 6dbebeb05973485aa7abde9f2b4d4bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:14.911016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:14.911987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-87ed32a6-4c1f-4a0d-9575-1f16abb9d90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:14.913611 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3836/7659] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:14 2022] DELETE /identity/v3/projects/6dbebeb05973485aa7abde9f2b4d4bf0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:14.918456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254049-da0f-4628-b216-64406555798d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:14.918946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254049-da0f-4628-b216-64406555798d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:14.919412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55254049-da0f-4628-b216-64406555798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:14.939924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-55254049-da0f-4628-b216-64406555798d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:14.941471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55254049-da0f-4628-b216-64406555798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:15.020362 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3824/7660] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:15.024464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.024966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.025249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.044553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:15.045793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:15.059049 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3837/7661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:15.060347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55254049-da0f-4628-b216-64406555798d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.070085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55254049-da0f-4628-b216-64406555798d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.085026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.086109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.087446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.088093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.089378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:15.089687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.091411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.106121 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3825/7662] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:15.110297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.129480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b553ed-5b31-405b-92d4-2381349f1193 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.138070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.138927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.139247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.139581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.140507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.143289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.163033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:15.190120 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3838/7663] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:15 2022] POST /identity/v3/projects => generated 361 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:15.193804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.205204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36e26a-6efd-4fdf-8fc1-98557602c916 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.297001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:15.333030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.334114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.335388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.335856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.336990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.342414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.395182 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3826/7664] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:15 2022] POST /identity/v3/users => generated 281 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:15.399406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.410423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ea271-0eca-41fd-b635-84ec22dd263b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.415933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.416717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.416990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.417297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.418007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.419721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.442196 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3839/7665] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:15.446293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.485708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418818-06e2-40d9-a8e3-adcc5582f4b0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.505580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.506298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.506580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.506855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.507590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.517514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307334-1e32-44cc-954c-1bbe33ebbc9f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.545650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3827/7666] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:15.547415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.563103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a4eca-7059-469d-8bb0-e532a0418e6e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.602935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.605606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.606004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.607012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] PATH_INFO: `/v3/projects/4cc216673cf64dda8cf934894daef0f9/users/2f8e693f3e1d4dfca0effffa6e69c013/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.668925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc216673cf64dda8cf934894daef0f9, user_id=2f8e693f3e1d4dfca0effffa6e69c013, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.671970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:15.691913 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3840/7667] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:15 2022] PUT /identity/v3/projects/4cc216673cf64dda8cf934894daef0f9/users/2f8e693f3e1d4dfca0effffa6e69c013/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:15.704348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f32a-a37a-4947-a402-5dce858eceb3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.705036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f32a-a37a-4947-a402-5dce858eceb3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.705729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f32a-a37a-4947-a402-5dce858eceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.742932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-eb55f32a-a37a-4947-a402-5dce858eceb3 None None] MFA Rules not processed for user `2f8e693f3e1d4dfca0effffa6e69c013`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:15.744994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb55f32a-a37a-4947-a402-5dce858eceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:15.841737 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3828/7668] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:15.854126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:15.947153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b7bf-8100-4337-a0f9-e7a32fa60e04 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:15.952866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:15.954211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:15.954564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:15.954910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] PATH_INFO: `/v3/users/2f8e693f3e1d4dfca0effffa6e69c013` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:15.957913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8e693f3e1d4dfca0effffa6e69c013)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:15.961329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:16.026153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8e693f3e1d4dfca0effffa6e69c013'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.027806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8e693f3e1d4dfca0effffa6e69c013'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.037541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8e693f3e1d4dfca0effffa6e69c013'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.050983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8e693f3e1d4dfca0effffa6e69c013'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.060890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8e693f3e1d4dfca0effffa6e69c013'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.071266 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3841/7669] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:15 2022] DELETE /identity/v3/users/2f8e693f3e1d4dfca0effffa6e69c013 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:16.090155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.090503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.090792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.092945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:16.094995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.125863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:16.129419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.187626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:16.233625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11463-880b-4bb6-b63d-6614ca64e201 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:16.242268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:16.243536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.244190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.244873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] PATH_INFO: `/v3/users/aa2aaa29e0dd479283202bd6575b4c25` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.246798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2aaa29e0dd479283202bd6575b4c25)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:16.249288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:16.260209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3829/7670] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:16.270370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:16.272717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.330603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2aaa29e0dd479283202bd6575b4c25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.331304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2aaa29e0dd479283202bd6575b4c25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.345234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2aaa29e0dd479283202bd6575b4c25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.386697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955830a-9cfb-4b48-b647-87886fe419f5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:16.391489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:16.392340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.392667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.393069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.393938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2aaa29e0dd479283202bd6575b4c25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.395428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.402292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e63fe0f2-4817-4d1e-ace4-43dc2087eb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2aaa29e0dd479283202bd6575b4c25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:16.405707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:16.409842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:16.411992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:16.415060 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3842/7671] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:16 2022] DELETE /identity/v3/users/aa2aaa29e0dd479283202bd6575b4c25 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:16.422207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a11be-6ae7-465c-be66-849240727344 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.423175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a11be-6ae7-465c-be66-849240727344 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.423511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a11be-6ae7-465c-be66-849240727344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.437440 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3830/7672] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:16.460641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-591a11be-6ae7-465c-be66-849240727344 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:16.462799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-591a11be-6ae7-465c-be66-849240727344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.570251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3843/7673] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:16.591047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:16.593103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.613189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3e5d-e87e-4e83-a6da-4590fd3ed528 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:16.706693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:16.707614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.708124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.709105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.723625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:16.725464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:16.739687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3831/7674] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:16.917534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a11be-6ae7-465c-be66-849240727344 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:16.919965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-591a11be-6ae7-465c-be66-849240727344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:16.940610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a11be-6ae7-465c-be66-849240727344 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:16.948512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:16.949744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:16.950141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:16.950489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] PATH_INFO: `/v3/projects/4cc216673cf64dda8cf934894daef0f9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:16.951871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc216673cf64dda8cf934894daef0f9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:16.954887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.033206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc216673cf64dda8cf934894daef0f9', 'request_id': 'req-1606f35a-76e6-451b-8881-eb271affc07b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.037802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:17.048415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.050139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.062713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc216673cf64dda8cf934894daef0f9', 'request_id': 'req-1606f35a-76e6-451b-8881-eb271affc07b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.084210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7b49-9cf8-41c5-8fc1-07ab1ff6f77a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.086328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc216673cf64dda8cf934894daef0f9', 'request_id': 'req-1606f35a-76e6-451b-8881-eb271affc07b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.113217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] The token cache is being invalidate because project 4cc216673cf64dda8cf934894daef0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:17.113529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.114267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1606f35a-76e6-451b-8881-eb271affc07b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.116255 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3844/7675] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:16 2022] DELETE /identity/v3/projects/4cc216673cf64dda8cf934894daef0f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:17.124828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db5f5-2c25-49c7-9c33-ac42e50b05d7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.125214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db5f5-2c25-49c7-9c33-ac42e50b05d7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.125497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db5f5-2c25-49c7-9c33-ac42e50b05d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.161368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ff0db5f5-2c25-49c7-9c33-ac42e50b05d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:17.162612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ff0db5f5-2c25-49c7-9c33-ac42e50b05d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.205490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.206358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.206639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.206925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] PATH_INFO: `/v3/projects/ac8403c64a48460ea9cbf383240fa2a9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.208660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8403c64a48460ea9cbf383240fa2a9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.210601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.283082 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3845/7676] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:17.291016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.291288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.291564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.311021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:17.312975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.323421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8403c64a48460ea9cbf383240fa2a9', 'request_id': 'req-2c9633cb-fbc8-4d38-bd15-0c3482751e75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.337599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8403c64a48460ea9cbf383240fa2a9', 'request_id': 'req-2c9633cb-fbc8-4d38-bd15-0c3482751e75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.347328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8403c64a48460ea9cbf383240fa2a9', 'request_id': 'req-2c9633cb-fbc8-4d38-bd15-0c3482751e75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.368014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] The token cache is being invalidate because project ac8403c64a48460ea9cbf383240fa2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:17.368837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.370144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.372236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3832/7677] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:17 2022] DELETE /identity/v3/projects/ac8403c64a48460ea9cbf383240fa2a9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:17.377450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.384813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.400960 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3846/7678] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:17.405074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.424905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790cd7-72de-4a80-937e-1e2c7134547f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.430243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:17.435919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.436729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.437024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.437299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.438080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:17.438388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.441005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.463595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3847/7679] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:17.467081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.469834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.480112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9633cb-fbc8-4d38-bd15-0c3482751e75 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.485275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.486190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.486474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.486753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] PATH_INFO: `/v3/users/cbb3982e7c3445209fea090c37590c63` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.505490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb3982e7c3445209fea090c37590c63)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.507725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.560516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5ab10-53bb-4958-8387-43ad692fe4c1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.564679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.565531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.565825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.566582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.569663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.594084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.595581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.602991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb3982e7c3445209fea090c37590c63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.614358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb3982e7c3445209fea090c37590c63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.619065 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3848/7680] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:17.619937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.632188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb3982e7c3445209fea090c37590c63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.633566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb3982e7c3445209fea090c37590c63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.634867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb3982e7c3445209fea090c37590c63'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:17.639168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518c6b-b3c9-49ea-a59a-02f65b59cbeb service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.653461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.654382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.654672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.655026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.655647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.657602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.665216 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3833/7681] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:17 2022] DELETE /identity/v3/users/cbb3982e7c3445209fea090c37590c63 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:17.670628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:17.718881 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3849/7682] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:17 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:17.723123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.726962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:17.819433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004549e-5015-40b3-9a2b-730a3f6b75a2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.872657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:17.914588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.915517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.915872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.916222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.917183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.919753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:17.956566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3834/7683] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:17 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:17.959915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:17.974013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d44082-8f40-4bce-b6a6-17e1e929a80c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:17.980458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:17.982020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:17.983067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:17.983718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:17.984948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:17.994532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.018086 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3850/7684] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:18.019667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.034451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ba1b-9882-4b14-94c7-35c95fe1385d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.042067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.042865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.043229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.043784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.045255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.050515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.072227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.073259 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3835/7685] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:18.089452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761508-e89c-4e19-88bc-e04dd03860d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.115935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.118143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.120333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.123604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.124017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.124171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] PATH_INFO: `/v3/projects/363b93d84f6d409da8c95082ef245fff/users/bad0f7a715e64c67be643b3b235453a3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.143357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbd5d-e121-4708-85f3-15a3faf0cd47 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.151888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.153104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.153826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.154209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] PATH_INFO: `/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.169689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=363b93d84f6d409da8c95082ef245fff, user_id=bad0f7a715e64c67be643b3b235453a3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.172838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d3bb-7876-4a1b-85d5-e8713adcd87e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.187860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba60c9d2e9f84e6f98b1681f72b9e35f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.195910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.210098 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3851/7686] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:18 2022] PUT /identity/v3/projects/363b93d84f6d409da8c95082ef245fff/users/bad0f7a715e64c67be643b3b235453a3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:18.211872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722651-d185-44f4-a7a2-b954f273104e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.212164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722651-d185-44f4-a7a2-b954f273104e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.212626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722651-d185-44f4-a7a2-b954f273104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.259827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-05722651-d185-44f4-a7a2-b954f273104e None None] MFA Rules not processed for user `bad0f7a715e64c67be643b3b235453a3`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:18.261287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05722651-d185-44f4-a7a2-b954f273104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.300467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba60c9d2e9f84e6f98b1681f72b9e35f', 'request_id': 'req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:18.319857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba60c9d2e9f84e6f98b1681f72b9e35f', 'request_id': 'req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:18.332114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba60c9d2e9f84e6f98b1681f72b9e35f', 'request_id': 'req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:18.359606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] The token cache is being invalidate because project ba60c9d2e9f84e6f98b1681f72b9e35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:18.359909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:18.363380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b82fd3a0-cc66-40b1-82a5-f7a9336baf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:18.366607 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3836/7687] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:18 2022] DELETE /identity/v3/projects/ba60c9d2e9f84e6f98b1681f72b9e35f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:18.374304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b18c-f1b0-4e17-b105-996fd7bc1c64 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.374629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b18c-f1b0-4e17-b105-996fd7bc1c64 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.375060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b18c-f1b0-4e17-b105-996fd7bc1c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.419389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a166b18c-f1b0-4e17-b105-996fd7bc1c64 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:18.421714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a166b18c-f1b0-4e17-b105-996fd7bc1c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.428717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3852/7688] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:18.432620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722651-d185-44f4-a7a2-b954f273104e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.435242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-05722651-d185-44f4-a7a2-b954f273104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.548005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3837/7689] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:18.550145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.550279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.550564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.561481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722651-d185-44f4-a7a2-b954f273104e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.578395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.579429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.579575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.582409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.583192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.587679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.590696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:18.593946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.606202 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3838/7690] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:18.613802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.625422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ad41d-b010-45a6-9cf9-bec04beb7513 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.631951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.632672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.632958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.633240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.633988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:18.634301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.636181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.644823 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3853/7691] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/projects => generated 389 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:18.654787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.666571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3839/7692] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:18.667680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.685731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c7ec3-9fc7-4408-9e36-c89de31ed637 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.714991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:18.723964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:18.782341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916e7ff-84d5-4fac-bfb6-805c0228f36e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.789975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.790315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.790546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.790823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.791674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.794157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.815566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:18.826505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:18.826795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:18.827073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:18.828292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:18.830441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:18.839908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3854/7693] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:18.842461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.845645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:18.876905 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3840/7694] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:18 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:18.880151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:18.985643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26923-7bcf-437f-9007-81ab5abf96ca admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:18.997097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27c25f-f0d7-401e-ac01-8d24830343dc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.014644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.015344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.015629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.016008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.017642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.022506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.054974 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3841/7695] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:19.056241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.073655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.074336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.074622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.075073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.077613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.085074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e112eb-dfe7-4fed-81af-ea61d28c232d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.099404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.100328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.100819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.101293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.102478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.104579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.106927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.109368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.136414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3855/7696] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:19.137422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.146641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.160201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3842/7697] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:19 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:19.162875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.173912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a72e-e1fe-4115-b8a3-72388beab9cd service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.187988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510a68-8bea-4bb0-bfc4-25b87d7de8be admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.189065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.189986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.190271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.190551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] PATH_INFO: `/v3/users/871c269a6b15425d8b79a6c653c56402` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.192459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=871c269a6b15425d8b79a6c653c56402)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.194603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.200635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.201876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.202409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.204277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] PATH_INFO: `/v3/projects/c8fb6b503fde439488f216d72df39cf7/users/c2dbea59e46c44f7aad94b53bfa26f6e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.241802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb6b503fde439488f216d72df39cf7, user_id=c2dbea59e46c44f7aad94b53bfa26f6e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.244813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.265204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3843/7698] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:19 2022] PUT /identity/v3/projects/c8fb6b503fde439488f216d72df39cf7/users/c2dbea59e46c44f7aad94b53bfa26f6e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:19.266512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.272207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:19.286150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871c269a6b15425d8b79a6c653c56402'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:19.287331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871c269a6b15425d8b79a6c653c56402'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:19.308391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871c269a6b15425d8b79a6c653c56402'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:19.338818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871c269a6b15425d8b79a6c653c56402'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:19.352024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871c269a6b15425d8b79a6c653c56402'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:19.360119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3856/7699] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:19 2022] DELETE /identity/v3/users/871c269a6b15425d8b79a6c653c56402 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:19.363670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.368628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.397954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:19.402890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c5ec3-4dda-4db5-b0c0-bd2123804de3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.490611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.491459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.491741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.492137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.493115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.495059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.531387 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3844/7700] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:19.535561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.539526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.548538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214688ec-fb75-4a6a-befa-898e4d1f9ecf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.572535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cf086-607e-450f-a854-170b6e07dd53 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.573064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.573064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.573064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.573064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.573379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.573379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.575701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.579028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.579316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.579598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.580352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.582103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.609130 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3845/7701] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:19.609326 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3857/7702] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:19.609415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.612218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.632465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff601fb-ad3d-47ac-83e7-9c95d4f482e1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.638462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60b28-2bef-4af6-9486-f0e5a1d314d9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.644100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.644993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.645266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.646154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] PATH_INFO: `/v3/projects/c8fb6b503fde439488f216d72df39cf7/users/c2dbea59e46c44f7aad94b53bfa26f6e/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.650081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb6b503fde439488f216d72df39cf7, user_id=c2dbea59e46c44f7aad94b53bfa26f6e, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.654167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.655090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.655372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.656500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] PATH_INFO: `/v3/projects/68e13ce28b1a427f98c27a95d32587cd/users/682d6a71d0c94c93919ad4ef073d046c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.658286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e469e-b0e8-44ad-a3fc-5d6402a4ce8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.686799 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3846/7703] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:19 2022] PUT /identity/v3/projects/c8fb6b503fde439488f216d72df39cf7/users/c2dbea59e46c44f7aad94b53bfa26f6e/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:19.697081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.697407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.697763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.699073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e13ce28b1a427f98c27a95d32587cd, user_id=682d6a71d0c94c93919ad4ef073d046c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.702844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409b116-b1d5-423a-ba9b-93c9851b66dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.726262 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3858/7704] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:19 2022] PUT /identity/v3/projects/68e13ce28b1a427f98c27a95d32587cd/users/682d6a71d0c94c93919ad4ef073d046c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:19.731595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.732874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.733433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.752097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] MFA Rules not processed for user `c2dbea59e46c44f7aad94b53bfa26f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:19.752097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.787400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:19.790906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.838865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3847/7705] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:19.839853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.841362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.907877 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3859/7706] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:19.908768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:19.910496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:19.948278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6ad9-9a7d-4063-91c0-df6526d8363e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:19.950787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:19.956047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:19.956672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:19.957077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:19.958166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] PATH_INFO: `/v3/projects/5a7efe5a3d7f4380b6e1ee40d4628ea8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:19.959996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7efe5a3d7f4380b6e1ee40d4628ea8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:19.962404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:19.967881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:19.996217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36195d-b279-40f5-933e-6a4ed66c4e6a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.001037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.001842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.003478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.003771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.006599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:20.025730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'request_id': 'req-52bc9833-ade8-4201-8f6d-56d54fa7f571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:20.042184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'request_id': 'req-52bc9833-ade8-4201-8f6d-56d54fa7f571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:20.053607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'request_id': 'req-52bc9833-ade8-4201-8f6d-56d54fa7f571'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:20.070717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] The token cache is being invalidate because project 5a7efe5a3d7f4380b6e1ee40d4628ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:20.071325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:20.072241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:20.074245 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3848/7707] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:19 2022] DELETE /identity/v3/projects/5a7efe5a3d7f4380b6e1ee40d4628ea8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:20.075531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.077284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:20.099698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.100992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75be035-79fc-4169-a049-2e1f57dd813b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.113900 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3860/7708] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:20.115633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b628-88b1-4f79-84a6-042fe72b8774 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.115633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b628-88b1-4f79-84a6-042fe72b8774 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.115882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b628-88b1-4f79-84a6-042fe72b8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.138921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a80b628-88b1-4f79-84a6-042fe72b8774 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:20.140166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a80b628-88b1-4f79-84a6-042fe72b8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:20.161348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9833-ade8-4201-8f6d-56d54fa7f571 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.166706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.167639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.168239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.168580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.170709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:20.267938 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3861/7709] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:20.275649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.275947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.276284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.292456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.294326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.311145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:20.311592 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3849/7710] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:20.312266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:20.329564 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3862/7711] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:20.334121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.360335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c6b5-5ac4-4c59-b0e8-8d2e2e7f1967 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.383720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.384614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.384896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.385255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.386033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:20.386433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.390525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.422241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.423709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3850/7712] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:20.434422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f106-e9e2-468f-b8b2-2438e8b751eb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.440400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.441148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.441490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.441775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.442564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.444674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.488671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3863/7713] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:20 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:20.494103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.509642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185580-df68-4805-86cb-d4a7e2fc38b6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.551825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:20.643755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.645231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.645715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.646007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.646735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.651973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.705586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3851/7714] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:20 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:20.709810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.726357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48c8f-ee1c-497f-a02d-dfa004a921d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.741016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.742790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.746562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.747542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.747942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.749776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.787096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.787525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3864/7715] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:20.805004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de16a-0c50-4c27-841d-5653e37c2ddd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.817530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.818051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.818611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.818917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.819749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.821466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f286-3eb6-423d-9e27-74044479f220 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.846905 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3852/7716] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:20.850968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:20.864757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae73-1b5c-4dec-9f2b-ec2d15b26265 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:20.879243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:20.880503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.880867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.881296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] PATH_INFO: `/v3/projects/22cbff1cb0f245f7a7fb933471525d5f/users/7377a446814744e290e3f6e4e99d7ab3/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.908117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cbff1cb0f245f7a7fb933471525d5f, user_id=7377a446814744e290e3f6e4e99d7ab3, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:20.910940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:20.938573 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3865/7717] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:20 2022] PUT /identity/v3/projects/22cbff1cb0f245f7a7fb933471525d5f/users/7377a446814744e290e3f6e4e99d7ab3/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:20.949106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:20.949476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:20.949832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:20.981241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] MFA Rules not processed for user `7377a446814744e290e3f6e4e99d7ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:20.983446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:21.084487 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3853/7718] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:21.088646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:21.146936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:21.219214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ad02-57b4-4b05-b269-7a50be401680 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:21.226329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:21.227022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.227307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.227585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:21.228644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:21.231404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:21.281727 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3866/7719] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:21.285690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:21.298107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7fcf6-0c75-4da8-803c-3cda1ff83f68 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:21.394584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:21.395447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.395959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.396627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:21.397175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:21.399951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:21.433549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3854/7720] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:21 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:21.437501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:21.455950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4878223-7952-43c7-b690-5904eb42bcc6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:21.466827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:21.467919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.468862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.468862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:21.469268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:21.471155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb8837-acfb-4b62-8cef-36cb90448cdb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:21.489804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3867/7721] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:21.496242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:21.512681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa57cf-ebd9-4cb8-a216-86f0ecc89d2b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:21.525781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:21.545011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.547105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.548641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] PATH_INFO: `/v3/projects/18ea40cef7fa49d58531f7482f8153e6/users/8acab9fda6d14148983afeb623b3e0cc/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:21.591587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ea40cef7fa49d58531f7482f8153e6, user_id=8acab9fda6d14148983afeb623b3e0cc, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:21.594435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:21.610944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:21.621199 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3855/7722] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:21 2022] PUT /identity/v3/projects/18ea40cef7fa49d58531f7482f8153e6/users/8acab9fda6d14148983afeb623b3e0cc/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:21.633154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.633693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.634270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:21.677914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] MFA Rules not processed for user `8acab9fda6d14148983afeb623b3e0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:21.679461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:21.775676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3868/7723] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:21.842129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:21.844134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:21.973244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f429-d2f7-4d29-a129-838cbfa8fd31 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:21.983284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:21.983284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:21.984946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:21.984946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:22.018898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:22.021308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fddbe-085d-43e8-9a65-2b5ebea7aeeb service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:22.046839 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3856/7724] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:22:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:23.097151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:23.260242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02b148-1ce2-4647-a516-cfbd30c00fb0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:23.267560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:23.268517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:23.268810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:23.269384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] PATH_INFO: `/v3/users/7377a446814744e290e3f6e4e99d7ab3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:23.270670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7377a446814744e290e3f6e4e99d7ab3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:23.274591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:23.317734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:23.364590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7377a446814744e290e3f6e4e99d7ab3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:23.365626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7377a446814744e290e3f6e4e99d7ab3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:23.382347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7377a446814744e290e3f6e4e99d7ab3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:23.406375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7377a446814744e290e3f6e4e99d7ab3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:23.433170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7377a446814744e290e3f6e4e99d7ab3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:23.461575 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3869/7725] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:23 2022] DELETE /identity/v3/users/7377a446814744e290e3f6e4e99d7ab3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:23.465799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:23.466377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:23.466492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:23.520172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:23.522030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:23.650003 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3857/7726] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:23.709922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:23.712182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:23.874367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d93011-2102-43f3-93d4-483e5f15da98 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:23.889595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:23.892546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:23.892853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:23.893151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:23.908306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:23.910176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:23.929846 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3870/7727] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:24.793281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:24.794886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:24.816781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd2dd-6e6e-4ff1-86e4-0334ff556039 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:24.835114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:24.835850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:24.836312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:24.837163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] PATH_INFO: `/v3/projects/22cbff1cb0f245f7a7fb933471525d5f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:24.838382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cbff1cb0f245f7a7fb933471525d5f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:24.841346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:24.962321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cbff1cb0f245f7a7fb933471525d5f', 'request_id': 'req-1458ab32-ae6d-4d54-86ce-400eac4d3258'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:24.980077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cbff1cb0f245f7a7fb933471525d5f', 'request_id': 'req-1458ab32-ae6d-4d54-86ce-400eac4d3258'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:24.990821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cbff1cb0f245f7a7fb933471525d5f', 'request_id': 'req-1458ab32-ae6d-4d54-86ce-400eac4d3258'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.022479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] The token cache is being invalidate because project 22cbff1cb0f245f7a7fb933471525d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:25.023162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.024098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.026302 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3858/7728] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:24 2022] DELETE /identity/v3/projects/22cbff1cb0f245f7a7fb933471525d5f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:25.030271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:25.043526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2eb15-1ebf-4c7b-8365-b7266e511313 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:25.187152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:25.188614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:25.189052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:25.189499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] PATH_INFO: `/v3/users/8acab9fda6d14148983afeb623b3e0cc` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:25.193437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acab9fda6d14148983afeb623b3e0cc)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:25.196355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:25.293822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:25.297589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acab9fda6d14148983afeb623b3e0cc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.298099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acab9fda6d14148983afeb623b3e0cc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.350918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acab9fda6d14148983afeb623b3e0cc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.372751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acab9fda6d14148983afeb623b3e0cc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.384473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acab9fda6d14148983afeb623b3e0cc'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.395587 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3871/7729] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:25 2022] DELETE /identity/v3/users/8acab9fda6d14148983afeb623b3e0cc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:25.498923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:25.500729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:25.525316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ab32-ae6d-4d54-86ce-400eac4d3258 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:25.548474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:25.707407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:25.708334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:25.708648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:25.708935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] PATH_INFO: `/v3/users/a968e34f692142a3bcc5cade9a62be21` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:25.710387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a968e34f692142a3bcc5cade9a62be21)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:25.713015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:25.827580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a968e34f692142a3bcc5cade9a62be21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.845056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a968e34f692142a3bcc5cade9a62be21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.890493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a968e34f692142a3bcc5cade9a62be21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.891329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a968e34f692142a3bcc5cade9a62be21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.892316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ae295c9a-b6c2-4638-9af2-c75bcb4d68c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a968e34f692142a3bcc5cade9a62be21'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:25.918198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:25.920148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:25.923237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3859/7730] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:25 2022] DELETE /identity/v3/users/a968e34f692142a3bcc5cade9a62be21 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:25.930739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:25.931622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:25.932134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:25.964112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:25.967038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:26.062765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bc481-53fc-40e7-bdad-55064e882fc9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:26.096098 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3860/7731] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:26.127266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:26.128969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:26.174259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:26.175100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:26.175484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:26.175858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:26.180572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:26.201051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:26.270598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadba45-f03e-4980-9521-3bf289c16a4f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:26.275892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:26.276851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:26.277528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:26.290780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:26.304872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:26.305383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:26.306365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:26.307214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:26.321889 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3861/7732] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:26.324719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:26.326615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:26.333997 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3872/7733] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:26.342480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6d8c5-82db-4b93-9b9e-e714f7c78e90 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:26.350037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:26.351580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:26.351580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:26.351881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] PATH_INFO: `/v3/projects/18ea40cef7fa49d58531f7482f8153e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:26.354059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ea40cef7fa49d58531f7482f8153e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:26.359701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:26.489192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ea40cef7fa49d58531f7482f8153e6', 'request_id': 'req-85cb6167-20e7-497a-b5f2-b306beb06fe8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:26.502656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ea40cef7fa49d58531f7482f8153e6', 'request_id': 'req-85cb6167-20e7-497a-b5f2-b306beb06fe8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:26.517636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ea40cef7fa49d58531f7482f8153e6', 'request_id': 'req-85cb6167-20e7-497a-b5f2-b306beb06fe8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:26.539692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] The token cache is being invalidate because project 18ea40cef7fa49d58531f7482f8153e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:26.540063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:26.541540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-85cb6167-20e7-497a-b5f2-b306beb06fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:26.548549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3862/7734] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:26 2022] DELETE /identity/v3/projects/18ea40cef7fa49d58531f7482f8153e6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:26.857530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:26.859457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:26.912765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d0b77-cc41-4019-929d-e6ae2c4adf55 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:26.996606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:27.087355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.089794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.090184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.092126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] PATH_INFO: `/v3/projects/2c833571bec448f99dd6aef98714f668` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.093985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c833571bec448f99dd6aef98714f668)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.096375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.198538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c833571bec448f99dd6aef98714f668', 'request_id': 'req-8ddb78f5-040e-48f3-9282-c75e04989d8a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:27.213284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c833571bec448f99dd6aef98714f668', 'request_id': 'req-8ddb78f5-040e-48f3-9282-c75e04989d8a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:27.225006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c833571bec448f99dd6aef98714f668', 'request_id': 'req-8ddb78f5-040e-48f3-9282-c75e04989d8a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:27.243676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] The token cache is being invalidate because project 2c833571bec448f99dd6aef98714f668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:27.245557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:27.246626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8ddb78f5-040e-48f3-9282-c75e04989d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:27.249122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3873/7735] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:26 2022] DELETE /identity/v3/projects/2c833571bec448f99dd6aef98714f668 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:27.254674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.255306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.255306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.284945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:27.286198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:27.358303 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3863/7736] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:27.366530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.366857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.367094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.391735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:27.393051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:27.405893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3874/7737] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:27.407564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.421883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224cdab-50c5-42dd-8092-181d47a9f9ca None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.430781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.431207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.431492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.432306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.433100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:27.433409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.435567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.454407 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3864/7738] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:27.455977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.466477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718772ce-e48c-4290-b79f-7a433d593dc3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.472053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.472697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.472982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.473290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.473902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.475885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.515303 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3875/7739] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:27 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:27.520262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.538299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914745a-248c-4174-acc9-a766b2f3e461 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.607847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:27.650319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.651059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.651351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.651918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.652999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.655865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.692065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3865/7740] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:27 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:27.694256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.710091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587afb-2a4e-48be-a3f1-ca9db347adaa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.716909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.717732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.718068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.718398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.720023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.722185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.738699 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3876/7741] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:27.742795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.757872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d7e5f-01d9-452d-9626-e1f457baffc5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.764161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.765032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.765412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.765783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.766806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.768667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9e9e-1179-43f7-b9e2-e9736bc382ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.784681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3866/7742] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:27.789356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:27.805580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d915-0ed9-44ff-ba9e-9f16943638d2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:27.812225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:27.813431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.813843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.815645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] PATH_INFO: `/v3/projects/b967d36ae4ec4537af78344111af127a/users/319fb2abff7a4b37b503ac42c47e9d30/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.839025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b967d36ae4ec4537af78344111af127a, user_id=319fb2abff7a4b37b503ac42c47e9d30, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:27.853090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:27.878058 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3877/7743] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:27 2022] PUT /identity/v3/projects/b967d36ae4ec4537af78344111af127a/users/319fb2abff7a4b37b503ac42c47e9d30/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:27.893096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a1d0-f2fe-49a7-9bd7-314f3a929c33 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:27.893399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a1d0-f2fe-49a7-9bd7-314f3a929c33 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:27.893933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a1d0-f2fe-49a7-9bd7-314f3a929c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:27.933076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8070a1d0-f2fe-49a7-9bd7-314f3a929c33 None None] MFA Rules not processed for user `319fb2abff7a4b37b503ac42c47e9d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:27.934333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8070a1d0-f2fe-49a7-9bd7-314f3a929c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:28.036533 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3867/7744] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:28.052306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:28.054491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:28.128260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a4857-8a74-4c2c-9a8d-033edc6ec604 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:28.132325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:28.133703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:28.134338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:28.134828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:28.148337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:28.150210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:28.155003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:28.164027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3878/7745] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:29.041023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:29.041511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:29.041596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:29.115730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] MFA Rules not processed for user `682d6a71d0c94c93919ad4ef073d046c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:29.117810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:29.221360 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3868/7746] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:29.223183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:29.225627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:29.331260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973946a-9442-41bf-af8e-5f55c638d8b5 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:29.338891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:29.339951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:29.340169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:29.340373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:29.347691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:29.349829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:29.379595 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3879/7747] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:29 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:29.384642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:29.404670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0975-790a-461d-be1c-897b0f6401a5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:29.413788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:29.414710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:29.415064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:29.415414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:29.416238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:29.418018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9be45-cf7d-452b-989f-8772f22f414b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:29.441948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3869/7748] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:29.446929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:29.468383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b579c-cb53-4822-98af-9d1415732c93 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:29.474832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:29.476411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:29.476913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:29.477480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] PATH_INFO: `/v3/system/users/0c54736b9d54454c84b7ab5b982710cd/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:29.507565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0c54736b9d54454c84b7ab5b982710cd, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:29.509576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:29.534253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3880/7749] 10.222.0.39 () {60 vars in 1377 bytes} [Sat Jun 25 21:22:29 2022] PUT /identity/v3/system/users/0c54736b9d54454c84b7ab5b982710cd/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:29.537607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:29.540714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:29.542734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:29.584357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] MFA Rules not processed for user `0c54736b9d54454c84b7ab5b982710cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:29.585920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:29.617557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:29.739755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3870/7750] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:29 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 21:22:29.744393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:29.949998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f980c7-0f06-42bf-9099-e601af0a759f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:29.986149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:30.011413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c54736b9d54454c84b7ab5b982710cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:30.012218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:30.012919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:30.013333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:30.014041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:30.016081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:30.027622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3881/7751] 10.222.0.39 () {58 vars in 1109 bytes} [Sat Jun 25 21:22:29 2022] GET /identity/v3/services => generated 2191 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:30.029861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:30.169029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97392b44-8dbb-4885-87fc-c779ed046126 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:30.230617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c54736b9d54454c84b7ab5b982710cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:30.231657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:30.232046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:30.232463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] PATH_INFO: `/v3/limits` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:30.233375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:30.234864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jun 25 21:22:30.300092 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 25 21:22:30.301449 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:22:30.304013 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3871/7752] 10.222.0.39 () {60 vars in 1125 bytes} [Sat Jun 25 21:22:30 2022] POST /identity/v3/limits => generated 124 bytes in 275 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:22:30.309198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:30.516234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ff0f-67db-4320-832f-98224861d209 None tempest-ImageQuotaTest-468172648-system-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:30.573361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c54736b9d54454c84b7ab5b982710cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:30.574681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:30.575413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:30.575948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:30.577115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:30.578956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:30.596647 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3882/7753] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:22:30 2022] GET /identity/v3/registered_limits => generated 129 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:30.597374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:30.614695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:30.879836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a454-f8d8-49ec-924b-68b4e4e97164 None tempest-ImageQuotaTest-468172648-system-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:30.963253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c54736b9d54454c84b7ab5b982710cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:30.964111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:30.964728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:30.966352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:30.968850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:30.971954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ed02f-65f4-4b87-b766-8e8798aaf32e None tempest-ImageQuotaTest-468172648-system-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:30.984201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3872/7754] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:22:30 2022] GET /identity/v3/registered_limits => generated 129 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:32.567058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:32.569193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:32.602340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ccfda-9415-4cf3-847e-cc933f306a00 None tempest-ImageQuotaTest-468172648-system-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:32.609907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:32.611040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:32.611589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:32.612076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] PATH_INFO: `/v3/users/bad0f7a715e64c67be643b3b235453a3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:32.616491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad0f7a715e64c67be643b3b235453a3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:32.618836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:32.753407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:32.757456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad0f7a715e64c67be643b3b235453a3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:32.758464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad0f7a715e64c67be643b3b235453a3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:32.791003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad0f7a715e64c67be643b3b235453a3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:32.829327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad0f7a715e64c67be643b3b235453a3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:32.841694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad0f7a715e64c67be643b3b235453a3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:32.859657 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3883/7755] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:32 2022] DELETE /identity/v3/users/bad0f7a715e64c67be643b3b235453a3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:32.861565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:32.862046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:32.862163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:32.903082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:32.904714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:32.995866 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3873/7756] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:33.026603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:33.028079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:33.165227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964a2b-2a33-483c-92c6-c325ac420b3a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:33.179810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:33.182353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:33.182849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:33.183345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:33.209001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:33.218326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:33.231395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3884/7757] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:33.774744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:33.776382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:33.842866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718ed9-25c9-4e49-8140-ff815a6cd00a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:33.869732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:33.878726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:33.879512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:33.881874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] PATH_INFO: `/v3/projects/363b93d84f6d409da8c95082ef245fff` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:33.889458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363b93d84f6d409da8c95082ef245fff)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:33.896378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:33.922883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:34.022682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363b93d84f6d409da8c95082ef245fff', 'request_id': 'req-cb69d500-d6fe-4057-a4a0-d17c60911e08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.042732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363b93d84f6d409da8c95082ef245fff', 'request_id': 'req-cb69d500-d6fe-4057-a4a0-d17c60911e08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.051346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363b93d84f6d409da8c95082ef245fff', 'request_id': 'req-cb69d500-d6fe-4057-a4a0-d17c60911e08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.072823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] The token cache is being invalidate because project 363b93d84f6d409da8c95082ef245fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:34.073318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.074169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.081471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3874/7758] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:33 2022] DELETE /identity/v3/projects/363b93d84f6d409da8c95082ef245fff => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:34.085540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:34.098971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bb81-bb3a-4c26-a950-a16f5143b419 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:34.260283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:34.261536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:34.261965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:34.264836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] PATH_INFO: `/v3/users/c2dbea59e46c44f7aad94b53bfa26f6e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:34.269271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2dbea59e46c44f7aad94b53bfa26f6e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:34.271395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:34.397058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2dbea59e46c44f7aad94b53bfa26f6e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.399780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2dbea59e46c44f7aad94b53bfa26f6e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.414826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2dbea59e46c44f7aad94b53bfa26f6e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.444062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:34.471559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2dbea59e46c44f7aad94b53bfa26f6e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.492975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2ef8afbc-8c3b-42a7-a4b7-da349bc26335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2dbea59e46c44f7aad94b53bfa26f6e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:34.500488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3885/7759] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:34 2022] DELETE /identity/v3/users/c2dbea59e46c44f7aad94b53bfa26f6e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:34.912859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:34.914384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:34.932451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69d500-d6fe-4057-a4a0-d17c60911e08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.009120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.011261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.011699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.012149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] PATH_INFO: `/v3/projects/c8fb6b503fde439488f216d72df39cf7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.013996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fb6b503fde439488f216d72df39cf7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.016523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.086635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fb6b503fde439488f216d72df39cf7', 'request_id': 'req-9b6223e7-10b5-4978-a771-a6aceab65630'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:35.097026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fb6b503fde439488f216d72df39cf7', 'request_id': 'req-9b6223e7-10b5-4978-a771-a6aceab65630'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:35.106221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fb6b503fde439488f216d72df39cf7', 'request_id': 'req-9b6223e7-10b5-4978-a771-a6aceab65630'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:35.119837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] The token cache is being invalidate because project c8fb6b503fde439488f216d72df39cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:35.120878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:35.121404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9b6223e7-10b5-4978-a771-a6aceab65630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:35.126623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3875/7760] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:34 2022] DELETE /identity/v3/projects/c8fb6b503fde439488f216d72df39cf7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:35.128199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.128784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.128784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.156374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:35.158277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:35.251076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3886/7761] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:35.259213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.259953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.260285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.280967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:35.282466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:35.291037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3876/7762] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:35.295553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.305838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88027de-98ab-47b1-aaed-4de436563d32 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.310923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.311605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.311895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.312173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.312964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:35.313290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.314895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.329616 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3887/7763] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:35.334110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.345265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428612-9024-400d-90a2-bb50b1a3f459 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.350197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.350868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.351153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.351439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.352137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.354116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.388901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3877/7764] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:35.393092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.404923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c7b7-312f-490b-8eda-f9a7969076e7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.472134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.472871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.473158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.473439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.474139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.476117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.504778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.510748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3888/7765] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:35.511090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:35.517231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192861e2-1343-4ff7-a44b-09e5609b1cb2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.524175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.524925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.525750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.525872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.526755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.528702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.546825 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3878/7766] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:35.551466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.564622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647bdf-dd9d-44dc-ba5c-18f5a76c700f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.570627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.571349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.571630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.571912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.573793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.575687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52942967-d162-4ec0-a5dd-ced05f27cd2b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.602677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.610588 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3889/7767] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:35.618124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620e1bf-d8de-4072-bcc7-eaad56b29794 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.625093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.626164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.626545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.626915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] PATH_INFO: `/v3/projects/28dfd4e923cc439e856341e94a74bd24/users/f69decb122424654a646cf4658572daf/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.657096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dfd4e923cc439e856341e94a74bd24, user_id=f69decb122424654a646cf4658572daf, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:35.663969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:35.684695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3879/7768] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:35 2022] PUT /identity/v3/projects/28dfd4e923cc439e856341e94a74bd24/users/f69decb122424654a646cf4658572daf/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:35.695736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.696316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.696782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.739915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] MFA Rules not processed for user `f69decb122424654a646cf4658572daf`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:35.741376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:35.835405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:35.880213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3890/7769] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:35.886608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:35.988120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3328c4-d4ab-4445-97f3-946c3513f5e9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:35.997753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:35.998508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:35.998787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:35.999076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:35.999857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.001839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.049984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3880/7770] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:35 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:36.053803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.067632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc7aa5-7e32-4970-9cdb-5912164fb8ca None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.166358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.167406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.167705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.168041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.169318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.171581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.203508 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3891/7771] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:36 2022] POST /identity/v3/users => generated 310 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:36.206539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.223628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04343b-4265-40d7-bc1f-3388dbdf0794 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.230339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.231155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.231653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.232111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.233083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.234956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.254834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3881/7772] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:36.259926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.274989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b243-961d-497b-be35-9c6dbfb90ff3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.282620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.283885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.284820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.285114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] PATH_INFO: `/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7/users/98850232b49842c88a6717967145252f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.306675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2b154e02aa4913a42bdb4b8a0077c7, user_id=98850232b49842c88a6717967145252f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.310494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.330647 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3892/7773] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:36 2022] PUT /identity/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7/users/98850232b49842c88a6717967145252f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:36.334927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.347866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b08f9-329c-43be-a80e-4e9cc65dd209 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.454462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.455430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.455718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.456170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.456793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.458529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b8836-9880-40fa-821b-6153bb1692a2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.471237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3882/7774] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:36.475785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.491209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b465b-ba25-4398-9077-58113f4bc251 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.499967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.500989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.501281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.501601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] PATH_INFO: `/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7/users/98850232b49842c88a6717967145252f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.504891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2b154e02aa4913a42bdb4b8a0077c7, user_id=98850232b49842c88a6717967145252f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:36.507002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:36.531360 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3893/7775] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:36 2022] PUT /identity/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7/users/98850232b49842c88a6717967145252f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:36.542284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.542597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.542873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.606647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] MFA Rules not processed for user `98850232b49842c88a6717967145252f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:36.609369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:36.654371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:36.769997 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3883/7776] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:36.784045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:36.785928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:36.881282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3787ff-2778-4a23-8cf3-148f80af14ed admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:36.898219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:36.898967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:36.899263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:36.899549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:36.975385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:36.997649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:37.000157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:37.018958 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3894/7777] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:37.708070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:37.710370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:37.829829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd0f1-38d0-4abe-af31-b7ec8fdabf92 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:37.836838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:37.837863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:37.838320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:37.838788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:37.848924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:37.850805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:37.872984 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3884/7778] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:38.315021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:38.316626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:38.408966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa855-7025-4916-8031-a4b5212fb00a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:38.413549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:38.414492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:38.414805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:38.415090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] PATH_INFO: `/v3/users/682d6a71d0c94c93919ad4ef073d046c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:38.416469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] RBAC: Authorizing `identity:delete_user(user_id=682d6a71d0c94c93919ad4ef073d046c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:38.418431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:38.481487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682d6a71d0c94c93919ad4ef073d046c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:38.482156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682d6a71d0c94c93919ad4ef073d046c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:38.495008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682d6a71d0c94c93919ad4ef073d046c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:38.512121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682d6a71d0c94c93919ad4ef073d046c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:38.520504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682d6a71d0c94c93919ad4ef073d046c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:38.528996 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3895/7779] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:38 2022] DELETE /identity/v3/users/682d6a71d0c94c93919ad4ef073d046c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:38.874329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:38.890508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949ed89-0643-4f98-86a1-f9547d1f3f5f service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:38.990862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:38.992448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:38.992840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:38.993391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] PATH_INFO: `/v3/projects/68e13ce28b1a427f98c27a95d32587cd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:38.995572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e13ce28b1a427f98c27a95d32587cd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:38.998522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:39.058249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:39.079595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e13ce28b1a427f98c27a95d32587cd', 'request_id': 'req-cb22cb72-37b7-47fb-b19b-897a53492cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.096263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e13ce28b1a427f98c27a95d32587cd', 'request_id': 'req-cb22cb72-37b7-47fb-b19b-897a53492cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.108889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e13ce28b1a427f98c27a95d32587cd', 'request_id': 'req-cb22cb72-37b7-47fb-b19b-897a53492cfa'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.128658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] The token cache is being invalidate because project 68e13ce28b1a427f98c27a95d32587cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:39.128968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.130907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.132791 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3885/7780] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:38 2022] DELETE /identity/v3/projects/68e13ce28b1a427f98c27a95d32587cd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:39.137141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:39.138686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:39.156247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5322b-4909-4340-ad36-2a9a7fe5664c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:39.237367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:39.238725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:39.239221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:39.239767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] PATH_INFO: `/v3/users/0c54736b9d54454c84b7ab5b982710cd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:39.241262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c54736b9d54454c84b7ab5b982710cd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:39.243817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:39.250060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:39.315729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c54736b9d54454c84b7ab5b982710cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.316917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c54736b9d54454c84b7ab5b982710cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.328817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c54736b9d54454c84b7ab5b982710cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.342227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c54736b9d54454c84b7ab5b982710cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.349822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c54736b9d54454c84b7ab5b982710cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:39.358135 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3896/7781] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:39 2022] DELETE /identity/v3/users/0c54736b9d54454c84b7ab5b982710cd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:39.949963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:39.951628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:39.992283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22cb72-37b7-47fb-b19b-897a53492cfa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:40.085748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:40.086753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:40.087137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:40.087519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:40.095367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:40.097467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-be08ae36-9b1e-4e84-80dd-b131efbd4706 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:22:40.117055 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jun 25 21:22:40.118242 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:22:40.121012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3886/7782] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:22:39 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:22:44.123041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:44.125424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.146783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9313dd-5340-410f-9f9a-f2cb5667378e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:44.163103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:44.164380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.164980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.165418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] PATH_INFO: `/v3/users/319fb2abff7a4b37b503ac42c47e9d30` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.167104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=319fb2abff7a4b37b503ac42c47e9d30)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:44.170218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:44.253752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319fb2abff7a4b37b503ac42c47e9d30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.254759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319fb2abff7a4b37b503ac42c47e9d30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.271447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319fb2abff7a4b37b503ac42c47e9d30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.288005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319fb2abff7a4b37b503ac42c47e9d30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.297321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319fb2abff7a4b37b503ac42c47e9d30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.306053 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3897/7783] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:44 2022] DELETE /identity/v3/users/319fb2abff7a4b37b503ac42c47e9d30 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:44.310511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.311660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.312272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.335340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:44.336982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.454192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3887/7784] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:44.462274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:44.464047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.541283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:44.558028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c24fb-5e0b-4ea6-84c5-7f19a75381a4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:44.564404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:44.565349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.566237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.566656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.579068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:44.581389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:44.594747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3898/7785] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:44.706141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:44.708585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.724119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b19dd-ae8c-4cff-9388-b86c7d4c5040 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:44.731060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:44.733918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.734296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.734672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] PATH_INFO: `/v3/users/f69decb122424654a646cf4658572daf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.736215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69decb122424654a646cf4658572daf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:44.738324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:44.809041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69decb122424654a646cf4658572daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.819413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:44.821183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.823401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:44.833074 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69decb122424654a646cf4658572daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.839272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f46d-3653-45ac-8126-2222db752cdf service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:44.844069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:44.845005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.845296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.845577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] PATH_INFO: `/v3/projects/b967d36ae4ec4537af78344111af127a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.846821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b967d36ae4ec4537af78344111af127a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:44.848877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:44.854911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69decb122424654a646cf4658572daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.855863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69decb122424654a646cf4658572daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.857041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43569a71-2826-4bd6-bd0e-43e8a45007ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69decb122424654a646cf4658572daf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.873089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3888/7786] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:44 2022] DELETE /identity/v3/users/f69decb122424654a646cf4658572daf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:44.878233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.878548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.878853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.902399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:44.903773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.912871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b967d36ae4ec4537af78344111af127a', 'request_id': 'req-d4f78a95-4a27-4db9-a57d-64d94e407ae8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.924492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b967d36ae4ec4537af78344111af127a', 'request_id': 'req-d4f78a95-4a27-4db9-a57d-64d94e407ae8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.930834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b967d36ae4ec4537af78344111af127a', 'request_id': 'req-d4f78a95-4a27-4db9-a57d-64d94e407ae8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.942501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] The token cache is being invalidate because project b967d36ae4ec4537af78344111af127a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:44.942796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.943461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4f78a95-4a27-4db9-a57d-64d94e407ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:44.945376 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3899/7787] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:44 2022] DELETE /identity/v3/projects/b967d36ae4ec4537af78344111af127a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:44.950601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b166a6e-1228-48a8-8ddc-3ca8573ae143 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:44.950601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b166a6e-1228-48a8-8ddc-3ca8573ae143 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:44.950850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b166a6e-1228-48a8-8ddc-3ca8573ae143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:44.974048 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3889/7788] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:44.984888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:44.986369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:44.991180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8b166a6e-1228-48a8-8ddc-3ca8573ae143 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:44.992490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8b166a6e-1228-48a8-8ddc-3ca8573ae143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.005735 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3900/7789] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:45.013391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.013679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.013993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.045084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:45.046435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.063334 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3901/7790] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:45.067072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.081368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be545-6318-4825-957f-6c2904e0b45b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.083215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc523-a2a8-4f11-a54a-a7dfba132180 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.086337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.087026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.087309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.087592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.088505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:45.088705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.089740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.090408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.090720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.091022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.091392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.107547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.114775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.114988 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3902/7791] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:45.114988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.114988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.122683 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3890/7792] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:45.123391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.134769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542b0c0-be71-4159-9dbe-3ce3a8a20531 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.136635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32328-be5e-4bf1-8bb5-a401048fe2c6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.142040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.144686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.145386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.145673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.145951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.146644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.148899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.148899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.149199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.150000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.153097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.166143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.167602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.186584 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3891/7793] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:45 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:45.188724 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3903/7794] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:45.190339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.265067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:45.307817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9290-270e-4565-8e9c-6cc772929a7d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.317634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.319099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.319550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.319994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.321103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.323632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.357308 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3892/7795] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:45 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:45.358503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.374890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051f8a-83b7-44c9-902f-100ccf68f52f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.381865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.383068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.384251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.384641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.385799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.388279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.400447 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3904/7796] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:45.404461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.417426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b776-04ba-4c3a-ac19-a0d93d6d6297 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.424889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.425956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.426490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.427021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.428042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.430029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.441393 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3893/7797] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:45.445741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.457241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2eb50-b9da-4a69-a989-276b3aad62ad admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.463553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.464575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.465132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.465629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] PATH_INFO: `/v3/projects/419fc04604d946eeabdf8ee39997270e/users/8705ef2687e44f82aadb0a88a2129381/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.484877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419fc04604d946eeabdf8ee39997270e, user_id=8705ef2687e44f82aadb0a88a2129381, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.488628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9112a6-07ea-43d9-894c-1f40bd194c70 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.503785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.505828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.519771 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3905/7798] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:45 2022] PUT /identity/v3/projects/419fc04604d946eeabdf8ee39997270e/users/8705ef2687e44f82aadb0a88a2129381/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:45.528632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9e40-29b3-4f72-af54-258604aeb010 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.531386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.531727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.532031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.588055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.589024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.589428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.589852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] PATH_INFO: `/v3/projects/28dfd4e923cc439e856341e94a74bd24` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.591654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dfd4e923cc439e856341e94a74bd24)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.593866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.595776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] MFA Rules not processed for user `8705ef2687e44f82aadb0a88a2129381`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:45.600479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.645567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:45.663290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dfd4e923cc439e856341e94a74bd24', 'request_id': 'req-6bb6f652-608e-40ea-878d-ad240e592279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.675356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dfd4e923cc439e856341e94a74bd24', 'request_id': 'req-6bb6f652-608e-40ea-878d-ad240e592279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.684059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dfd4e923cc439e856341e94a74bd24', 'request_id': 'req-6bb6f652-608e-40ea-878d-ad240e592279'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.695814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3906/7799] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:45.700201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] The token cache is being invalidate because project 28dfd4e923cc439e856341e94a74bd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:45.700547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.701309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.705097 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3894/7800] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:45 2022] DELETE /identity/v3/projects/28dfd4e923cc439e856341e94a74bd24 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:45.709017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.712528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:45.714590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.725359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb825c-9930-4461-aefc-03a3b80a18b1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.801217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f652-608e-40ea-878d-ad240e592279 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:45.806610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.807548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.808003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.808192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.811371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:45.830669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:45.834717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:45.835648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:45.835989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:45.836324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] PATH_INFO: `/v3/users/98850232b49842c88a6717967145252f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:45.837666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98850232b49842c88a6717967145252f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.839752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.909223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98850232b49842c88a6717967145252f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.910006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98850232b49842c88a6717967145252f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.918797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:45.920056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98850232b49842c88a6717967145252f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.922010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:45.938122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3895/7801] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:45.938845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98850232b49842c88a6717967145252f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.948624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8c6cc9cf-5df1-4c42-a2fd-09e7c4d004b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98850232b49842c88a6717967145252f'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:45.959030 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3907/7802] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:45 2022] DELETE /identity/v3/users/98850232b49842c88a6717967145252f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:46.163367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.166415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:46.187384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0b53-4e58-41a2-ad4b-3d071b8a327c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.277783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.278697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.278989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.279267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] PATH_INFO: `/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.281051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2b154e02aa4913a42bdb4b8a0077c7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.283414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.347948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2b154e02aa4913a42bdb4b8a0077c7', 'request_id': 'req-6e558b99-a171-4c17-9de3-ec1b2d636fd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:46.359672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2b154e02aa4913a42bdb4b8a0077c7', 'request_id': 'req-6e558b99-a171-4c17-9de3-ec1b2d636fd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:46.371869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2b154e02aa4913a42bdb4b8a0077c7', 'request_id': 'req-6e558b99-a171-4c17-9de3-ec1b2d636fd3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:46.402141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] The token cache is being invalidate because project 7f2b154e02aa4913a42bdb4b8a0077c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:46.402441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:46.403269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e558b99-a171-4c17-9de3-ec1b2d636fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:46.405379 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3896/7803] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:46 2022] DELETE /identity/v3/projects/7f2b154e02aa4913a42bdb4b8a0077c7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:46.410477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.410992 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.411225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.433071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:46.434554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:46.503559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:46.529255 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3908/7804] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:46.533742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.534038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.534323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.556654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:46.558198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:46.575511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3897/7805] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:46.577238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.596539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964c40c-59b0-4a43-9d57-12c5c78cbc2e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.602952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.604005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.604298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.604637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.605387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:46.605765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.607426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.627976 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3909/7806] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:22:46.632466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.642549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a452-54d0-4513-9919-6f09c348b50c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.648518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.655049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.655342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.655703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.656457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.658455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.692017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3898/7807] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:46 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:46.693260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.703972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50135c50-8810-4feb-b9ad-12e910edf348 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.763777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.764456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.764751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.765031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.765821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.767940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.792488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3910/7808] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:46 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:46.794163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.805454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806622dc-f96e-464a-956c-e6dd1ac87102 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.811220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.812104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.812535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.812910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.813833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.815997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.833395 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3899/7809] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:46.834663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.845316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b1ce-51dc-4e18-8f24-b5c5c4a06bc0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.850516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.851230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.851574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.851914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.852818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.854554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2827-31a2-4a63-85de-2ec147cd0700 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.865820 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3911/7810] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:46.870326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:46.877433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:46.883946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8762b1-4956-4436-a0d8-2bc739975992 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:46.891120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:46.892546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.893211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.893641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] PATH_INFO: `/v3/projects/e3e30110b84947109180a84543fd1f7e/users/a7113e39532740ada685747a3c961190/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.909183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e30110b84947109180a84543fd1f7e, user_id=a7113e39532740ada685747a3c961190, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:46.911983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:46.927250 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3900/7811] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:46 2022] PUT /identity/v3/projects/e3e30110b84947109180a84543fd1f7e/users/a7113e39532740ada685747a3c961190/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:46.939575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:46.939903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:46.940203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:46.977299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] MFA Rules not processed for user `a7113e39532740ada685747a3c961190`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:46.979269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:47.064867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3912/7812] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:47.069345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.175204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028f18-82c2-447d-b07f-18a2dc1c4491 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.180487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.181181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.181481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.181758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.182778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.185399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.228782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3901/7813] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:47 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:47.229471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.243257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2abb6-6c4f-45c1-89e7-b43f9f51b2d9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.302266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:47.324670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.325528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.325896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.326139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.326957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.330384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.362133 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3913/7814] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:47 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:47.365714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.383132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed09-371e-4ccf-8f56-77b7fe34e77a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.391806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.392893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.393219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.393594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.394757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.396982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.422012 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3902/7815] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:47.426436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.439297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1eb89-c786-4e37-8001-e870284c9f0b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.459915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.462336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.462909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.463490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] PATH_INFO: `/v3/projects/455f122e8d4a432499e814d04a34e69e/users/9821b092cb894be2bf7484eea8f9db34/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.486712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=455f122e8d4a432499e814d04a34e69e, user_id=9821b092cb894be2bf7484eea8f9db34, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.490147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.510246 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3914/7816] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:47 2022] PUT /identity/v3/projects/455f122e8d4a432499e814d04a34e69e/users/9821b092cb894be2bf7484eea8f9db34/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:47.514257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.532975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80d1b-5c62-4333-96c9-70c0de70b6f7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.640166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.641678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.641976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.642279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.643539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.646080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb039f-b658-49f1-a0d0-5e6e209672f5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.661818 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3903/7817] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:47.666296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.683314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709f47-e7a4-4363-a4a8-dfd37192f18f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:47.693377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:47.694373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.694739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.695185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] PATH_INFO: `/v3/projects/455f122e8d4a432499e814d04a34e69e/users/9821b092cb894be2bf7484eea8f9db34/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.705668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=455f122e8d4a432499e814d04a34e69e, user_id=9821b092cb894be2bf7484eea8f9db34, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:47.709754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:47.749079 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3915/7818] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:47 2022] PUT /identity/v3/projects/455f122e8d4a432499e814d04a34e69e/users/9821b092cb894be2bf7484eea8f9db34/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:47.751543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:47.751843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:47.752150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:47.794511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] MFA Rules not processed for user `9821b092cb894be2bf7484eea8f9db34`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:47.796774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:47.870889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:47.909882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3904/7819] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:47.919572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:47.921972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:48.025094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8dad7-dec8-4872-8be1-cf152f000bab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:48.029642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:48.030445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:48.030807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:48.031289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:48.042717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:48.044472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:48.060656 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3916/7820] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:48.606373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:48.628291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafba0f-4403-4877-8229-386f65b83fe2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:48.648234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:48.648469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:48.648860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:48.649480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:48.655220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:48.782101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:48.797127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afb7a-7268-412b-9be8-6190245553d9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:48.849935 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3905/7821] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:51.426155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:51.437896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8547d-064d-47c7-a92b-50c867608585 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:51.443566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:51.444956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:51.445231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:51.445510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] PATH_INFO: `/v3/users/a7113e39532740ada685747a3c961190` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:51.448882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7113e39532740ada685747a3c961190)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:51.450957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:51.535081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7113e39532740ada685747a3c961190'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:51.535334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7113e39532740ada685747a3c961190'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:51.550271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7113e39532740ada685747a3c961190'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:51.581966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7113e39532740ada685747a3c961190'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:51.596359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7113e39532740ada685747a3c961190'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:51.604016 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3917/7822] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:51 2022] DELETE /identity/v3/users/a7113e39532740ada685747a3c961190 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:51.608691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:51.609154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:51.609320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:51.630519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:51.632230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:51.716646 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3906/7823] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:22:51.725235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:51.726823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:51.750905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:51.810120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335c22-fef5-43a1-bb05-0f21b9356349 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:51.818534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:51.819238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:51.819525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:51.819873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:51.834815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:51.836511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:51.854599 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3918/7824] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:52.210716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:52.212240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:52.231310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ec11-a1a2-4543-a3ad-a3da7ea19a2c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:52.240031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:52.240990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:52.241276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:52.241554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] PATH_INFO: `/v3/projects/e3e30110b84947109180a84543fd1f7e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:52.243201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e30110b84947109180a84543fd1f7e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:52.245404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:52.323715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e30110b84947109180a84543fd1f7e', 'request_id': 'req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.335328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e30110b84947109180a84543fd1f7e', 'request_id': 'req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.342395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:52.345392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e30110b84947109180a84543fd1f7e', 'request_id': 'req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.364473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] The token cache is being invalidate because project e3e30110b84947109180a84543fd1f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:52.365113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.366360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.368633 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3907/7825] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:52 2022] DELETE /identity/v3/projects/e3e30110b84947109180a84543fd1f7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:52.372931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:52.392739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7cc71-6237-4e3c-83b4-51f2b1ddf782 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:52.450941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:52.453077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:52.453366 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:52.453648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] PATH_INFO: `/v3/users/9821b092cb894be2bf7484eea8f9db34` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:52.454946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9821b092cb894be2bf7484eea8f9db34)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:52.456975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:52.507200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9821b092cb894be2bf7484eea8f9db34'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.507870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9821b092cb894be2bf7484eea8f9db34'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.517554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9821b092cb894be2bf7484eea8f9db34'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.531161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9821b092cb894be2bf7484eea8f9db34'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.539261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8b8c6d1-5755-452b-8ab7-8cb2f1afb369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9821b092cb894be2bf7484eea8f9db34'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:52.545893 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3919/7826] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:52 2022] DELETE /identity/v3/users/9821b092cb894be2bf7484eea8f9db34 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:52.895967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:52.899411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:52.929803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb3c0-87ca-40ab-aa7a-5e2f047977a1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.042276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.043627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.043954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.044380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] PATH_INFO: `/v3/projects/455f122e8d4a432499e814d04a34e69e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.046861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] RBAC: Authorizing `identity:delete_project(project_id=455f122e8d4a432499e814d04a34e69e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.050227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.194162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455f122e8d4a432499e814d04a34e69e', 'request_id': 'req-f635827b-8e1f-429b-ab9d-fc04b7d4218b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:53.214247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455f122e8d4a432499e814d04a34e69e', 'request_id': 'req-f635827b-8e1f-429b-ab9d-fc04b7d4218b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:53.226605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455f122e8d4a432499e814d04a34e69e', 'request_id': 'req-f635827b-8e1f-429b-ab9d-fc04b7d4218b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:53.238802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] The token cache is being invalidate because project 455f122e8d4a432499e814d04a34e69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:53.239003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:53.239597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f635827b-8e1f-429b-ab9d-fc04b7d4218b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:53.241224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3908/7827] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:52 2022] DELETE /identity/v3/projects/455f122e8d4a432499e814d04a34e69e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:53.246270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.246554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.246838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.276359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:53.278265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:53.323400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:53.364395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3920/7828] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:53.373316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.373887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.374168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.397348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:53.398601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:53.411549 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3909/7829] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:53.412583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.424354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac5714-a98e-4ee9-9051-2776009d5efa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.431297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.432117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.432535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.433055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.434605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:53.435155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.437231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.455180 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3921/7830] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:53.459309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.477173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe5731-0027-44bf-ab8a-36b66e4c1918 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.483561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.484584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.484927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.485275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.487584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.488336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.526260 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3910/7831] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:53 2022] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:53.526844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.546748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8946-655a-4855-86bf-7a53c56eaf95 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.730444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.731170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.731458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.731734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.732657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.738938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.767626 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3922/7832] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:53 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:53.776625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.789177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f029-d17b-49b9-9b3b-a196084a7190 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.813266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.826589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.827013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.827357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.828630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.830406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.849285 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3911/7833] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:53.849797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.870262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ecf9-0fab-4490-a644-2d32ca357d90 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.877139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.877986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.878294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.878619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.879374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.881240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef6c5-3558-4132-9004-deb3ad09466e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.902127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:53.908676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3923/7834] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:53.915558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e579b-1a36-4743-993f-15550239ef0d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:53.933652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:53.935091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.935579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.936305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] PATH_INFO: `/v3/projects/ae4ca2758c854987bbb09fc508185913/users/377dba60344a4ae9803ab2397e65af1c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:53.964318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4ca2758c854987bbb09fc508185913, user_id=377dba60344a4ae9803ab2397e65af1c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:53.967968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:53.996584 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3912/7835] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:53 2022] PUT /identity/v3/projects/ae4ca2758c854987bbb09fc508185913/users/377dba60344a4ae9803ab2397e65af1c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:53.998540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:53.999083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:53.999548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.036373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] MFA Rules not processed for user `377dba60344a4ae9803ab2397e65af1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:54.037761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.128808 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3924/7836] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:54.141116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.144503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.180239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:54.237791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804471-f072-4762-b9d4-cc69fdce735a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.242244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.242911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.243213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.243604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.256995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.259772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.260865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.261100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.272809 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3913/7837] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:54.308375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.310017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:54.345907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7affd-40af-4d21-86ab-b71b8e1ec306 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.352019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.352958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.353234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.353510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] PATH_INFO: `/v3/users/c845f86f1b6244f7a53996329294f2cd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.354723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c845f86f1b6244f7a53996329294f2cd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.357166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.382155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ab806-ca85-4822-aab3-edf0e384dda4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.388364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.389333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.389681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.389969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] PATH_INFO: `/v3/users/377dba60344a4ae9803ab2397e65af1c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.392004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377dba60344a4ae9803ab2397e65af1c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.393996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.425790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c845f86f1b6244f7a53996329294f2cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.426970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c845f86f1b6244f7a53996329294f2cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.435950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c845f86f1b6244f7a53996329294f2cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.449538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c845f86f1b6244f7a53996329294f2cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.451454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377dba60344a4ae9803ab2397e65af1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.459350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f9bc9bc7-5c0c-44c6-8ff8-6aa1b4fba0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c845f86f1b6244f7a53996329294f2cd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.462168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377dba60344a4ae9803ab2397e65af1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.467415 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3925/7838] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:54 2022] DELETE /identity/v3/users/c845f86f1b6244f7a53996329294f2cd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:54.475707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377dba60344a4ae9803ab2397e65af1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.476502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377dba60344a4ae9803ab2397e65af1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.477305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377dba60344a4ae9803ab2397e65af1c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.495606 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3914/7839] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:54 2022] DELETE /identity/v3/users/377dba60344a4ae9803ab2397e65af1c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:54.500127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.500561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.501248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.522230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:54.523573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.595592 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3926/7840] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:54.607647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.609397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.659299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.660479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:54.661677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.684485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6001f15-9fad-4de6-a77f-91d10ab3230d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.692985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.693927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.694198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.694496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] PATH_INFO: `/v3/projects/041615c7a84b47f88e21c6a4e19dd7ec` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.696666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=041615c7a84b47f88e21c6a4e19dd7ec)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.698757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.700585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf0d07-d884-4aff-8148-88d627e48f48 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.705277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.706017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.706364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.706647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.717285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.718881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887458a-9c46-4eba-a835-2eb3ba343cd6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.729179 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3915/7841] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:54.752024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041615c7a84b47f88e21c6a4e19dd7ec', 'request_id': 'req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.753986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:54.763156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041615c7a84b47f88e21c6a4e19dd7ec', 'request_id': 'req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.771990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041615c7a84b47f88e21c6a4e19dd7ec', 'request_id': 'req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.789152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] The token cache is being invalidate because project 041615c7a84b47f88e21c6a4e19dd7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:54.789455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.790184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9c3230c5-bc70-40e2-9ad7-40d1f30963eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:54.792301 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3927/7842] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:54 2022] DELETE /identity/v3/projects/041615c7a84b47f88e21c6a4e19dd7ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:54.798384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.799442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.800103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.832983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:54.834429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.913903 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3916/7843] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:54.922220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.923073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.923518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.942929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:54.944164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:54.952797 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3928/7844] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:54.957060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:54.968617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528062d-ba95-40e8-bc41-deb0b36133e7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:54.973485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:54.974251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:54.974602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:54.976657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:54.977634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:54.978714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:54.981257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:54.999460 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3917/7845] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:22:55.000509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.010395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c89c1-ca62-4661-909f-edc63e6d4221 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.017184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.018332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.018767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.019217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.019983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.022000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.068115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3929/7846] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:54 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:55.069824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.083297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fd8c-0161-4b91-a90a-9d4f3a9036a4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.152137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.152944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.153354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.153635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.154346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.156326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.181413 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3918/7847] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:55.185766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.197027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56914-e145-42b9-aee2-685be2fe88c6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.202961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.203807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.204096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.204375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.205144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.206778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.220793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3930/7848] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:22:55.222046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.233560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c697bd9-7310-4634-849f-0eb72f59a56c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.238526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.239270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.239574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.239860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.240612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.242315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.253010 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3919/7849] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:55.257310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.268487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723eb14-4f74-4171-96a0-808cb97f1dc9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.273585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.274489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.274770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.275051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] PATH_INFO: `/v3/projects/4aec2f850eac42b2ada24f111fcbcaff/users/251e78d095684e13ac5404d0c1aed630/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.290562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aec2f850eac42b2ada24f111fcbcaff, user_id=251e78d095684e13ac5404d0c1aed630, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.293365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094f87f-699a-4857-bc28-9fa5728c5c70 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.299108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.301129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.314670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34c4d-be75-4559-beba-eeb3cc655fe4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.339584 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3931/7850] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:55 2022] PUT /identity/v3/projects/4aec2f850eac42b2ada24f111fcbcaff/users/251e78d095684e13ac5404d0c1aed630/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:55.344986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.345260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.345541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.372549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:55.375568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] MFA Rules not processed for user `251e78d095684e13ac5404d0c1aed630`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:55.377002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.389160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.390050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.390393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.390643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] PATH_INFO: `/v3/projects/ae4ca2758c854987bbb09fc508185913` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.391881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4ca2758c854987bbb09fc508185913)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.393912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.446647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4ca2758c854987bbb09fc508185913', 'request_id': 'req-1a3537e0-7b65-4592-85b0-102247376bc5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:55.450890 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3932/7851] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:55.455597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4ca2758c854987bbb09fc508185913', 'request_id': 'req-1a3537e0-7b65-4592-85b0-102247376bc5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:55.463200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4ca2758c854987bbb09fc508185913', 'request_id': 'req-1a3537e0-7b65-4592-85b0-102247376bc5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:55.463911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.465401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.483150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] The token cache is being invalidate because project ae4ca2758c854987bbb09fc508185913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:22:55.483718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:55.484474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1a3537e0-7b65-4592-85b0-102247376bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:55.486570 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3920/7852] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:22:55 2022] DELETE /identity/v3/projects/ae4ca2758c854987bbb09fc508185913 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:22:55.491235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96591b-cb05-4264-819b-6637708fced4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.491586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96591b-cb05-4264-819b-6637708fced4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.491935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96591b-cb05-4264-819b-6637708fced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.510950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5c96591b-cb05-4264-819b-6637708fced4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:55.512397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5c96591b-cb05-4264-819b-6637708fced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.580455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:55.601220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64230885-f73b-475d-b640-7ea1a7f46a68 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.611071 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3921/7853] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:55.612604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.612907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.613188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.631959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:55.633232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.643241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3922/7854] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:55.646498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.657128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b223f-6006-4877-bb0b-886ad01d9f23 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.662184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.662863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.663148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.663430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.664173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:22:55.664539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.666177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.678869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3923/7855] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:22:55.683255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.687863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.688868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.689163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.689442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.691599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:55.693992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08670dd2-14da-4e71-873f-08f4b8682d0b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.700381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.701033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.701322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.701605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.702832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.705251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.739987 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3924/7856] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:22:55.741020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.761713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.763345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.775402 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3933/7857] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:55.815188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:55.831955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a26-1b98-4f60-8ce9-dc7ee71907cb admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.838165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.839585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.839585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.839585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.840644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.842637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.874880 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3925/7858] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:22:55 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:22:55.880273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.892064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04895-bf21-41f0-a86e-919ee0a7af60 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.896848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.897620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.897812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.898095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.898826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.900547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.912999 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3934/7859] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:55.917411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.932530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ff4a-a9ba-411c-a186-f570b9420c8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.937989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.938911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.939202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.939486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:55.940494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:55.947269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235104d7-e9a6-4a98-9092-f0ea3e666d0f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:55.962391 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3926/7860] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:22:55.966462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:55.978040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6a31-e8e1-44c8-a8d6-adc6393044f5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:55.983926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:55.984956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:55.985240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:55.985521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] PATH_INFO: `/v3/projects/3d85c54c9e9b4dcba311e759f4b23834/users/d0549a84f2af451a8b72eeb624723e0a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:56.002515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d85c54c9e9b4dcba311e759f4b23834, user_id=d0549a84f2af451a8b72eeb624723e0a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:56.005403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:56.019943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3935/7861] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:22:55 2022] PUT /identity/v3/projects/3d85c54c9e9b4dcba311e759f4b23834/users/d0549a84f2af451a8b72eeb624723e0a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:56.031747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:56.032141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:56.032457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:56.064818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] MFA Rules not processed for user `d0549a84f2af451a8b72eeb624723e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:56.066137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:56.162025 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3927/7862] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:56.169100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:56.171236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:56.275257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e225d1-2d9f-4e56-b21d-f77e9bf62499 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:56.280325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:56.281037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:56.281337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:56.281609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:56.291608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:56.293244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:56.304626 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3936/7863] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:22:58.522172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:58.540353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc575c-0257-49bb-bf91-4171229cf91a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:58.549657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:58.550550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:58.550992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:58.551494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:58.554006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:58.572090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:58.573616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a84e-cc06-41fd-bb4f-2daa2efb2152 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:58.601726 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3928/7864] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:22:58.644044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:58.644044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:58.667550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:58.747307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e713c0-b678-45bf-9914-db3921ccf846 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:58.752961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:58.754004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:58.754347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:58.754647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] PATH_INFO: `/v3/users/251e78d095684e13ac5404d0c1aed630` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:58.757107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251e78d095684e13ac5404d0c1aed630)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:58.759495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:58.860669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251e78d095684e13ac5404d0c1aed630'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:58.861499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251e78d095684e13ac5404d0c1aed630'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:58.873872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251e78d095684e13ac5404d0c1aed630'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:58.914712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251e78d095684e13ac5404d0c1aed630'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:58.925513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251e78d095684e13ac5404d0c1aed630'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:22:58.937101 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3937/7865] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:22:58 2022] DELETE /identity/v3/users/251e78d095684e13ac5404d0c1aed630 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:22:58.940763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:58.942237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:58.942565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:58.966572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:22:58.968394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:59.092296 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3929/7866] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:22:59.117812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:22:59.119598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:22:59.235403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f8ec6-a073-49d3-99a1-bd332e370876 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:22:59.240165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:22:59.241362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:22:59.241794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:22:59.241999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:22:59.261795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:22:59.263474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3b9a-0e4c-4c25-a6fd-2a594440e381 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:22:59.276576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3938/7867] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:00.317466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:00.319037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:00.346501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9902-a781-491c-a1cd-fde3c46dbb7a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:00.359043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:00.359962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.361203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.362012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] PATH_INFO: `/v3/projects/4aec2f850eac42b2ada24f111fcbcaff` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.364000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aec2f850eac42b2ada24f111fcbcaff)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:00.367545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:00.410477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:00.440932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aec2f850eac42b2ada24f111fcbcaff', 'request_id': 'req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:00.456022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aec2f850eac42b2ada24f111fcbcaff', 'request_id': 'req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:00.465662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aec2f850eac42b2ada24f111fcbcaff', 'request_id': 'req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:00.488170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] The token cache is being invalidate because project 4aec2f850eac42b2ada24f111fcbcaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:00.488824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:00.489741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3bb3bc21-60b0-4e44-aa4b-9bc428c6636c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:00.491902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3930/7868] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:00 2022] DELETE /identity/v3/projects/4aec2f850eac42b2ada24f111fcbcaff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:00.497751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.498810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.499318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.521713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:00.523353 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:00.553313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:00.597646 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3939/7869] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:00.606063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.606355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.606723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.631693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:00.643070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:00.654620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3931/7870] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:00.658981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:00.670019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a9f5e-f30a-4bce-931b-00f8403de732 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:00.674983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:00.675705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.675989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.676535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.677283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:00.677589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:00.679229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:00.694896 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3940/7871] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:00.701697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:00.717227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d277844-9fd8-488b-b683-4cec1a6d92e3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:00.723990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:00.724914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.725203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.725487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.726203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:00.730004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:00.784778 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3932/7872] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:00 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:00.786000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:00.829915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9ef2-ac21-4dfc-89ad-ce9c91f8f933 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:00.925279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:00.926234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.926743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:00.927197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:00.928022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:00.931479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:00.969585 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3941/7873] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:00 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:00.973752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:00.988048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5046c-f785-4cf9-b835-d43d2b904350 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:00.998372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:00.999535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:00.999751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.000025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.001451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.004198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.023764 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3933/7874] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:01.024120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.038404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b56a-78cd-4429-a7bf-183ea2dc73ac admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.050171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.051368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.051368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.051743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.052666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.054430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81013c-6184-4da8-835a-ae63301fa959 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.082289 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3942/7875] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:01.083326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.098953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d9521-7828-45cf-8a83-411c8eaf28e7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.111087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.114240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.115017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.115327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] PATH_INFO: `/v3/projects/ca53af77209749bea474b39f5d3b2973/users/139dc2a9d94144648be77c15dee14473/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.148307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca53af77209749bea474b39f5d3b2973, user_id=139dc2a9d94144648be77c15dee14473, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.151324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.186308 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3934/7876] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:01 2022] PUT /identity/v3/projects/ca53af77209749bea474b39f5d3b2973/users/139dc2a9d94144648be77c15dee14473/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:01.198327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.198822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.199209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.254703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] MFA Rules not processed for user `139dc2a9d94144648be77c15dee14473`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:01.256263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:01.371871 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3943/7877] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:01.376165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.471345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5425-3da6-4fa2-a09c-85478d47daff admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.477318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.478024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.478495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.478927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.479777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.482761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.518396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3935/7878] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:01 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:01.522315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.540999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578162dd-0198-4dc9-bcd8-ef266ea43db5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.589816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:01.685736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.686560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.686846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.687117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.688303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.690409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.722169 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3944/7879] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:01 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:01.723878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.741052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fee77-acbd-40a0-9be1-feb3e202b8b2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.750594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.751843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.751843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.751843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.752553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.754698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.770644 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3936/7880] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:01.773745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.788685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627bdc3-5390-4677-a589-0fcfc66e88ec admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.794888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.795818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.796083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.796612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] PATH_INFO: `/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5/users/6ed4d2ff1a1140f598733c39e74dc254/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.830805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4561a5d816b34f0d8050ab300d8a8bb5, user_id=6ed4d2ff1a1140f598733c39e74dc254, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.833926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:01.860485 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3945/7881] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:01 2022] PUT /identity/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5/users/6ed4d2ff1a1140f598733c39e74dc254/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:01.863880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:01.882733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96103-3542-4f02-96fe-74df099ce58e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:01.930647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:01.991155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:01.992087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:01.992541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:01.992939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:01.994562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:01.996719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4678c63-98ad-4804-ac0c-3e500f358e84 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.014847 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3937/7882] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:02.016471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.045384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0cc31-5bb3-4443-9d19-bc465f48cdc1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.066252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.067556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.067946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.068317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] PATH_INFO: `/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5/users/6ed4d2ff1a1140f598733c39e74dc254/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.078348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4561a5d816b34f0d8050ab300d8a8bb5, user_id=6ed4d2ff1a1140f598733c39e74dc254, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.086496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.128286 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3946/7883] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:02 2022] PUT /identity/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5/users/6ed4d2ff1a1140f598733c39e74dc254/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:02.196502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.196928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.197304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.234578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] MFA Rules not processed for user `6ed4d2ff1a1140f598733c39e74dc254`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:02.236315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:02.378037 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3938/7884] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:02.383084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.405370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8602803-9e04-46cd-9a23-fa6fe27cb67e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.410537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.411224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.411507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.411784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.412614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.414482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.441608 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3947/7885] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:02 2022] POST /identity/v3/domains => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:02.444737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.455480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbcdc3-d1f9-4505-8b3b-c3a745615b6c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.527502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.528379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.528808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.529207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.530058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.531802 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.552996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3939/7886] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:02 2022] POST /identity/v3/domains => generated 277 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:02.554392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.566230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e2dd0-bd3d-45bc-9a12-317d674ffffa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.632117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.632852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.633202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.633426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.634183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.635841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.656136 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3948/7887] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:02 2022] POST /identity/v3/domains => generated 277 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:02.660386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.678852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5651-b8ba-4d4b-a03d-19c4967692cf tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.740038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:02.759321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.760114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.760503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.760858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.761797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.763517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.783089 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3940/7888] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:02 2022] POST /identity/v3/domains => generated 280 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:02.787415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:02.799455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f87a9b-bb63-4a04-aa2d-c3707529dc4e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:02.882617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:02.890579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:02.892405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:02.893181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:02.893496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/969cdb37831f4e73af6ad4934545a81b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:02.928673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=969cdb37831f4e73af6ad4934545a81b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:02.930766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:02.968710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '969cdb37831f4e73af6ad4934545a81b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:02.972672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '969cdb37831f4e73af6ad4934545a81b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.039012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.051476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.061408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.079616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project 969cdb37831f4e73af6ad4934545a81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:03.079913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.080680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.092555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.096528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.097652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '969cdb37831f4e73af6ad4934545a81b', 'request_id': 'req-2c10fa69-e345-4e63-a082-d9c9d3d529a4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.109563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3949/7889] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:02 2022] DELETE /identity/v3/domains/969cdb37831f4e73af6ad4934545a81b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:03.110572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:03.112354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:03.135666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5940a-db2d-4666-96bf-b17d10cf24e5 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:03.225000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:03.225897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:03.226857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:03.227243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:03.228458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:03.230703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:03.249964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3941/7890] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:03 2022] POST /identity/v3/domains => generated 248 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:03.254484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:03.270797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fa69-e345-4e63-a082-d9c9d3d529a4 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:03.356139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:03.358514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:03.359030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:03.359528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/98d18383931940238db4060adf9e19e6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:03.380268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=98d18383931940238db4060adf9e19e6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:03.383387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:03.423507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.425117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.437129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:03.460983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.462488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.470126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:03.472076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:03.473908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3950/7891] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:03 2022] PATCH /identity/v3/domains/98d18383931940238db4060adf9e19e6 => generated 249 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:23:03.496991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23984378-868b-4a2d-8c65-702e109f4a89 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:03.633664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:03.634836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:03.635130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:03.635418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/98d18383931940238db4060adf9e19e6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:03.663713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=98d18383931940238db4060adf9e19e6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:03.665599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:03.707000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.712205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '98d18383931940238db4060adf9e19e6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.776754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:03.787362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.801164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.822196 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.860600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project 98d18383931940238db4060adf9e19e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:03.861294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.862212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.880352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.895830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.896576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '98d18383931940238db4060adf9e19e6', 'request_id': 'req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:03.905377 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3942/7892] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:03 2022] DELETE /identity/v3/domains/98d18383931940238db4060adf9e19e6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:03.913796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:03.926096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1d67-5100-4c3a-ba5c-351622fe5308 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:04.051724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:04.052872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:04.054652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:04.055807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:04.061574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:04.063370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:04.097024 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3951/7893] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:03 2022] POST /identity/v3/domains => generated 277 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:04.101511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:04.103845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:04.119025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b48a3-6abe-4e7f-8041-b2a5d4829e6e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:04.229934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:04.231296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:04.231651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:04.232493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/4aa14fb26318413b9693b6376b59d9a5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:04.251395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4aa14fb26318413b9693b6376b59d9a5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:04.254393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:04.301547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.302465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.345590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.346825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.356718 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3943/7894] 10.222.0.39 () {60 vars in 1249 bytes} [Sat Jun 25 21:23:04 2022] PATCH /identity/v3/domains/4aa14fb26318413b9693b6376b59d9a5 => generated 279 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:04.358205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:04.361472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:04.405151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917de2f-16ac-4b33-ba6c-e1f7305a55fa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:04.506631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:04.508566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:04.508933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:04.509227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/4aa14fb26318413b9693b6376b59d9a5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:04.542182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=4aa14fb26318413b9693b6376b59d9a5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:04.549600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:04.552476 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3952/7895] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:23:04 2022] GET /identity/v3/domains/4aa14fb26318413b9693b6376b59d9a5 => generated 279 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:04.556415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:04.573448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6993-84f1-49cd-9960-cd97f16af7aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:04.590628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:04.591913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:04.592354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:04.592791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/4aa14fb26318413b9693b6376b59d9a5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:04.595484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4aa14fb26318413b9693b6376b59d9a5)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:04.597730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:04.653250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.663980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.750325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:04.765373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.780819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.801001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.849782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project 4aa14fb26318413b9693b6376b59d9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:04.850443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.852054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.867703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.873964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.875474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4aa14fb26318413b9693b6376b59d9a5', 'request_id': 'req-29db25cb-9082-47bc-9347-cb84081bbf5e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:04.886086 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3944/7896] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:04 2022] DELETE /identity/v3/domains/4aa14fb26318413b9693b6376b59d9a5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:04.887141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:04.889614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:04.904719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f8387-88d2-4bc2-b529-1bcbaaef208c tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:04.987139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:04.987833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:04.988231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:04.988869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:04.989665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:04.991408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.014406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3953/7897] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 21:23:04 2022] GET /identity/v3/domains => generated 1347 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:05.018781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.035939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db25cb-9082-47bc-9347-cb84081bbf5e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.064251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.065552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.065906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.066250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/4aa14fb26318413b9693b6376b59d9a5` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.075891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find domain: 4aa14fb26318413b9693b6376b59d9a5.: keystone.exception.DomainNotFound: Could not find domain: 4aa14fb26318413b9693b6376b59d9a5. Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4aa14fb26318413b9693b6376b59d9a5. Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:05.110236 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:05.111519 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4aa14fb26318413b9693b6376b59d9a5. Jun 25 21:23:05.112931 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:05.119062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.121082 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3945/7898] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:05 2022] PATCH /identity/v3/domains/4aa14fb26318413b9693b6376b59d9a5 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:05.142267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b325a-c43b-4412-9cd5-abbe8b3e1750 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.148165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.148965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.149401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.149774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.150615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:05.152410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.165946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:05.180616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.184604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3954/7899] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:05 2022] POST /identity/v3/domains => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:05.192902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ac3-c59b-43ba-bdbc-de9d1840261b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.283509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.284324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.284762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.285045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.285875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:05.288446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.338950 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3946/7900] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:05 2022] POST /identity/v3/users => generated 348 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:05.340806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.369383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1ae8-efe9-4645-861a-ac3a0f846227 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.390364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.391073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.391358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.391639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.392735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:05.394662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.424207 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3955/7901] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:23:05 2022] POST /identity/v3/groups => generated 324 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:05.428257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.442782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997554-5db0-446e-99bd-490076de1044 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.448469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.449347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.449875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.449875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.451336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a7f0b2f0a8a64c5bb0d6ff578248f9c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:05.453376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.493384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.494365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.551294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.551952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.559732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3947/7902] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:05 2022] PATCH /identity/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0 => generated 276 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:05.564463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:05.566504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:05.590317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86a105-9e91-455c-a025-e6019bb92001 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:05.669852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:05.670667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:05.670953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:05.671240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:05.684459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a7f0b2f0a8a64c5bb0d6ff578248f9c0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:05.685963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:05.717391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.722304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.889726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c100af513545f19b4940b18043e8d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.890494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c100af513545f19b4940b18043e8d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.894082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:05.907323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c100af513545f19b4940b18043e8d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.925684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c100af513545f19b4940b18043e8d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:05.935385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c100af513545f19b4940b18043e8d9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.019655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.036035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.044401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.064521 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project a7f0b2f0a8a64c5bb0d6ff578248f9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:06.064809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.066834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.096459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.101402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.102393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a7f0b2f0a8a64c5bb0d6ff578248f9c0', 'request_id': 'req-56860974-c2e0-46b3-adfe-c2aba9507eed'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:06.120474 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3956/7903] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:05 2022] DELETE /identity/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:06.122944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.143156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a41f4-1a69-4a3d-a0b9-9584bdf698a8 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.207114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:06.247691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.248974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.249324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.249687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.258289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a7f0b2f0a8a64c5bb0d6ff578248f9c0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.260436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0.: keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.288511 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.289826 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.291143 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:06.292501 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3948/7904] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0 => generated 112 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.296494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.297914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:06.314300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860974-c2e0-46b3-adfe-c2aba9507eed tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.321440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.323778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.324701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.325009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/users/b3c100af513545f19b4940b18043e8d9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.337905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:get_user(user_id=b3c100af513545f19b4940b18043e8d9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.340526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find user: b3c100af513545f19b4940b18043e8d9.: keystone.exception.UserNotFound: Could not find user: b3c100af513545f19b4940b18043e8d9. Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 21:23:06.382070 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.383164 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b3c100af513545f19b4940b18043e8d9. Jun 25 21:23:06.384360 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.385316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3957/7905] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/users/b3c100af513545f19b4940b18043e8d9 => generated 110 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.389304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.405438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2460a-1f95-47b0-8622-a5a482f1e74a tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.418627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.419561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.419843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.420118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/groups/2a25131f68434bdeaa9b14d4ac294646` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.434921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:get_group(group_id=2a25131f68434bdeaa9b14d4ac294646)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.436405 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:06.436405 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:06.436405 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:06.437184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find group: 2a25131f68434bdeaa9b14d4ac294646.: keystone.exception.GroupNotFound: Could not find group: 2a25131f68434bdeaa9b14d4ac294646. Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jun 25 21:23:06.470379 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_group(group_id) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.471499 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2a25131f68434bdeaa9b14d4ac294646. Jun 25 21:23:06.472695 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:06.478108 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3949/7906] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/groups/2a25131f68434bdeaa9b14d4ac294646 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.482247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.496265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1207-cf5a-4525-9e76-1f1d5f81cc00 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.502662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.503765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.504142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.504572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/groups/2a25131f68434bdeaa9b14d4ac294646` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.525190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find group: 2a25131f68434bdeaa9b14d4ac294646.: keystone.exception.GroupNotFound: Could not find group: 2a25131f68434bdeaa9b14d4ac294646. Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jun 25 21:23:06.536692 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.537948 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2a25131f68434bdeaa9b14d4ac294646. Jun 25 21:23:06.539180 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.546747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3958/7907] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:23:06 2022] DELETE /identity/v3/groups/2a25131f68434bdeaa9b14d4ac294646 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.547788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.564326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54816c-ad8d-4181-9004-431a0b8270a2 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.582239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.587710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.588171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.589080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/users/b3c100af513545f19b4940b18043e8d9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.607096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3c100af513545f19b4940b18043e8d9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.611560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find user: b3c100af513545f19b4940b18043e8d9.: keystone.exception.UserNotFound: Could not find user: b3c100af513545f19b4940b18043e8d9. Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jun 25 21:23:06.647500 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.648472 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: b3c100af513545f19b4940b18043e8d9. Jun 25 21:23:06.649666 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:06.654630 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3950/7908] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:06 2022] DELETE /identity/v3/users/b3c100af513545f19b4940b18043e8d9 => generated 110 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.655415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.668111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbca2-b160-4ab2-8a67-289c4e6f21aa tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.675920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.677404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.677590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.677938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.690880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0.: keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.706158 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.707582 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.708788 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.710003 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3959/7909] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:06 2022] PATCH /identity/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0 => generated 112 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:06.715237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.728805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4163a-a4da-433e-a910-31ad61ec6392 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.734366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.735695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.735695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.736011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.736795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.738685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.762674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.773368 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3951/7910] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/domains => generated 1347 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:06.775245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac43ed-cb81-4449-bfd6-34afa1e2e58e tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.781126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.782146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.782441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.782721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.783470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:06.783784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.785727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.840000 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3960/7911] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:06.846308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.858373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d7495-3216-4afe-bbdc-af5d204ee9c1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.868414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.869165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.869458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.870098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.872694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-262080981) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:06.873042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:06.875886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:06.894831 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3952/7912] 10.222.0.39 () {58 vars in 1196 bytes} [Sat Jun 25 21:23:06 2022] GET /identity/v3/domains?name=tempest-test_domain-262080981 => generated 406 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:06.901146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:06.916439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd055b-5a67-4a93-bf41-6adc17230979 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:06.939954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:06.941300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:06.941807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:06.942277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:06.962635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0.: keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:06.984506 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:06.985887 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a7f0b2f0a8a64c5bb0d6ff578248f9c0. Jun 25 21:23:06.987038 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:06.997525 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3961/7913] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:06 2022] PATCH /identity/v3/domains/a7f0b2f0a8a64c5bb0d6ff578248f9c0 => generated 112 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:07.001540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:07.016549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34069-6760-4d3c-8542-00cbd5bdaeb6 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:07.028329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:07.029172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:07.029459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:07.029734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/bfff2c4063c540fd894eb2b0302667b4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:07.065067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bfff2c4063c540fd894eb2b0302667b4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:07.066521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:07.139641 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3953/7914] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:07 2022] PATCH /identity/v3/domains/bfff2c4063c540fd894eb2b0302667b4 => generated 277 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:07.139848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:07.154290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69a567-7f7d-4fdc-9fe7-7a6c06968416 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:07.159698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:07.160745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:07.161130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:07.161504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/bfff2c4063c540fd894eb2b0302667b4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:07.178133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bfff2c4063c540fd894eb2b0302667b4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:07.180463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:07.212455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.215511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.229137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:07.273134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.296761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.305737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.322475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project bfff2c4063c540fd894eb2b0302667b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:07.322774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.324000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.337474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.341641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.342883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bfff2c4063c540fd894eb2b0302667b4', 'request_id': 'req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.350009 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3962/7915] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:07 2022] DELETE /identity/v3/domains/bfff2c4063c540fd894eb2b0302667b4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:07.354978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:07.357457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:07.379297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670b02-82ff-44ff-9700-63da274d8f71 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:07.475141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:07.476050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:07.476452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:07.476758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/8ad7d540c09743a0a2aecb5a6ccb96c8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:07.495551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8ad7d540c09743a0a2aecb5a6ccb96c8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:07.497616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:07.527534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.528273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.530552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:07.573215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.574073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.577107 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3954/7916] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:07 2022] PATCH /identity/v3/domains/8ad7d540c09743a0a2aecb5a6ccb96c8 => generated 278 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:07.582428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:07.598133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a99f55-c68b-4303-bd8f-97c56c3afdc1 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:07.681259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:07.682861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:07.683038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:07.683300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/8ad7d540c09743a0a2aecb5a6ccb96c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:07.709748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8ad7d540c09743a0a2aecb5a6ccb96c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:07.711423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:07.747466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.753869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.873598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.875420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:07.898119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.909954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.928718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project 8ad7d540c09743a0a2aecb5a6ccb96c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:07.928954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.929629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.940257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.945403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.945985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8ad7d540c09743a0a2aecb5a6ccb96c8', 'request_id': 'req-b478ae57-1eae-480a-941d-b81d797eb421'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:07.953563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3963/7917] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:07 2022] DELETE /identity/v3/domains/8ad7d540c09743a0a2aecb5a6ccb96c8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:07.957657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:07.959090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:07.979154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231603ef-429f-4763-8b01-be76070d9358 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:08.069668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:08.070655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:08.071011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:08.071364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/d02371fdeb41433a950dd0444b7e03a1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:08.085452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d02371fdeb41433a950dd0444b7e03a1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:08.087198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:08.109771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.110840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.142577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.143202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.148469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3955/7918] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:07 2022] PATCH /identity/v3/domains/d02371fdeb41433a950dd0444b7e03a1 => generated 276 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:08.150021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:08.151482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:08.166763 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ae57-1eae-480a-941d-b81d797eb421 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:08.235403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4d2ff1a1140f598733c39e74dc254', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4561a5d816b34f0d8050ab300d8a8bb5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:08.236446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:08.236845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:08.237083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] PATH_INFO: `/v3/domains/d02371fdeb41433a950dd0444b7e03a1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:08.251690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d02371fdeb41433a950dd0444b7e03a1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:08.253636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:08.279973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.284515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.353262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.366274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.374801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.393202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] The token cache is being invalidate because project d02371fdeb41433a950dd0444b7e03a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:08.394722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.398085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.413817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.416955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:DELETE=18,keystone:SELECT=80 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:08.420300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.425296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7 tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd02371fdeb41433a950dd0444b7e03a1', 'request_id': 'req-bf1407da-8c3f-4d81-bc05-92dfbfd9bee7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.443119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3964/7919] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:08 2022] DELETE /identity/v3/domains/d02371fdeb41433a950dd0444b7e03a1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:08.447570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:08.449781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:08.583340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041dc-6ccc-4f82-8f90-c485e80b860b tempest-DomainsTestJSON-1876261175 tempest-DomainsTestJSON-1876261175-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:08.691651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:08.729244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:08.731087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:08.731774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:08.732293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] PATH_INFO: `/v3/users/139dc2a9d94144648be77c15dee14473` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:08.734034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=139dc2a9d94144648be77c15dee14473)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:08.744099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:08.820408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139dc2a9d94144648be77c15dee14473'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.835137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139dc2a9d94144648be77c15dee14473'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.856018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139dc2a9d94144648be77c15dee14473'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.857650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139dc2a9d94144648be77c15dee14473'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.858915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139dc2a9d94144648be77c15dee14473'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:08.902764 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3956/7920] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:08 2022] DELETE /identity/v3/users/139dc2a9d94144648be77c15dee14473 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:08.908243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:08.909051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:08.909540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:08.937869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:08.944214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:09.070196 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3965/7921] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:09.087852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:09.089541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:09.189550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8447-3c64-4794-a2c8-d032f19a9d6c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:09.194513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:09.195315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:09.195601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:09.195920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:09.212308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:09.214920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:09.235729 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3957/7922] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:09.832941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:09.834617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:09.854122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac1387-4fc8-4f74-a029-74850ae531d4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:09.860176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:09.861115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:09.861481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:09.861942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] PATH_INFO: `/v3/projects/ca53af77209749bea474b39f5d3b2973` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:09.863279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca53af77209749bea474b39f5d3b2973)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:09.866367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:09.919859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca53af77209749bea474b39f5d3b2973', 'request_id': 'req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:09.928029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca53af77209749bea474b39f5d3b2973', 'request_id': 'req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:09.934040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca53af77209749bea474b39f5d3b2973', 'request_id': 'req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:09.945866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] The token cache is being invalidate because project ca53af77209749bea474b39f5d3b2973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:09.946165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:09.946830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:09.949439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3966/7923] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:09 2022] DELETE /identity/v3/projects/ca53af77209749bea474b39f5d3b2973 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:09.954067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:09.964494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d05d03-f3c0-4de2-8354-39a2ab56dde6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:10.028526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:10.029094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.029383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.029779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] PATH_INFO: `/v3/users/6ed4d2ff1a1140f598733c39e74dc254` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.031260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed4d2ff1a1140f598733c39e74dc254)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:10.033522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:10.049954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:10.097998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed4d2ff1a1140f598733c39e74dc254'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.108049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed4d2ff1a1140f598733c39e74dc254'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.123673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed4d2ff1a1140f598733c39e74dc254'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.124532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed4d2ff1a1140f598733c39e74dc254'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.125316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-33b2e7ed-9cdf-47ac-a4f9-6eea5c251f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed4d2ff1a1140f598733c39e74dc254'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.138759 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3958/7924] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:09 2022] DELETE /identity/v3/users/6ed4d2ff1a1140f598733c39e74dc254 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:10.430235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:10.431996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:10.446344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb8a6-e381-48e3-bf82-7f98d1a1bb23 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:10.519282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:10.520193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.520514 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.520815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] PATH_INFO: `/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.522044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4561a5d816b34f0d8050ab300d8a8bb5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:10.523995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:10.549845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:10.579009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4561a5d816b34f0d8050ab300d8a8bb5', 'request_id': 'req-2b03ff56-41fc-4781-b144-0678b00e0fd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.588064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4561a5d816b34f0d8050ab300d8a8bb5', 'request_id': 'req-2b03ff56-41fc-4781-b144-0678b00e0fd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.595048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4561a5d816b34f0d8050ab300d8a8bb5', 'request_id': 'req-2b03ff56-41fc-4781-b144-0678b00e0fd8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.608115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] The token cache is being invalidate because project 4561a5d816b34f0d8050ab300d8a8bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:10.608365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.609036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2b03ff56-41fc-4781-b144-0678b00e0fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:10.610651 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3967/7925] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:10 2022] DELETE /identity/v3/projects/4561a5d816b34f0d8050ab300d8a8bb5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:10.615882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.616319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.616614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.637567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:10.638817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:10.701097 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3959/7926] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:10.709256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.709556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.709841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.729027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:10.730287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:10.739153 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3968/7927] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:10.743579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:10.756190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e8f6-7922-4cba-9523-2bc0fe0d8503 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:10.761250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:10.762122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.762403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.762688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.763456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:10.763797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:10.765510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:10.781215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3960/7928] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:10.786014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:10.798484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd340-4093-4478-bf85-7c8cec64dda2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:10.811780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:10.812685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.812982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.813225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.813987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:10.816281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:10.846188 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3969/7929] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:10 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:10.850871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:10.862736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a63f8-5c7e-48a1-ad69-0e70fb9e077e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:10.980855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:10.981547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:10.981831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:10.982112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:10.982832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:10.985892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.019794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3961/7930] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:10 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:11.024374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.040471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f438-dac6-48fe-957e-86a0115ad14a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.058585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.059420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.059774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.060382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.061225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.065736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.086749 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3970/7931] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:11.090910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.101044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:11.117156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e8134-340a-41ba-a67f-4a9905f15f59 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.129933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.131203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.132592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.133305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.134335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.139240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bbba9-bb35-41f7-ad8f-bfecdd162c9b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.157338 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3962/7932] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:11.162334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.178950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b294bb-46da-45ef-95c0-d91c6ee409b0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.193143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.194269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.194655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.195038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] PATH_INFO: `/v3/projects/d7aca080f21e42c6be646f73f4831a02/users/c92d61cdcb7f46e88d60304d7dbd7d08/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.217417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aca080f21e42c6be646f73f4831a02, user_id=c92d61cdcb7f46e88d60304d7dbd7d08, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.223889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.265577 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3971/7933] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:11 2022] PUT /identity/v3/projects/d7aca080f21e42c6be646f73f4831a02/users/c92d61cdcb7f46e88d60304d7dbd7d08/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:11.278591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.278884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.279168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.313002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] MFA Rules not processed for user `c92d61cdcb7f46e88d60304d7dbd7d08`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:11.314931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:11.418829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3963/7934] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:11.423568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.540005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6e437-bc1c-4f58-abdd-b413729a46a2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.546166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.547191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.547579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.547958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.549559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.552530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.603269 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3972/7935] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:11 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:11.605155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.621308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e645b-ca26-4b4d-af15-d639ce1ffc28 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.710443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.711243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.711589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.712017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.713467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.715227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.753382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3964/7936] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:11 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:11.757300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.771132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ced38-e3f4-4341-bb9e-1ef3d01e21de admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.776628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.777891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.778347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.779143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.782870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.786025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.808378 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3973/7937] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:11.810503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.832957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fc0b3-ccd0-45f1-87e5-09c891fe01dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.838505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:11.839886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:11.839886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:11.840135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] PATH_INFO: `/v3/projects/501b9bb1c6554bd59e5938a4d52be918/users/c208e30a51f64164aa0752e0913393dc/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:11.858631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501b9bb1c6554bd59e5938a4d52be918, user_id=c208e30a51f64164aa0752e0913393dc, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:11.862290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:11.885644 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3965/7938] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:11 2022] PUT /identity/v3/projects/501b9bb1c6554bd59e5938a4d52be918/users/c208e30a51f64164aa0752e0913393dc/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:11.888933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:11.910250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548624-7ea9-459e-a1c4-2d23800f1e5a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:11.931334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:12.001031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.001743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.002033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.002332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.003282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.004745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bee2c-1bb4-4a0c-b48d-abf5c2afa429 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.023563 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3974/7939] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:12.029346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.052455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa3365-e289-4abe-9c23-336e5ae7a852 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.062803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.065092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.065380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.065661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] PATH_INFO: `/v3/projects/501b9bb1c6554bd59e5938a4d52be918/users/c208e30a51f64164aa0752e0913393dc/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.071151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501b9bb1c6554bd59e5938a4d52be918, user_id=c208e30a51f64164aa0752e0913393dc, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.074848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.088361 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3966/7940] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:12 2022] PUT /identity/v3/projects/501b9bb1c6554bd59e5938a4d52be918/users/c208e30a51f64164aa0752e0913393dc/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:12.100000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.100595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.100984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.168570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] MFA Rules not processed for user `c208e30a51f64164aa0752e0913393dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:12.171383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:12.310538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3975/7941] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:12.316595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.335231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825085b2-94f1-4eb2-b56c-925b0dd44e17 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.355934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.356949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.357456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.357955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.362212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.365775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invalid input for field 'name': '' is too short Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: On instance['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: On instance['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: '' Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise error Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application '' Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.379370 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:23:12.381005 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application '' Jun 25 21:23:12.382044 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:12.386313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.386937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3967/7942] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:12 2022] POST /identity/v3/domains => generated 283 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:23:12.408116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2510c0-a99d-4e42-8f8a-17f26044b8c8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.417101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.418520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.420130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.420663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.423933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.426410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: On instance['name']: Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise error Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.440145 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 25 21:23:12.441563 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application On instance['name']: Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:23:12.442766 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.470937 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3976/7943] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:12 2022] POST /identity/v3/domains => generated 412 bytes in 85 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 25 21:23:12.476200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.499092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e273f-187b-4f16-9504-09c8c343303c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.506576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.509190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.509609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.509985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.511163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.512957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.542059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.543481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3968/7944] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:12 2022] POST /identity/v3/domains => generated 276 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:12.554539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984351a-00f5-4d85-9726-a1d5714f8052 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.656458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.657595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.657904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.658169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/8503e7d7768847f6a1962a46107dcddf` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.677513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8503e7d7768847f6a1962a46107dcddf)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.680098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jun 25 21:23:12.707841 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 25 21:23:12.709022 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:12.711805 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3977/7945] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:12 2022] DELETE /identity/v3/domains/8503e7d7768847f6a1962a46107dcddf => generated 120 bytes in 170 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:23:12.716482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.731006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32be2-ad9c-42fe-bd6d-d9a148248fda tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.740027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.740595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.741297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.741595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/8503e7d7768847f6a1962a46107dcddf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:12.746039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8503e7d7768847f6a1962a46107dcddf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:12.747121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:12.762964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:12.779160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:12.780383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:12.835112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:12.839351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:12.843715 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3969/7946] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:12 2022] PATCH /identity/v3/domains/8503e7d7768847f6a1962a46107dcddf => generated 277 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:12.848536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:12.852154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:12.885788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b8570-1c89-4143-97a6-5521238515f6 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:12.913229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:12.988743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:12.989771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:12.990116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:12.990471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/8503e7d7768847f6a1962a46107dcddf` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.002661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8503e7d7768847f6a1962a46107dcddf)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:13.004414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:13.031441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.037914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8503e7d7768847f6a1962a46107dcddf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.161974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.182169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.192673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.222658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] The token cache is being invalidate because project 8503e7d7768847f6a1962a46107dcddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:13.223053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.224028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.239154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.243020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.243858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8503e7d7768847f6a1962a46107dcddf', 'request_id': 'req-133dc646-c6b6-4ae6-a0b6-649ce90d7432'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.250340 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3978/7947] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:12 2022] DELETE /identity/v3/domains/8503e7d7768847f6a1962a46107dcddf => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:13.255977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:13.267597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb09d9-207d-4e94-8e0e-34f0a173c113 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:13.355585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:13.356567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:13.356853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:13.357132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/02acf85b17f14795aba5cb268d65643b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.375915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Could not find domain: 02acf85b17f14795aba5cb268d65643b.: keystone.exception.DomainNotFound: Could not find domain: 02acf85b17f14795aba5cb268d65643b. Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 02acf85b17f14795aba5cb268d65643b. Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:13.391919 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:13.393048 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:13.394516 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 02acf85b17f14795aba5cb268d65643b. Jun 25 21:23:13.395546 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.395546 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3970/7948] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:13 2022] DELETE /identity/v3/domains/02acf85b17f14795aba5cb268d65643b => generated 112 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:13.398634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:13.400206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:13.418802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc646-c6b6-4ae6-a0b6-649ce90d7432 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:13.426298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:13.427235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:13.428472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:13.428589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.429422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:13.431124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:13.458185 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3979/7949] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:13 2022] POST /identity/v3/domains => generated 253 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:13.463079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:13.475256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624659b2-1bd9-4536-a2c9-2b43f00c6046 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:13.589258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:13.590030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:13.590326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:13.590613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.591361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:13.593027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:13.601807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.sql.core [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1905853803' for key 'project.ixu_project_name_domain_id'") Jun 25 21:23:13.601807 ncdv-master-1 devstack@keystone.service[97719]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 21:23:13.601807 ncdv-master-1 devstack@keystone.service[97719]: [parameters: {'id': '523b2859c6e24d3d85019fdd520f174f', 'name': 'tempest-domain-dup-1905853803', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 25 21:23:13.601807 ncdv-master-1 devstack@keystone.service[97719]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97719) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1905853803.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1905853803. Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application conn.query(q) Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 21:23:13.620545 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result.read() Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1905853803' for key 'project.ixu_project_name_domain_id'") Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 25 21:23:13.621783 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application yield resource Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application next(self.gen) Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise self.value Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application session.commit() Jun 25 21:23:13.623194 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.session.flush() Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application compat.raise_( Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 21:23:13.624521 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 21:23:13.625800 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application conn.query(q) Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application result.read() Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 21:23:13.626952 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1905853803' for key 'project.ixu_project_name_domain_id'") Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application [parameters: {'id': '523b2859c6e24d3d85019fdd520f174f', 'name': 'tempest-domain-dup-1905853803', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.628255 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1905853803. Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:13.632679 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1905853803. Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: ERROR keystone.server.flask.application Jun 25 21:23:13.635162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3971/7950] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:13 2022] POST /identity/v3/domains => generated 212 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 25 21:23:13.636574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:13.654445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced21cd-97e8-4614-abe0-001ef1fe493e tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:13.665471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:13.666717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:13.666929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:13.667341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/4bd994cd764c4f33aa712ee897d9712d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.688092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4bd994cd764c4f33aa712ee897d9712d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:13.689800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:13.714530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.715501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.750711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:13.764377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.765752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.774022 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3980/7951] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:13 2022] PATCH /identity/v3/domains/4bd994cd764c4f33aa712ee897d9712d => generated 254 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:13.774267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:13.776781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:13.801921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b651d1-7466-48aa-b713-31e7886dd3ac tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:13.906000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:13.907184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:13.907541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:13.907909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/4bd994cd764c4f33aa712ee897d9712d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:13.923854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4bd994cd764c4f33aa712ee897d9712d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:13.925731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:13.936458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:13.967905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:13.972288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.053890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.065461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.083998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.114863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] The token cache is being invalidate because project 4bd994cd764c4f33aa712ee897d9712d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:14.115067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.116230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.132710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.136823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.137604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4bd994cd764c4f33aa712ee897d9712d', 'request_id': 'req-afdf1af1-4b4c-4387-8df1-83bd39451fc9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.145808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3972/7952] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:13 2022] DELETE /identity/v3/domains/4bd994cd764c4f33aa712ee897d9712d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:14.150398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:14.169049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea935e22-569d-4182-9a57-d519542a81e0 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:14.264921 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c208e30a51f64164aa0752e0913393dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501b9bb1c6554bd59e5938a4d52be918', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:14.267979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:14.280704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:14.281074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] PATH_INFO: `/v3/domains/8503e7d7768847f6a1962a46107dcddf` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:14.298472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-743e7032-a062-455c-b4f3-cd464dc2248c tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Could not find domain: 8503e7d7768847f6a1962a46107dcddf.: keystone.exception.DomainNotFound: Could not find domain: 8503e7d7768847f6a1962a46107dcddf. Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8503e7d7768847f6a1962a46107dcddf. Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:14.311520 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:14.312667 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application with Lock( Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self._enter() Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.creator() Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application created_value = creator( Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 21:23:14.313637 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8503e7d7768847f6a1962a46107dcddf. Jun 25 21:23:14.317755 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:14.317755 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3981/7953] 10.222.0.39 () {60 vars in 1248 bytes} [Sat Jun 25 21:23:14 2022] PATCH /identity/v3/domains/8503e7d7768847f6a1962a46107dcddf => generated 112 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:23:14.319705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:14.321713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:14.517148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf1af1-4b4c-4387-8df1-83bd39451fc9 tempest-DomainsNegativeTestJSON-1077725638 tempest-DomainsNegativeTestJSON-1077725638-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:14.521935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:14.523401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:14.523593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:14.523872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] PATH_INFO: `/v3/users/c92d61cdcb7f46e88d60304d7dbd7d08` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:14.525166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92d61cdcb7f46e88d60304d7dbd7d08)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:14.527286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:14.639709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92d61cdcb7f46e88d60304d7dbd7d08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.645855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:14.658865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92d61cdcb7f46e88d60304d7dbd7d08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.692845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92d61cdcb7f46e88d60304d7dbd7d08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.693651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92d61cdcb7f46e88d60304d7dbd7d08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.694278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92d61cdcb7f46e88d60304d7dbd7d08'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:14.719455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3973/7954] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:14 2022] DELETE /identity/v3/users/c92d61cdcb7f46e88d60304d7dbd7d08 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:14.723623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:14.723928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:14.724952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:14.754359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:14.755624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:14.854053 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3982/7955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:14.893739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:14.895314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:15.021751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa37c6f-d33f-4fb2-89d3-52c7e0d72cb5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:15.027499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:15.028560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:15.028994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:15.029621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:15.041258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:15.043890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:15.066874 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3974/7956] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:16.258578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:16.263402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:16.306578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfd09-1cfe-4da9-ba42-32dfc4bbd198 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:16.319792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:16.320787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:16.321041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:16.321414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] PATH_INFO: `/v3/projects/d7aca080f21e42c6be646f73f4831a02` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:16.322914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7aca080f21e42c6be646f73f4831a02)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:16.325679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:16.471153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7aca080f21e42c6be646f73f4831a02', 'request_id': 'req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.501200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7aca080f21e42c6be646f73f4831a02', 'request_id': 'req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.509111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7aca080f21e42c6be646f73f4831a02', 'request_id': 'req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.544192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] The token cache is being invalidate because project d7aca080f21e42c6be646f73f4831a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:16.545011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.546053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.549173 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3983/7957] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:16 2022] DELETE /identity/v3/projects/d7aca080f21e42c6be646f73f4831a02 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:16.554089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:16.568708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b03117-c664-459d-bc14-561dd993b135 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:16.717283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:16.718407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:16.718762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:16.719112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] PATH_INFO: `/v3/users/c208e30a51f64164aa0752e0913393dc` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:16.721066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c208e30a51f64164aa0752e0913393dc)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:16.723416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:16.812642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c208e30a51f64164aa0752e0913393dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.845525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c208e30a51f64164aa0752e0913393dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.866554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c208e30a51f64164aa0752e0913393dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.867715 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c208e30a51f64164aa0752e0913393dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.868513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a842e570-a585-44a7-a3a7-6aeced1a5555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c208e30a51f64164aa0752e0913393dc'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:16.871844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:16.893872 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3975/7958] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:16 2022] DELETE /identity/v3/users/c208e30a51f64164aa0752e0913393dc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:17.215461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:17.224295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:17.255703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16c33d-fad9-4dbe-b1eb-47ddf4f1e0b7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:17.279768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:17.345117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:17.346159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:17.346439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:17.346717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] PATH_INFO: `/v3/users/d0549a84f2af451a8b72eeb624723e0a` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:17.348631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0549a84f2af451a8b72eeb624723e0a)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:17.350682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:17.429481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0549a84f2af451a8b72eeb624723e0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:17.430215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0549a84f2af451a8b72eeb624723e0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:17.438768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0549a84f2af451a8b72eeb624723e0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:17.453219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0549a84f2af451a8b72eeb624723e0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:17.462823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0549a84f2af451a8b72eeb624723e0a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:17.475409 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3984/7959] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:17 2022] DELETE /identity/v3/users/d0549a84f2af451a8b72eeb624723e0a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:17.477522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:17.477823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:17.478107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:17.497217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:17.499260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:17.626284 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3976/7960] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:17.657176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:17.659083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:17.763564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba706-c1d8-4c07-84a4-310d25d96e72 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:17.781603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:17.784221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:17.786627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:17.790017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:17.790445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:17.791316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:17.841151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:17.843908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:17.867644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3985/7961] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:17.962764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:17.965718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.028296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31abdd-0c64-4199-a37e-327d3655c0e0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.035064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f881-a0c8-4456-8ab7-f9e8d808f366 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.046963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.047664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.050465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.050785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.051076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.052344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.052898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.053488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] PATH_INFO: `/v3/projects/501b9bb1c6554bd59e5938a4d52be918` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.058830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=501b9bb1c6554bd59e5938a4d52be918)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.058977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.059743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.091580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.095116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0cc10-4d83-4498-a26d-02f9dfc47fdf service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.132445 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3977/7962] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:18.148285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:18.171046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501b9bb1c6554bd59e5938a4d52be918', 'request_id': 'req-150e2d2a-1645-4a4d-a493-e8bf620cafbf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.192055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501b9bb1c6554bd59e5938a4d52be918', 'request_id': 'req-150e2d2a-1645-4a4d-a493-e8bf620cafbf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.210436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501b9bb1c6554bd59e5938a4d52be918', 'request_id': 'req-150e2d2a-1645-4a4d-a493-e8bf620cafbf'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.254799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] The token cache is being invalidate because project 501b9bb1c6554bd59e5938a4d52be918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:18.255178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.256073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.258119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3986/7963] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:17 2022] DELETE /identity/v3/projects/501b9bb1c6554bd59e5938a4d52be918 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:18.262944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278f82-3fe9-4f90-bf9a-6d19ddbffa59 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.263285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278f82-3fe9-4f90-bf9a-6d19ddbffa59 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.263576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278f82-3fe9-4f90-bf9a-6d19ddbffa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.291962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-22278f82-3fe9-4f90-bf9a-6d19ddbffa59 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:18.293573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-22278f82-3fe9-4f90-bf9a-6d19ddbffa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.316695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.320080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.435987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2d2a-1645-4a4d-a493-e8bf620cafbf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.443732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.444674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.444966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.445248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] PATH_INFO: `/v3/projects/3d85c54c9e9b4dcba311e759f4b23834` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.452355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d85c54c9e9b4dcba311e759f4b23834)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.452591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3978/7964] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:18.452710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.455627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.456070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.456634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.484895 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:18.486365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.500580 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3979/7965] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:18.505930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.518838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a26ce-d660-48ee-ab08-2698c9f504e3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.533315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:18.535520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d85c54c9e9b4dcba311e759f4b23834', 'request_id': 'req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.544907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d85c54c9e9b4dcba311e759f4b23834', 'request_id': 'req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.552200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d85c54c9e9b4dcba311e759f4b23834', 'request_id': 'req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.565462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] The token cache is being invalidate because project 3d85c54c9e9b4dcba311e759f4b23834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:18.565748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.566418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c3fd8eeb-2a8c-4d63-9836-160e09073fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:18.571747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3987/7966] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:18 2022] DELETE /identity/v3/projects/3d85c54c9e9b4dcba311e759f4b23834 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:18.573789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283dfa-3b0c-4dbf-ad3b-901c78c77f8e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.573940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283dfa-3b0c-4dbf-ad3b-901c78c77f8e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.574130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283dfa-3b0c-4dbf-ad3b-901c78c77f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.594958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-01283dfa-3b0c-4dbf-ad3b-901c78c77f8e None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:18.596255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01283dfa-3b0c-4dbf-ad3b-901c78c77f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.605559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.606261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.607115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.607672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.609165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:18.609756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.611956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.634604 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3980/7967] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:18.639023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.642496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.662744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:18.669046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f1be5-f695-4256-859d-3d0633404747 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.676926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.678125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.678421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.678845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.679697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.681635 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3988/7968] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:18.682843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.693461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.693648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.693944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.723918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:18.725874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:18.727298 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3981/7969] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:18.731127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.815385 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3989/7970] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:18.819649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.830317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a8180-f7ec-41af-8320-0911146123e6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.832916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587a205-1b36-4343-9b4a-ac28e0281cab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.835644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.836324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.836657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.836937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.837665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:18.837989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.838098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.838672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.839002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.839370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.839650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.840068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.842044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.856572 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3990/7971] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:23:18.857660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.864836 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3982/7972] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:18.868193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1637f-2ac9-4689-ae8d-9c197e2fff0c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.868529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.873993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.874665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.874952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.875259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.875948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.878088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.881180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6da0d-d1e0-43bd-9005-8298752a9960 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:18.891305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:18.892141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:18.892718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:18.892718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:18.893771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:18.896553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:18.909257 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3983/7973] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:18.912869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.915830 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3991/7974] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:18.919891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:18.927942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2660-9d25-474f-afe5-45bcce46af8c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.008730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce59-bf45-446b-9c83-9ba4f97cbf38 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.010867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.011547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.011830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.012145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.013015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.014298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.014965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.015083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.015308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.015581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.016332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.017464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:19.018340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.028211 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3984/7975] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:19.032253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.044582 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3992/7976] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:18 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:19.048091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.056810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417d2f-99eb-48df-b57e-da74380d6baa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.063284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.064550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.065066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.065182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6923e-f44e-4a6d-a4d2-6ec6222776a6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.066043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] PATH_INFO: `/v3/projects/8e6fd8677f8e4a88b4ba46bb432c1dab/users/9bdd48ddb43d490ea95677c5f70f9e30/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.074820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.075540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.075829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.076114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.076932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.079238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.091107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6fd8677f8e4a88b4ba46bb432c1dab, user_id=9bdd48ddb43d490ea95677c5f70f9e30, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.093229 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3993/7977] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:19.095914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c60483-62ee-477b-9f22-0e1e6eecc373 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.096742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.109600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652a481-3709-4699-a089-d0a8b07c5dc8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.119308 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3985/7978] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:19 2022] PUT /identity/v3/projects/8e6fd8677f8e4a88b4ba46bb432c1dab/users/9bdd48ddb43d490ea95677c5f70f9e30/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:19.130673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.130965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.131250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.154349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:19.165560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] MFA Rules not processed for user `9bdd48ddb43d490ea95677c5f70f9e30`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:19.166801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:19.181330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.182025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.182320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.182698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.183434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.185099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.199291 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3994/7979] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:19.200765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.212306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71e71-ef22-4667-85a3-db625d17f329 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.217549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.218548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.218898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.219247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] PATH_INFO: `/v3/projects/53594216b2134b67893528ac9fd36c28/users/629a0f9f31ef4a7a9e7fd20fffb9d3bd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.236924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53594216b2134b67893528ac9fd36c28, user_id=629a0f9f31ef4a7a9e7fd20fffb9d3bd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.239822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7b887-0779-4ea9-a124-560106e1ec66 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.243515 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3986/7980] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:19.248122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.259154 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3995/7981] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:19 2022] PUT /identity/v3/projects/53594216b2134b67893528ac9fd36c28/users/629a0f9f31ef4a7a9e7fd20fffb9d3bd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:19.260075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7fa0-c57b-4dfa-af30-d021cd8649ca None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.269813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.270104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.270380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.297313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] MFA Rules not processed for user `629a0f9f31ef4a7a9e7fd20fffb9d3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:19.298557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:19.342214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.343035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.343155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.343439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.344134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.346103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.368240 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3996/7982] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:19.378232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.383438 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3987/7983] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:19.383602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:19.384462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.438133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:19.451907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2787f-437f-4d94-8dbf-fffbb6570e18 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.459598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc323afa-f2f5-4852-b35d-60bad48c0f7c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.464744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.465496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.465784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.466058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.466751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.468798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.494510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3988/7984] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:19.499874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.508579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.509257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.509534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.509807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.513668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6224-3ebb-4101-a552-9f4ffce326a0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.519639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:19.523265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.524049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.524406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.524816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.526776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.530179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.550126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3989/7985] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:19.554780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.569634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3cc7-32b0-4146-9183-28c2a150f698 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.578916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.580478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.580988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.581593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] PATH_INFO: `/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586/users/d4199476ff634cc1bfc904935ed9d9c9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.588879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.590961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.603534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3997/7986] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:23:19.612337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1326fcf6c040d2a3f9b4bc6bc03586, user_id=d4199476ff634cc1bfc904935ed9d9c9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.615330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.648249 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3990/7987] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:19 2022] PUT /identity/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586/users/d4199476ff634cc1bfc904935ed9d9c9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:19.652156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.665658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce189-009b-48cc-88bc-b112c866792e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.742124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.742985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.743792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.744237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.745228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.746854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabd485-4b7a-4815-8049-1d9e07dc7fa0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.759427 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3998/7988] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:19.763703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.775411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4209a11-c599-4c70-9471-907c476c1bac admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:19.781746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:19.782852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.783157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.783512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] PATH_INFO: `/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586/users/d4199476ff634cc1bfc904935ed9d9c9/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.786135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1326fcf6c040d2a3f9b4bc6bc03586, user_id=d4199476ff634cc1bfc904935ed9d9c9, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:19.789682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:19.801954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3991/7989] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:19 2022] PUT /identity/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586/users/d4199476ff634cc1bfc904935ed9d9c9/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:19.814011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:19.814392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:19.814760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:19.854125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] MFA Rules not processed for user `d4199476ff634cc1bfc904935ed9d9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:19.855541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:19.956109 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 3999/7990] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:19.957576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:19.988590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248c5c-b2be-40e8-b8d5-1af5144a9f6c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.003844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.005793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.006294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.006867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.007840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.010779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.036390 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3992/7991] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:19 2022] POST /identity/v3/services => generated 287 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:20.037295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.050703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e97177-2441-4513-8c28-b385f8799281 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.068261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.069033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.069395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.069773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.070598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.072041 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.072041 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:23:20.072041 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:23:20.073519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.085759 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4000/7992] 10.222.0.39 () {60 vars in 1212 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:20.090331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.100824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037c41-7f9d-49a3-9571-cb35a3f1fa02 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.106573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.107373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.108324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.108324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.108876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.110616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.136062 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3993/7993] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/services => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:20.140166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.160639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c7e4-2c18-42e9-bd6b-8571acb22045 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.179485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:20.186432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.187737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.188534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.189775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.190952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.193681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.208459 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4001/7994] 10.222.0.39 () {60 vars in 1212 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:20.209759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.222823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95a98-b844-490a-93c3-2013e8306fcf tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.230260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.231011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.231368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.231693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.232551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.246229 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.246229 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:20.246229 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:20.248375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.259174 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3994/7995] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 21:23:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:20.263123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.276371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9b5c-1913-44e0-b410-5d012ae61bb1 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.283548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.285232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.285637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.286512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.287416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=6e58ad84932d426982a69c7f87c75256)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.289669 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.289669 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:23:20.289669 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:23:20.291152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.300016 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4002/7996] 10.222.0.39 () {58 vars in 1289 bytes} [Sat Jun 25 21:23:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256 => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:23:20.304026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.316721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10b07-79c0-4ced-b685-06b557d7382a tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.323025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.324100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.324717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.325139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.326027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=6e58ad84932d426982a69c7f87c75256)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.327894 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.327894 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:20.327894 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:20.329157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.342057 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3995/7997] 10.222.0.39 () {58 vars in 1290 bytes} [Sat Jun 25 21:23:20 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 25 21:23:20.343798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.359084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b3afb-0a74-4851-b046-50ea93280419 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.365384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.366286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.366579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.366864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.367537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6e58ad84932d426982a69c7f87c75256)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.368618 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.368618 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:23:20.368618 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:23:20.370746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.388530 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4003/7998] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:20.392240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.407414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680080-1a14-4667-8f66-d923acdf273d tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.414850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.416166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.416775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.417421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.418519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.421627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.430752 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3996/7999] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 21:23:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:20.435164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.450816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280fef-3891-4f95-aef4-b43e2bfe9c0e tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.457761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.459063 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.459636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.460135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.461058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6e58ad84932d426982a69c7f87c75256)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.463396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Could not find Endpoint Group: 6e58ad84932d426982a69c7f87c75256.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 6e58ad84932d426982a69c7f87c75256. Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jun 25 21:23:20.482702 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 6e58ad84932d426982a69c7f87c75256. Jun 25 21:23:20.483836 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:20.485870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4004/8000] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6e58ad84932d426982a69c7f87c75256 => generated 120 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 25 21:23:20.490034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.503512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab280b-7522-4be5-bf24-e0d31b49312c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.509866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.511123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.511637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.512183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services/c296288015e24acfa27a529a338c5b57` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.513152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c296288015e24acfa27a529a338c5b57)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.515008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.553039 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3997/8001] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/services/c296288015e24acfa27a529a338c5b57 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:20.560232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.571072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c307b5-5b29-4f53-857d-9d11e52b450b tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.588942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.590395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.590724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.591002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.591907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.593414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.609820 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4005/8002] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/services => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:20.613787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.625524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c42f00-82e6-49ce-9bfe-2fb7e31ec3c9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.642208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.643700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.643832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.644116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.644885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.647792 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.647792 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:20.647792 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:20.647792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.658193 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3998/8003] 10.222.0.39 () {60 vars in 1212 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:20.662951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.678340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d902f-d0cd-4af9-ab7f-d2526d21f3c2 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.686233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.686908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.687203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.687454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.688187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.691382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.721418 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4006/8004] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:20 2022] POST /identity/v3/services => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:20.726439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.738379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9f4fc-e436-4ba4-bdc9-bb069e679230 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.757988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.758969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.759375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.759664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1c1624414e274a80963d89efc20e133a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.760751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=1c1624414e274a80963d89efc20e133a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.762495 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.762495 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:20.762495 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:20.763609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.780911 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 3999/8005] 10.222.0.39 () {60 vars in 1312 bytes} [Sat Jun 25 21:23:20 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/1c1624414e274a80963d89efc20e133a => generated 336 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:20.784000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.796770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25257-468c-4e15-8dd2-295b73df083f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.802072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.803463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.804031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.804550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services/1f578a9e340f4431a828c41e2a3a2b42` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.806226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1f578a9e340f4431a828c41e2a3a2b42)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.808741 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.841827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4007/8006] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/services/1f578a9e340f4431a828c41e2a3a2b42 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:20.846048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.860238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804bbc-cc5b-401b-99b3-5f44cf59b29f tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.883884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.885049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.885350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.886034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1c1624414e274a80963d89efc20e133a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.887323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1c1624414e274a80963d89efc20e133a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.888913 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:20.888913 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:20.888913 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:20.889967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.909000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4000/8007] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1c1624414e274a80963d89efc20e133a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:20.913400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.927881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0268-dd6f-4bea-ac2b-ac0d6368b8b4 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:20.933721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:20.934940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:20.935724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:20.935724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services/3622c55c8aa544b28aa84999db980e01` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:20.936563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3622c55c8aa544b28aa84999db980e01)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:20.938552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:20.978276 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4008/8008] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/services/3622c55c8aa544b28aa84999db980e01 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:20.983820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:20.997237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade7c6-6646-469f-a5f9-b48ef47688b6 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:21.013017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:21.017639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:21.019019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:21.020475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:21.021206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/02d2b26bcf0d408188d6b0b340278c29` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:21.022020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=02d2b26bcf0d408188d6b0b340278c29)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:21.024658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:21.041907 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4001/8009] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:23:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/02d2b26bcf0d408188d6b0b340278c29 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:21.045937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:21.059605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a936a5-223f-41a8-bfa7-213224bce5b9 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:21.066105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4199476ff634cc1bfc904935ed9d9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:21.067161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:21.067299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:21.067534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] PATH_INFO: `/v3/services/4292a0942cb04381b78dd9d912df737f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:21.068193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4292a0942cb04381b78dd9d912df737f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:21.069873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc78593-c7bd-48a9-9b87-43e4018ae71c tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:21.094399 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4009/8010] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:21 2022] DELETE /identity/v3/services/4292a0942cb04381b78dd9d912df737f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:21.098731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:21.185054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f8a4-d226-4e3e-9ec1-ecf307bd55a8 tempest-EndPointGroupsTest-871144189 tempest-EndPointGroupsTest-871144189-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:21.202413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:21.203334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:21.203617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:21.203893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] PATH_INFO: `/v3/users/9bdd48ddb43d490ea95677c5f70f9e30` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:21.205150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdd48ddb43d490ea95677c5f70f9e30)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:21.207419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:21.287469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdd48ddb43d490ea95677c5f70f9e30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:21.300915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdd48ddb43d490ea95677c5f70f9e30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:21.322665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdd48ddb43d490ea95677c5f70f9e30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:21.323920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdd48ddb43d490ea95677c5f70f9e30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:21.324798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdd48ddb43d490ea95677c5f70f9e30'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:21.347727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4002/8011] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:21 2022] DELETE /identity/v3/users/9bdd48ddb43d490ea95677c5f70f9e30 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:21.353644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:21.353962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:21.354132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:21.379165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:21.380485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:21.505323 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4010/8012] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:21.518282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:21.522272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:21.669204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:21.689671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740743-de3c-41ff-9051-e1d62045904d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:21.702426 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:21.705004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:21.705400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:21.705771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:21.734461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:21.738065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:21.770865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4003/8013] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:23.377469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:23.379824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:23.395594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900dc35-c8b7-422c-b466-4fa87ee4dc0f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:23.404792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:23.405548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:23.405985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:23.406356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] PATH_INFO: `/v3/projects/8e6fd8677f8e4a88b4ba46bb432c1dab` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:23.408322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6fd8677f8e4a88b4ba46bb432c1dab)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:23.458672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:23.474031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:23.556737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6fd8677f8e4a88b4ba46bb432c1dab', 'request_id': 'req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.571453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6fd8677f8e4a88b4ba46bb432c1dab', 'request_id': 'req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.582026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6fd8677f8e4a88b4ba46bb432c1dab', 'request_id': 'req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.605303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] The token cache is being invalidate because project 8e6fd8677f8e4a88b4ba46bb432c1dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:23.605652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.606336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.608541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4011/8014] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:23 2022] DELETE /identity/v3/projects/8e6fd8677f8e4a88b4ba46bb432c1dab => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:23.612323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:23.624092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8dcd8-5774-4337-b027-0192e8b8974c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:23.830468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:23.831714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:23.831907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:23.832193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] PATH_INFO: `/v3/users/d4199476ff634cc1bfc904935ed9d9c9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:23.834067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4199476ff634cc1bfc904935ed9d9c9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:23.838058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:23.967766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4199476ff634cc1bfc904935ed9d9c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:23.989019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4199476ff634cc1bfc904935ed9d9c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.034472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4199476ff634cc1bfc904935ed9d9c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.035847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4199476ff634cc1bfc904935ed9d9c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.036680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-231d577c-55c4-4797-bcac-6a840795ad37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4199476ff634cc1bfc904935ed9d9c9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.065564 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4004/8015] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:23 2022] DELETE /identity/v3/users/d4199476ff634cc1bfc904935ed9d9c9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:24.598277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:24.599908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:24.622403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741fae-5adc-4fac-a8ca-d19dfdfe85f4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:24.718545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:24.719454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:24.720245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:24.720912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] PATH_INFO: `/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:24.722590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1326fcf6c040d2a3f9b4bc6bc03586)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:24.724774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:24.792036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'request_id': 'req-3f3bdb3a-7405-40fe-9fd2-790af5d23567'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.802256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'request_id': 'req-3f3bdb3a-7405-40fe-9fd2-790af5d23567'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.810743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1326fcf6c040d2a3f9b4bc6bc03586', 'request_id': 'req-3f3bdb3a-7405-40fe-9fd2-790af5d23567'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.833146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] The token cache is being invalidate because project 1c1326fcf6c040d2a3f9b4bc6bc03586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:24.833746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.834435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3f3bdb3a-7405-40fe-9fd2-790af5d23567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:24.836535 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4012/8016] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:24 2022] DELETE /identity/v3/projects/1c1326fcf6c040d2a3f9b4bc6bc03586 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:24.843607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:24.844658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:24.845039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:24.866945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:24.868203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:24.944078 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4005/8017] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:24.954333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:24.954892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:24.955163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:24.978573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:24.979965 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:24.992877 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4013/8018] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:24.994338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.012459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52856918-6dc3-43ef-bbf2-fe6924befc57 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.020585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.021434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.021722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.022001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.022752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:25.023054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.024791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.028680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:25.050963 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4006/8019] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:25.051548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.064474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fed38-8856-4cc4-b76e-2f74fe8d40cc None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.070054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.070756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.071040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.071326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.072143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.074291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.114576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4014/8020] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:25 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:25.115706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.127124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdddd47-8810-429c-8180-346ec5a73f5c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.245272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.246029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.246329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.253041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.253830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.255851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.294085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4007/8021] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:25 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:25.298015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.304847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:25.314454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b03a-d472-4d7e-8ab4-789bc010ffbc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.332135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.332981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.334931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.335279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.336158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.338060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.360802 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4015/8022] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:25.365558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.376266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974b9c-287b-4fe2-bc07-9377b83ba342 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.381401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.382806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.383170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.383363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.384109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.385866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058edef-843b-4239-8846-f005fd3a9392 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.399577 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4008/8023] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:25.404365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.416053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e6b9-2b36-40cc-a2f4-a29a092dd802 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.423919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.425299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.425590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.425867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] PATH_INFO: `/v3/projects/ef4f08b48deb476f88d1a36ec5dc1408/users/b7eced6dcacb4cd8aecf729bbc0ab973/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.446312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4f08b48deb476f88d1a36ec5dc1408, user_id=b7eced6dcacb4cd8aecf729bbc0ab973, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.450068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.465593 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4016/8024] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:25 2022] PUT /identity/v3/projects/ef4f08b48deb476f88d1a36ec5dc1408/users/b7eced6dcacb4cd8aecf729bbc0ab973/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:25.479372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.479693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.479949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.524070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] MFA Rules not processed for user `b7eced6dcacb4cd8aecf729bbc0ab973`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:25.525750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:25.635689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4009/8025] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:25.638170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.836082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9309af-d3cc-44d4-b0fc-9b741396ea69 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:25.841509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:25.842154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:25.842445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:25.842731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:25.846558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:25.848974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:25.899439 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4017/8026] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:25 2022] POST /identity/v3/projects => generated 367 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:25.900215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:25.917173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477010-fe1b-4524-b3bb-7fbbdd0492d6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.016843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.017565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.017932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.018285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.019101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.021948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.032267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:26.055190 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4010/8027] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:25 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:26.060045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.072005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef15d-f81a-4486-93ba-f4d72e26e5c1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.078566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.079437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.079917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.080188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.081020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.084016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.098543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4018/8028] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:26.102685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.117977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5d0d0-3561-44b8-ab01-801fdfeace92 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.128642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.131236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.131743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.133358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] PATH_INFO: `/v3/projects/b72461eb95e840c4a204040fc70ec35b/users/97f8202bf34044c3927ec3ab411d5a94/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.176223 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72461eb95e840c4a204040fc70ec35b, user_id=97f8202bf34044c3927ec3ab411d5a94, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.184482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.220364 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4011/8029] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:26 2022] PUT /identity/v3/projects/b72461eb95e840c4a204040fc70ec35b/users/97f8202bf34044c3927ec3ab411d5a94/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:26.225877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.238208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a31d-c1e1-42b3-93d7-a75a6667f422 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.322721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.323701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.323990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.324265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.325234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.327275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355447e-d0a8-4edb-833b-10570aaa2e16 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.345578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.346956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4019/8030] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:26.357803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7193-c49a-4205-8956-2926e2c8738f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.362750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.363761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.364038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.364324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] PATH_INFO: `/v3/projects/b72461eb95e840c4a204040fc70ec35b/users/97f8202bf34044c3927ec3ab411d5a94/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.366863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72461eb95e840c4a204040fc70ec35b, user_id=97f8202bf34044c3927ec3ab411d5a94, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.369645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.383310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4012/8031] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:26 2022] PUT /identity/v3/projects/b72461eb95e840c4a204040fc70ec35b/users/97f8202bf34044c3927ec3ab411d5a94/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:26.394122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.394444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.394685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.426415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] MFA Rules not processed for user `97f8202bf34044c3927ec3ab411d5a94`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:26.428346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:26.464393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:26.527703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4020/8032] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:26.529494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.544884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312441-ee6d-408d-b756-d96f728e7c74 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.551627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.552350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.552698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.552982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.553770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.554883 ncdv-master-1 devstack@keystone.service[97719]: WARNING py.warnings [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:26.554883 ncdv-master-1 devstack@keystone.service[97719]: warnings.warn(msg) Jun 25 21:23:26.554883 ncdv-master-1 devstack@keystone.service[97719]: Jun 25 21:23:26.555850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.585569 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4013/8033] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:26 2022] POST /identity/v3/regions => generated 224 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:26.589847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.600004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b22aa-72f8-4c9c-bbbc-e41ad591c13a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.617041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.617734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.618022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.618318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.619020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.620457 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:26.620457 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:23:26.620457 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:23:26.621594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.649627 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4021/8034] 10.222.0.39 () {60 vars in 1148 bytes} [Sat Jun 25 21:23:26 2022] POST /identity/v3/regions => generated 224 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:26.650496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.665980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596114b-1268-4383-98e0-88ebd9bacbc4 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.710941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.712272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.712718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.713102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/3caf52aa-f8b4-40c8-b65c-bf8f9913427d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.714121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:create_region(region_id=3caf52aa-f8b4-40c8-b65c-bf8f9913427d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.716271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.758958 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4014/8035] 10.222.0.39 () {60 vars in 1258 bytes} [Sat Jun 25 21:23:26 2022] PUT /identity/v3/regions/3caf52aa-f8b4-40c8-b65c-bf8f9913427d => generated 232 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:26.762988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.776032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09f6a-7926-4b3e-98f3-64bc514777b2 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.807816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.809892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.811584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.812469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/3caf52aa-f8b4-40c8-b65c-bf8f9913427d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.813399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=3caf52aa-f8b4-40c8-b65c-bf8f9913427d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.823471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.862471 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4022/8036] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:23:26 2022] DELETE /identity/v3/regions/3caf52aa-f8b4-40c8-b65c-bf8f9913427d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:26.868061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.881533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59715a21-7ca4-4912-9924-b3f8c6a3b9f8 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.900262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.901015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.901289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.901571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.902446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.904093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:26.928964 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4015/8037] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:26 2022] POST /identity/v3/regions => generated 253 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:26.932985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:26.951282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613437-9304-47d6-8958-7fa801dab5cf tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:26.975372 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:26.976744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:26.977110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:26.977483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:26.978991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:update_region(region_id=c11d487e0e6c4d1e91aab2de009a7dd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:26.980249 ncdv-master-1 devstack@keystone.service[97720]: WARNING py.warnings [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:23:26.980249 ncdv-master-1 devstack@keystone.service[97720]: warnings.warn(msg) Jun 25 21:23:26.980249 ncdv-master-1 devstack@keystone.service[97720]: Jun 25 21:23:26.981659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.020241 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4023/8038] 10.222.0.39 () {60 vars in 1249 bytes} [Sat Jun 25 21:23:26 2022] PATCH /identity/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9 => generated 254 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:27.025107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.039886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2421c-a668-4008-a423-024893292fcc tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.062998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.064770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.065061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.065343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.066017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:get_region(region_id=c11d487e0e6c4d1e91aab2de009a7dd9)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.067399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.079736 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4016/8039] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:23:27 2022] GET /identity/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9 => generated 254 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:27.081235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.101889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadd8ec-1c8f-4031-9080-f8d4bdf794f3 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.108221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.109988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.110285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.110584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.111250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c11d487e0e6c4d1e91aab2de009a7dd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.113322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.141775 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4024/8040] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:27.145514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.162381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f726c-6915-478d-9b32-cb3f7fed30d5 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.181392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.182464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.182967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.183441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.184308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.185663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.193152 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4017/8041] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 21:23:27 2022] GET /identity/v3/regions => generated 670 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:23:27.198681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.211852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34da8-272c-400c-b235-7c5c037094be tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.217733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.219108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.219108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.219304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.219879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c11d487e0e6c4d1e91aab2de009a7dd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.221699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Could not find region: c11d487e0e6c4d1e91aab2de009a7dd9.: keystone.exception.RegionNotFound: Could not find region: c11d487e0e6c4d1e91aab2de009a7dd9. Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: c11d487e0e6c4d1e91aab2de009a7dd9. Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 21:23:27.240222 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: c11d487e0e6c4d1e91aab2de009a7dd9. Jun 25 21:23:27.241494 ncdv-master-1 devstack@keystone.service[97720]: ERROR keystone.server.flask.application Jun 25 21:23:27.242454 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4025/8042] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/regions/c11d487e0e6c4d1e91aab2de009a7dd9 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 25 21:23:27.247884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.263860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e4da-6366-44ce-8cdb-08b18560f6fa tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.276767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.277624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.277919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.278198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.278881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.279990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.286582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4018/8043] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 21:23:27 2022] GET /identity/v3/regions => generated 670 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:27.292049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.303738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a62d13-d2ea-44e3-90bc-8313437a52f0 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.309116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.309898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.310256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.310537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.311396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.313064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.355793 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4026/8044] 10.222.0.39 () {60 vars in 1149 bytes} [Sat Jun 25 21:23:27 2022] POST /identity/v3/regions => generated 254 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:27.357358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.369629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ab48-dd3b-42f8-9594-4a52fcb6b332 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.398388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.399106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.399402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.399687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.400406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Adding query filter params (parent_region_id=e8e36ac1ae424b90927ed14af44df2f6) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:27.400944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.404090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.414167 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4019/8045] 10.222.0.39 () {58 vars in 1226 bytes} [Sat Jun 25 21:23:27 2022] GET /identity/v3/regions?parent_region_id=e8e36ac1ae424b90927ed14af44df2f6 => generated 400 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:27.418860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.432015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14175d-5323-4330-9e39-6da5c5438638 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.441509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.442810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.443580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.445635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:27.446163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.446472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/19f7d452bd9c48a38efeb1379abe5ce8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.447173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=19f7d452bd9c48a38efeb1379abe5ce8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.451040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.499501 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4027/8046] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/regions/19f7d452bd9c48a38efeb1379abe5ce8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:27.500811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.516235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:27.538634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47714-d9ff-4157-96ae-7401fee751ac tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.544841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.546188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.547282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.548573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/d4da04f570b247e6b221e6f44ae19c96` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.549625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d4da04f570b247e6b221e6f44ae19c96)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.552791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.563286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:27.601414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4028/8047] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/regions/d4da04f570b247e6b221e6f44ae19c96 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:27.604889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630d1a-50da-4268-97d1-745d7f506c75 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.605927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.651299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.652476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ac58-9b8a-4743-8166-fdd156a9c0f9 tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.656543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.657374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.657674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] PATH_INFO: `/v3/users/629a0f9f31ef4a7a9e7fd20fffb9d3bd` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.657797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f8202bf34044c3927ec3ab411d5a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72461eb95e840c4a204040fc70ec35b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.659004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.659300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.659584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] PATH_INFO: `/v3/regions/e8e36ac1ae424b90927ed14af44df2f6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.660264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e8e36ac1ae424b90927ed14af44df2f6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.661360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629a0f9f31ef4a7a9e7fd20fffb9d3bd)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.662371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.674133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.691447 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4029/8048] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/regions/e8e36ac1ae424b90927ed14af44df2f6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:27.695555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:27.735586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4570-b66b-4b2a-8d46-ce161843db4b tempest-RegionsTestJSON-1415765776 tempest-RegionsTestJSON-1415765776-project-admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:27.744005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:27.745503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.745937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.746762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] PATH_INFO: `/v3/users/b7eced6dcacb4cd8aecf729bbc0ab973` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.748738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7eced6dcacb4cd8aecf729bbc0ab973)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:27.751881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:27.756337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629a0f9f31ef4a7a9e7fd20fffb9d3bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.775630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629a0f9f31ef4a7a9e7fd20fffb9d3bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.805276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629a0f9f31ef4a7a9e7fd20fffb9d3bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.808468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629a0f9f31ef4a7a9e7fd20fffb9d3bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.809001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2e6309da-4d5f-4cf2-8912-f211633ad849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629a0f9f31ef4a7a9e7fd20fffb9d3bd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.842970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7eced6dcacb4cd8aecf729bbc0ab973'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.843923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7eced6dcacb4cd8aecf729bbc0ab973'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.854237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4020/8049] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/users/629a0f9f31ef4a7a9e7fd20fffb9d3bd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:27.858274 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7eced6dcacb4cd8aecf729bbc0ab973'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.858720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.859185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.859639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.902968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:27.913117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:27.921090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7eced6dcacb4cd8aecf729bbc0ab973'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.931427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-01a1eab3-d061-4704-9964-a58ede4deaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7eced6dcacb4cd8aecf729bbc0ab973'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:27.942040 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4030/8050] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:27 2022] DELETE /identity/v3/users/b7eced6dcacb4cd8aecf729bbc0ab973 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:27.947125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:27.947623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:27.948122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:27.981404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:27.982689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:27.996177 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4021/8051] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:28.016509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:28.018132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:28.074932 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4031/8052] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:28.094554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:28.096675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:28.116996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:28.166924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:28.169042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96d43-c49a-4a62-b55e-49768c95604a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:28.247539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af197-786c-4221-9e87-beabdbf36e41 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:28.255813 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:28.256549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:28.256841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:28.257322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:28.262722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:28.265787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:28.266027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:28.266756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:28.287507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:28.288798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:28.290328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:28.294831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:28.309622 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4032/8053] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:28.313625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4022/8054] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:23:28.876342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:28.878469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:28.901911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca785-b79e-4706-b4a2-4fd13b15da04 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:28.914004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:28.920550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:28.922307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:28.923694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] PATH_INFO: `/v3/projects/53594216b2134b67893528ac9fd36c28` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:28.927963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53594216b2134b67893528ac9fd36c28)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:28.929996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:29.007590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53594216b2134b67893528ac9fd36c28', 'request_id': 'req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.008292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:29.017507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53594216b2134b67893528ac9fd36c28', 'request_id': 'req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.017945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:29.024810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53594216b2134b67893528ac9fd36c28', 'request_id': 'req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.055357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d59484-3685-484f-af5d-8585ecd9ecd9 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:29.058005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] The token cache is being invalidate because project 53594216b2134b67893528ac9fd36c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:29.058307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.062803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1f5f037-d8ad-4ee0-a228-52b64580cf2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.065655 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4033/8055] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:28 2022] DELETE /identity/v3/projects/53594216b2134b67893528ac9fd36c28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:29.078690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da81e-55bc-4ad3-a701-683e4f5f1d78 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.079028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da81e-55bc-4ad3-a701-683e4f5f1d78 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.079250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da81e-55bc-4ad3-a701-683e4f5f1d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.113222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f61da81e-55bc-4ad3-a701-683e4f5f1d78 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:29.116296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f61da81e-55bc-4ad3-a701-683e4f5f1d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:29.143035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:29.144549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.145020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.145479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] PATH_INFO: `/v3/projects/ef4f08b48deb476f88d1a36ec5dc1408` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.147007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4f08b48deb476f88d1a36ec5dc1408)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:29.149536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:29.220925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4f08b48deb476f88d1a36ec5dc1408', 'request_id': 'req-93630b91-83a3-4f8e-acb0-77ac285300c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.232570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4f08b48deb476f88d1a36ec5dc1408', 'request_id': 'req-93630b91-83a3-4f8e-acb0-77ac285300c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.239831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4f08b48deb476f88d1a36ec5dc1408', 'request_id': 'req-93630b91-83a3-4f8e-acb0-77ac285300c3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.252050 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4034/8056] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:29.254021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.254383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.254658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.255179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] The token cache is being invalidate because project ef4f08b48deb476f88d1a36ec5dc1408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:29.255481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.256150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.258083 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4023/8057] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:29 2022] DELETE /identity/v3/projects/ef4f08b48deb476f88d1a36ec5dc1408 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:29.262953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:29.265235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:29.298790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:29.300273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:29.302040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:29.357128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630b91-83a3-4f8e-acb0-77ac285300c3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:29.370307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:29.373483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.373902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.375017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] PATH_INFO: `/v3/users/97f8202bf34044c3927ec3ab411d5a94` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.378059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f8202bf34044c3927ec3ab411d5a94)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:29.383726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:29.432687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:29.468126 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4035/8058] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:29.473863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:29.485407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c9322-8851-4d58-bd53-98ba2acf7d69 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:29.492303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:29.493184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.494151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.494586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.495510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:29.495938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:29.498220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:29.507606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f8202bf34044c3927ec3ab411d5a94'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.513673 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4036/8059] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:29.518731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:29.531706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70393957-a470-45bf-9694-72fe2da47191 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:29.533726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f8202bf34044c3927ec3ab411d5a94'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.556576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:29.559113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.559477 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.560067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.561644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:29.566483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:29.569186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f8202bf34044c3927ec3ab411d5a94'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.575701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f8202bf34044c3927ec3ab411d5a94'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.577412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f8202bf34044c3927ec3ab411d5a94'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:29.615471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4024/8060] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:29 2022] DELETE /identity/v3/users/97f8202bf34044c3927ec3ab411d5a94 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:29.671943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4037/8061] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:29 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:29.672698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:29.674341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:29.820360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df98b2-ac9f-4444-ace8-05355df9fdc8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:29.947817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:29.985550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:29.986452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:29.986839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:29.987470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:29.988322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:29.992162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:30.044693 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4025/8062] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:29 2022] POST /identity/v3/users => generated 286 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:30.046499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:30.071712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866171a-93c0-4417-b335-ebd6d92f9328 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:30.085322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:30.086042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.087659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.087976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.088798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:30.095649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:30.126485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:30.127081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4038/8063] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:30.153055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519e825-1df6-4d18-b8d3-597a16b5adfa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:30.168039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:30.169425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.170856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.171978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.174891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:30.180128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad737-4c7f-4ee1-b0fc-3efc2c39f7df admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:30.212006 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4026/8064] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:30.214517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:30.232466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722740-993c-453d-8812-aeb72949b97c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:30.244186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:30.246350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.248218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.248564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] PATH_INFO: `/v3/projects/14c9536811d448ce93934719b3cb1ee0/users/20ebbf3fbc8d4b36bebcf9e106ad578a/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.315722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c9536811d448ce93934719b3cb1ee0, user_id=20ebbf3fbc8d4b36bebcf9e106ad578a, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:30.318379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:30.352859 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4039/8065] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:30 2022] PUT /identity/v3/projects/14c9536811d448ce93934719b3cb1ee0/users/20ebbf3fbc8d4b36bebcf9e106ad578a/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:30.359133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.359632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.360063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.422173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] MFA Rules not processed for user `20ebbf3fbc8d4b36bebcf9e106ad578a`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:30.432269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:30.461582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:30.463547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:30.593126 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4027/8066] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:30.604485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:30.605947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:30.629909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674780-6abf-4385-8e34-e37cc24b0add admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:30.636973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:30.638031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.638323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.638602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] PATH_INFO: `/v3/projects/b72461eb95e840c4a204040fc70ec35b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.640800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72461eb95e840c4a204040fc70ec35b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:30.644166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:30.745966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6983d3-2f3c-4b83-9a14-8368973d8f02 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:30.750701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72461eb95e840c4a204040fc70ec35b', 'request_id': 'req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:30.772728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72461eb95e840c4a204040fc70ec35b', 'request_id': 'req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:30.782508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72461eb95e840c4a204040fc70ec35b', 'request_id': 'req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:30.820282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] The token cache is being invalidate because project b72461eb95e840c4a204040fc70ec35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:30.824280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:30.825198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-46510101-0283-4bd8-b0e3-0eb3eb2a4d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:30.829104 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4040/8067] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:30 2022] DELETE /identity/v3/projects/b72461eb95e840c4a204040fc70ec35b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:30.835113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bcb88-64e5-4df5-9ea0-5a3941aa028f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.835434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bcb88-64e5-4df5-9ea0-5a3941aa028f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.836773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bcb88-64e5-4df5-9ea0-5a3941aa028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.873673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-902bcb88-64e5-4df5-9ea0-5a3941aa028f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:30.876094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-902bcb88-64e5-4df5-9ea0-5a3941aa028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:30.885243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:30.886102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:30.886563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:30.886745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:30.892051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:30.898263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:30.954351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:31.018952 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4041/8068] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:31.021267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.021554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.021834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.027841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.029484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.047783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4028/8069] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:31.049022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:31.050209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:31.072065 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4042/8070] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:31.072541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.103433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9079fa-1d53-486f-aef1-6c4cb5a8962f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.117324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.118028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.118655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.118785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.120289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:31.120766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.122444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.168507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4029/8071] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:31.169848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.180178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be382b8-3cfe-4b6f-8c4b-0d120979b6df None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.196182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.196958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.198560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.200065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.206495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.214487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.278182 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4043/8072] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:31 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:31.284412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.305077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818770-2d46-4a1b-839f-5dd089362386 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.453309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.454032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.454324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.454604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.455325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.457578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.528503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4030/8073] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:31 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:31.529352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.553440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618592a0-1f7c-4e95-9fa8-9d1e7810d1d5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.565151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.566043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.566330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.566604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.567344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.569016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.610561 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4044/8074] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:31.613227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.639240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcde1-cf2c-42a2-a760-5f5bc0cbad85 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.647605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.648521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.648744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.649055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.649825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.651740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6043b-f0b9-498a-a469-2f1aedb7fbcd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.689067 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4031/8075] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:31.690259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.706771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682836-d2bd-4e6a-8861-2c54b5592904 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:31.721294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:31.722221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.722503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.722779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] PATH_INFO: `/v3/projects/62a09d1a88be48d4908f5100b77b8a1f/users/216070850d374fb79d0c39f755c7a288/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.777605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a09d1a88be48d4908f5100b77b8a1f, user_id=216070850d374fb79d0c39f755c7a288, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:31.780207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:31.827961 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4045/8076] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:31 2022] PUT /identity/v3/projects/62a09d1a88be48d4908f5100b77b8a1f/users/216070850d374fb79d0c39f755c7a288/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:31.839063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:31.839591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:31.839990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:31.879396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] MFA Rules not processed for user `216070850d374fb79d0c39f755c7a288`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:31.881108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:31.971266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4032/8077] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:31.987951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:31.990085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:32.132007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d358a-5584-4032-aa2a-41c939f46eb6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:32.142280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:32.143564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:32.143813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:32.144037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:32.163488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:32.165390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507caf8a-e5b3-49d9-bb99-b2a0d6e8db00 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:32.203251 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4046/8078] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:32.332448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:32.383422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:32.466384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea45ac-000b-4d2b-a12f-4f53789b5d63 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:32.486527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:32.490458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:32.491647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:32.491647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] PATH_INFO: `/v3/users/216070850d374fb79d0c39f755c7a288` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:32.498690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=216070850d374fb79d0c39f755c7a288)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:32.504006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:32.687246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216070850d374fb79d0c39f755c7a288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:32.703886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216070850d374fb79d0c39f755c7a288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:32.723253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216070850d374fb79d0c39f755c7a288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:32.724710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216070850d374fb79d0c39f755c7a288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:32.724998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216070850d374fb79d0c39f755c7a288'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:32.750646 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4033/8079] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:32 2022] DELETE /identity/v3/users/216070850d374fb79d0c39f755c7a288 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:32.755116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:32.755414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:32.755688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:32.783470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:32.784972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:32.881766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:32.908676 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4047/8080] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:32.922338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:32.923814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:33.001220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29cdfc-9a0a-4115-9f68-ff29380586c9 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:33.006249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:33.008350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:33.008682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:33.008966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:33.020243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:33.024986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d713-fb08-498a-9a95-c6c14f5acfc7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:33.041690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4034/8081] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:34.813931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:34.815474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:34.841212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16195e4-44cd-4edf-9684-3fb602f303b9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:34.858474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:34.859390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:34.859858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:34.860354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] PATH_INFO: `/v3/projects/62a09d1a88be48d4908f5100b77b8a1f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:34.868725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a09d1a88be48d4908f5100b77b8a1f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:34.874138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:34.988766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a09d1a88be48d4908f5100b77b8a1f', 'request_id': 'req-d195b9f6-d730-4077-a717-c88cfea4da54'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:35.005655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a09d1a88be48d4908f5100b77b8a1f', 'request_id': 'req-d195b9f6-d730-4077-a717-c88cfea4da54'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:35.019538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a09d1a88be48d4908f5100b77b8a1f', 'request_id': 'req-d195b9f6-d730-4077-a717-c88cfea4da54'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:35.036365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] The token cache is being invalidate because project 62a09d1a88be48d4908f5100b77b8a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:35.036691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:35.037422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d195b9f6-d730-4077-a717-c88cfea4da54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:35.039037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4048/8082] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:34 2022] DELETE /identity/v3/projects/62a09d1a88be48d4908f5100b77b8a1f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:35.044862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.045369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.045369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.071808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:35.073463 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:35.128918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:35.179055 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4035/8083] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:35.187102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.187465 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.187753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.226024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:35.227287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:35.250317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.250851 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4049/8084] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:35.262721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9339b2-a6c0-4f49-a308-e947ef1e2d11 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.273781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.274483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.274770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.275051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.275851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:35.276166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.279305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.320698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.325231 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4036/8085] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:35.340043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282e4ed-3eed-4277-9c36-ddb2715fdc29 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.346967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.347827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.348268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.348724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.349680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.351784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.422973 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4050/8086] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:35 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:35.427311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.444469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0b236-cc7d-4b54-b362-4d143984a6c1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.607435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.608410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.608930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.611189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.612351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.617533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.676888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4037/8087] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:35 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:35.677760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.690880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028fa4-b31b-4e32-aa5c-d475c39967c5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.713694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.714408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.714755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.715319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.716282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.723126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.760218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.763403 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4051/8088] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:35.783998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0d0d-bac1-44ee-b7ae-cac2bae05ed1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.795391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.796521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.797039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.797527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.798486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.800390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e917bf-1ad6-4d21-ae53-6eef16b95c58 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.838724 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4038/8089] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:35.840060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:35.875504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089b50-e477-4e3c-86e1-a3f17739ca10 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:35.906088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:35.907594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:35.909773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:35.909773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] PATH_INFO: `/v3/projects/f9251230cdcd466abdb423b460b190b2/users/6ef229dab5ea427f9ccb62ff52adfbfb/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:35.957602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9251230cdcd466abdb423b460b190b2, user_id=6ef229dab5ea427f9ccb62ff52adfbfb, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:35.964677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:35.996730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4052/8090] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:35 2022] PUT /identity/v3/projects/f9251230cdcd466abdb423b460b190b2/users/6ef229dab5ea427f9ccb62ff52adfbfb/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:36.008521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.009540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.009893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.073350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] MFA Rules not processed for user `6ef229dab5ea427f9ccb62ff52adfbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:36.079826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:36.199239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4039/8091] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:36.201453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:36.374176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0e4d7-1d5a-43ec-b574-b8eaa40a53e9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:36.382802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:36.383831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.384349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.384946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.386447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:36.389481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:36.404736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:36.460803 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4053/8092] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:36 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:36.460950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:36.487672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042c57-fd81-449d-9f29-df86c10a945d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:36.593886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:36.630929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:36.631637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.631925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.632206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.633016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:36.635321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:36.690295 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4040/8093] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:36 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:36.694655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:36.712342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d17d8-c22d-4662-b6c2-21a690940380 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:36.735780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:36.741083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.741083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.741083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.741083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:36.750855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:36.765157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4054/8094] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:36.769163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:36.788966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318a76-5b49-45c0-a9fa-eb1f71f6192d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:36.794929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:36.796080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.796560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.797175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] PATH_INFO: `/v3/projects/62b019b8438f4da19c472189ddf1e3cf/users/acba9374043e45acb70f7515945c86d2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.818266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b019b8438f4da19c472189ddf1e3cf, user_id=acba9374043e45acb70f7515945c86d2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:36.822493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:36.848469 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4041/8095] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:36 2022] PUT /identity/v3/projects/62b019b8438f4da19c472189ddf1e3cf/users/acba9374043e45acb70f7515945c86d2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:36.852715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:36.865345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96aee4-2cf6-4dbf-8f38-2b22c2961570 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:36.950607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:36.952340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:36.952968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:36.954203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:36.955241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:36.957671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c8aa9-c23e-4126-b0fa-bfd5b7ae4eb1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:36.984324 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4055/8096] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:23:36.985763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:37.001750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef05e63-0738-47ec-9375-1a7a704aaaab admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:37.007021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:37.008097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:37.008702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:37.008996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] PATH_INFO: `/v3/projects/62b019b8438f4da19c472189ddf1e3cf/users/acba9374043e45acb70f7515945c86d2/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:37.011210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b019b8438f4da19c472189ddf1e3cf, user_id=acba9374043e45acb70f7515945c86d2, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:37.013961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:37.026675 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4042/8097] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:36 2022] PUT /identity/v3/projects/62b019b8438f4da19c472189ddf1e3cf/users/acba9374043e45acb70f7515945c86d2/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:37.038358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37756-5b57-44b2-b000-cd83e49a92b4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:37.038578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37756-5b57-44b2-b000-cd83e49a92b4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:37.038843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e37756-5b57-44b2-b000-cd83e49a92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:37.075001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c9e37756-5b57-44b2-b000-cd83e49a92b4 None None] MFA Rules not processed for user `acba9374043e45acb70f7515945c86d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:37.076320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9e37756-5b57-44b2-b000-cd83e49a92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:37.164619 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4056/8098] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:37.171654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:37.173654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:37.250023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a9267-d4fc-4927-bd2a-f84fdf7068c1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:37.254323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:37.255120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:37.255477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:37.255828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:37.268459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:37.270497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:37.288627 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4043/8099] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:37.985345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:37.986162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:37.986610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:38.011829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] MFA Rules not processed for user `9ffe5cc15fe246e28cfff1fdb071dff5`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:38.013816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:38.100202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:38.117908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4057/8100] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:39.859682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:39.862178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:39.993099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f4b6-5949-485b-a877-22358b235bb7 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:39.998866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:39.999808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:40.000248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:40.000603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:40.002713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:40.017697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:40.021260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:40.023367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7318cdd-9f4e-4864-a346-39a0b8450b55 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:40.041466 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4044/8101] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:40.108513 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8e69e-dfe4-4fcf-ba55-03c29f15e14b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:40.114271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:40.115663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:40.116179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:40.116792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] PATH_INFO: `/v3/users/6ef229dab5ea427f9ccb62ff52adfbfb` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:40.118823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef229dab5ea427f9ccb62ff52adfbfb)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:40.121738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:40.210717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef229dab5ea427f9ccb62ff52adfbfb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:40.211748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef229dab5ea427f9ccb62ff52adfbfb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:40.226247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef229dab5ea427f9ccb62ff52adfbfb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:40.245496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef229dab5ea427f9ccb62ff52adfbfb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:40.258004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef229dab5ea427f9ccb62ff52adfbfb'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:40.268063 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4058/8102] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:40 2022] DELETE /identity/v3/users/6ef229dab5ea427f9ccb62ff52adfbfb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:23:40.272756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:40.273134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:40.273356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:40.310256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:40.311541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:40.341963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:40.430358 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4045/8103] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:40.440007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:40.441903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:40.525841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4a1-b971-4bc8-bef1-3dbb3778010a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:40.532022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:40.533232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:40.533367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:40.533658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:40.552698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:40.554333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:40.580630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4059/8104] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:40.983536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:40.986251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:41.000623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394bcbf-7b67-4332-a54b-26e53453949f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:41.008835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:41.009632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:41.010339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:41.010792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] PATH_INFO: `/v3/projects/f9251230cdcd466abdb423b460b190b2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:41.012545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9251230cdcd466abdb423b460b190b2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:41.014733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:41.089998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9251230cdcd466abdb423b460b190b2', 'request_id': 'req-86291105-1f8c-405b-b84b-bf8dfbe133e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.100708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9251230cdcd466abdb423b460b190b2', 'request_id': 'req-86291105-1f8c-405b-b84b-bf8dfbe133e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.108616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9251230cdcd466abdb423b460b190b2', 'request_id': 'req-86291105-1f8c-405b-b84b-bf8dfbe133e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.130883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] The token cache is being invalidate because project f9251230cdcd466abdb423b460b190b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:41.131198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.132848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.134494 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4046/8105] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:40 2022] DELETE /identity/v3/projects/f9251230cdcd466abdb423b460b190b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:41.139780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:41.150403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53764a-37e7-4350-9569-578f1707e4bf service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:41.176082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:41.235397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:41.236302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:41.236787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:41.237046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] PATH_INFO: `/v3/users/acba9374043e45acb70f7515945c86d2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:41.238328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acba9374043e45acb70f7515945c86d2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:41.240858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:41.320704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acba9374043e45acb70f7515945c86d2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.322951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acba9374043e45acb70f7515945c86d2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.338330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acba9374043e45acb70f7515945c86d2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.393280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acba9374043e45acb70f7515945c86d2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.402946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c06df7a6-f2d9-497e-af7b-63955f75cf80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acba9374043e45acb70f7515945c86d2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:41.416644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4060/8106] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:41 2022] DELETE /identity/v3/users/acba9374043e45acb70f7515945c86d2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:41.869710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:41.871287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:41.901064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86291105-1f8c-405b-b84b-bf8dfbe133e3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:41.989301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:41.990384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:41.990759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:41.991132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] PATH_INFO: `/v3/projects/62b019b8438f4da19c472189ddf1e3cf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:41.992480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b019b8438f4da19c472189ddf1e3cf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:41.994555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.043226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:42.052068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b019b8438f4da19c472189ddf1e3cf', 'request_id': 'req-594e9fbe-1f87-44cf-991f-57091b3d9a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:42.068286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b019b8438f4da19c472189ddf1e3cf', 'request_id': 'req-594e9fbe-1f87-44cf-991f-57091b3d9a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:42.078328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b019b8438f4da19c472189ddf1e3cf', 'request_id': 'req-594e9fbe-1f87-44cf-991f-57091b3d9a73'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:42.096540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] The token cache is being invalidate because project 62b019b8438f4da19c472189ddf1e3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:42.097226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:42.098157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-594e9fbe-1f87-44cf-991f-57091b3d9a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:42.100193 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4047/8107] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:41 2022] DELETE /identity/v3/projects/62b019b8438f4da19c472189ddf1e3cf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:42.105725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.106426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.106918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.133782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:42.135388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:42.289067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4061/8108] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:42.290906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.291256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.291767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.315519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:42.316846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:42.328741 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4048/8109] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:42.331604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.347122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3bab7-8049-455a-a53c-eca54c946440 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.353114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.354432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.354771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.355171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.356003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:42.356858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.358785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.378384 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4062/8110] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:42.382841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.397180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b390d-0942-46ef-9fc5-e869757a2501 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.403046 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.404050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.404584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.405100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.406072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.408553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.453985 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4049/8111] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:42 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:42.455529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.467088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2b93-9e7c-4f5f-81dd-03f3cb30dfce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.505352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:42.554719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.555525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.555819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.556099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.556905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.560764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.590901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4063/8112] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:42 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:42.595332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.607858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd8db6-4c81-408a-b693-78983d621ffe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.613714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.614407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.614694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.614966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.615924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.617473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.633452 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4050/8113] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:42.641993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.653750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260da00-f26d-482f-bf6d-cb1a15de87a2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.658686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.659323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.659610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.659901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.660672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.662552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66febf17-7b14-4c7f-87f7-a0b5abf505b6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.678031 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4064/8114] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:42.679692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.691593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d261ca-3be2-4c83-97a7-66bd1a8b7ea3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:42.697023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:42.697996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.698281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.698579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] PATH_INFO: `/v3/projects/27cb0469925947919b933fab48ce0019/users/c66ff86550764bcb80a7c19f43709f4c/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.715887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cb0469925947919b933fab48ce0019, user_id=c66ff86550764bcb80a7c19f43709f4c, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:42.718534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:42.734425 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4051/8115] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:42 2022] PUT /identity/v3/projects/27cb0469925947919b933fab48ce0019/users/c66ff86550764bcb80a7c19f43709f4c/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:42.748462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:42.748462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:42.748462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:42.782104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] MFA Rules not processed for user `c66ff86550764bcb80a7c19f43709f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:42.783505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:42.904226 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4065/8116] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:42.916764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:42.919295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:43.009875 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bb98-eeca-4b34-bfdd-c278263157be admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:43.017345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:43.018824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:43.019281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:43.019555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:43.035916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:43.037657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f4e6-a76d-46d4-9771-34a1938f174d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:43.058299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4052/8117] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:44.095558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:44.242943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a497-0677-4a09-90ff-f1526c9c9923 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:44.256283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:44.257402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:44.257789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:44.258176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] PATH_INFO: `/v3/users/c66ff86550764bcb80a7c19f43709f4c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:44.259869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66ff86550764bcb80a7c19f43709f4c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:44.263285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:44.332577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:44.355880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66ff86550764bcb80a7c19f43709f4c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:44.357733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66ff86550764bcb80a7c19f43709f4c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:44.392801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66ff86550764bcb80a7c19f43709f4c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:44.422485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66ff86550764bcb80a7c19f43709f4c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:44.445860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66ff86550764bcb80a7c19f43709f4c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:44.463567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4066/8118] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:23:44 2022] DELETE /identity/v3/users/c66ff86550764bcb80a7c19f43709f4c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:44.465110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:44.465585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:44.465796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:44.501527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:44.506902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:44.683486 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4053/8119] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:44.742838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:44.745073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:44.867791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eafb3-f5e8-473e-8c07-d86d138bab5e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:44.873591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:44.874539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:44.874966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:44.875352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:44.891171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:44.894186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c336987-6fa8-4d89-b089-62c94ebffbae service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:44.909508 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4067/8120] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:46.589120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:46.590738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:46.626080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807976b8-2e3b-4166-a2c6-3bdde92042c5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:46.643710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:46.644884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:46.645107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:46.645567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] PATH_INFO: `/v3/projects/27cb0469925947919b933fab48ce0019` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:46.650989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cb0469925947919b933fab48ce0019)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:46.654743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:46.660649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:46.748054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cb0469925947919b933fab48ce0019', 'request_id': 'req-37895b46-5038-4ed2-be30-cb162a636ae4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:46.763968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cb0469925947919b933fab48ce0019', 'request_id': 'req-37895b46-5038-4ed2-be30-cb162a636ae4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:46.780064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cb0469925947919b933fab48ce0019', 'request_id': 'req-37895b46-5038-4ed2-be30-cb162a636ae4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:46.813642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] The token cache is being invalidate because project 27cb0469925947919b933fab48ce0019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:23:46.813955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:46.822596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-37895b46-5038-4ed2-be30-cb162a636ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:23:46.826418 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4054/8121] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:23:46 2022] DELETE /identity/v3/projects/27cb0469925947919b933fab48ce0019 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:46.833319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:46.833751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:46.834028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:46.878396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:46.880537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:47.034221 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4068/8122] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:47.042623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.043038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.043401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.078665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:47.080011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:47.121007 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4055/8123] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:23:47.125920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.144155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45cb6-af4d-44b6-b727-63ecafda5023 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.158214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.158928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.159215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.159496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.160247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:23:47.160589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.162252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.191199 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4069/8124] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:23:47.192724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.205455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444921e8-5c15-4938-8c59-4efad9cff3bf None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.222695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.223396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.223766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.224060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.224801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.226743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.285363 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4056/8125] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:23:47 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:23:47.286641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.304600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693e6a1-2b3f-45b1-96b7-28869b781e09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.406989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:47.434539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.435258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.435543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.436276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.436562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.440641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.476178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4070/8126] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:23:47 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:23:47.481205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.498962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f397-b0ad-4549-9366-b9b9f8c617f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.509237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.510294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.510839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.511344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.513241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.515273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.536118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.540649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4057/8127] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:47.552391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f4d-3373-4275-8cf0-8cf07962668b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.566257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.567190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.567490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.569197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.570754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.577411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15261-f19c-4b73-8338-9976d496e887 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.615721 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4071/8128] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:23:47.617166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.638188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506855-3091-4da0-a0db-d7d2417a9680 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:47.653853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:47.655297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.655599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.657427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] PATH_INFO: `/v3/projects/a982aebb43484fb28b46c65b41427bd9/users/255d2825475340b5a1005b5d78e8fd13/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.708404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a982aebb43484fb28b46c65b41427bd9, user_id=255d2825475340b5a1005b5d78e8fd13, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:47.711209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:47.761685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:47.761973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:47.762468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:47.762581 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4058/8129] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:23:47 2022] PUT /identity/v3/projects/a982aebb43484fb28b46c65b41427bd9/users/255d2825475340b5a1005b5d78e8fd13/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:23:47.807724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] MFA Rules not processed for user `255d2825475340b5a1005b5d78e8fd13`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:23:47.809457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:47.942003 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4072/8130] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:23:47.952824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:47.954673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:48.042676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04730-7959-4367-9513-fa3856a1813e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:48.049863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:48.050549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:48.050832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:48.051317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:48.061840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:48.063590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:48.085176 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4059/8131] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:55.965750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:23:55.967233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:56.133915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9d8e6-fced-4997-b08f-127376c723e8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:23:56.146672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:23:56.147400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:23:56.147687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:23:56.147967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:23:56.156669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:23:56.242997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:23:56.249535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:23:56.283410 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4073/8132] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:23:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:23:58.075631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:02.988065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:03.008819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee21c-b1d9-438b-95f9-2f9d607f895c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:03.027606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:03.029185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:03.029701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:03.030217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:03.032590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:03.053206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:03.057368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a540f1-a4b5-45d9-ac8e-3a26dc4095b5 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:03.085430 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4060/8133] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:06.270701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:13.073475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:23.621855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:23.623957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:23.695303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca215-5b5f-42c9-bf41-3ab8cc809078 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:23.699934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:23.700863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:23.701500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:23.701781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] PATH_INFO: `/v3/users/8705ef2687e44f82aadb0a88a2129381` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:23.702962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8705ef2687e44f82aadb0a88a2129381)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:23.704935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:23.754809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8705ef2687e44f82aadb0a88a2129381'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:23.755505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8705ef2687e44f82aadb0a88a2129381'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:23.763588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8705ef2687e44f82aadb0a88a2129381'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:23.777557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8705ef2687e44f82aadb0a88a2129381'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:23.785535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8705ef2687e44f82aadb0a88a2129381'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:23.792759 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4074/8134] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:24:23 2022] DELETE /identity/v3/users/8705ef2687e44f82aadb0a88a2129381 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:23.797396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:23.797871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:23.798020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:23.821955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:23.823411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:23.888473 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4061/8135] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:23.898397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:23.899877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:23.968953 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79805-1594-47d0-971c-95ecc5465225 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:23.974260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:23.974933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:23.975221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:23.975526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:23.987040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:23.988631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78384d9-2e1c-4bf5-9963-90b01a001ef5 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:24.000233 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4075/8136] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:24.203202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:24.205484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:24.225795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a86837-bc93-40f2-8805-5c052c1bee7b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:24.232339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:24.234188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.234693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.235245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] PATH_INFO: `/v3/projects/419fc04604d946eeabdf8ee39997270e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.237004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=419fc04604d946eeabdf8ee39997270e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:24.239531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:24.331419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419fc04604d946eeabdf8ee39997270e', 'request_id': 'req-7b420692-0bcd-4768-ab46-c63c3b518e2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:24.343431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419fc04604d946eeabdf8ee39997270e', 'request_id': 'req-7b420692-0bcd-4768-ab46-c63c3b518e2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:24.350812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419fc04604d946eeabdf8ee39997270e', 'request_id': 'req-7b420692-0bcd-4768-ab46-c63c3b518e2e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:24.365603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] The token cache is being invalidate because project 419fc04604d946eeabdf8ee39997270e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:24:24.365977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:24.367182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7b420692-0bcd-4768-ab46-c63c3b518e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:24.369411 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4062/8137] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:24:24 2022] DELETE /identity/v3/projects/419fc04604d946eeabdf8ee39997270e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:24.375551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.375848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.376132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.398704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:24.400131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:24.430775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:24.511113 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4076/8138] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:24.519454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.520825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.521449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.552167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:24.553648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:24.566828 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4063/8139] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:24.572539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:24.588319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89027b14-77e8-4386-b1b0-9b11426abb7f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:24.594983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:24.596067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.596602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.597082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.598299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:24:24.598834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:24.600822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:24.624767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4077/8140] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:24:24.626222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:24.640699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a744-40b9-4834-af75-db0bb837305f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:24.660086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:24.662066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.662614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.663119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.665342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:24.675652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:24.776228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:24.777400 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4064/8141] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:24:24 2022] POST /identity/v3/projects => generated 359 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:24:24.796888 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e166-66c9-421c-bafb-f88e4389e58f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:24.954431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:24.955132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:24.955417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:24.956301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:24.957246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:24.959241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:24.989157 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4078/8142] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:24:24 2022] POST /identity/v3/users => generated 280 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:24:24.993607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:25.029160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299a23-e4e2-4193-aa38-345321ba3ea8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:25.041985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:25.042891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:25.043353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:25.043795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:25.044944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:25.047670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:25.075497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4065/8143] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:24:25.079620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:25.092886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e871c-df9a-4355-8aad-5e0f48e59e75 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:25.105929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:25.107481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:25.107976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:25.108512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:25.109483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:25.111512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b383-90b9-44fd-be15-40437b08b9bb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:25.127798 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4079/8144] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:24:25.132755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:25.150015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883001-62cc-42ae-af8e-24b6a680d908 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:25.160477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:25.161471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:25.161900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:25.162507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] PATH_INFO: `/v3/projects/62272cf7284344b4bb414585d2c6c040/users/8e07c099c85d41d8b115eaa0c947a3fd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:25.184851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62272cf7284344b4bb414585d2c6c040, user_id=8e07c099c85d41d8b115eaa0c947a3fd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:25.188257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:25.216131 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4066/8145] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:24:25 2022] PUT /identity/v3/projects/62272cf7284344b4bb414585d2c6c040/users/8e07c099c85d41d8b115eaa0c947a3fd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:25.227719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633be84-7191-40df-8573-e3a02010fbad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:25.228053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633be84-7191-40df-8573-e3a02010fbad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:25.228300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633be84-7191-40df-8573-e3a02010fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:25.271480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2633be84-7191-40df-8573-e3a02010fbad None None] MFA Rules not processed for user `8e07c099c85d41d8b115eaa0c947a3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:25.272867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2633be84-7191-40df-8573-e3a02010fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:25.405494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4080/8146] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:25.415877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:25.418211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:25.469394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:25.537823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bf79-d78e-4591-9ea3-b6f806a3cca8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:25.543585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:25.548012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:25.548615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:25.549064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:25.562821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:25.564584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60d04d-c66f-4915-a101-cd60f96e6885 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:25.578343 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4067/8147] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:35.397388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:35.570663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=17 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:46.142764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633be84-7191-40df-8573-e3a02010fbad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:46.144924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2633be84-7191-40df-8573-e3a02010fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:46.345987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633be84-7191-40df-8573-e3a02010fbad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:46.363195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:46.364260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:46.364481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:46.364746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] PATH_INFO: `/v3/users/9ffe5cc15fe246e28cfff1fdb071dff5` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:46.366236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffe5cc15fe246e28cfff1fdb071dff5)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:46.373872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:46.449603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffe5cc15fe246e28cfff1fdb071dff5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:46.450391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffe5cc15fe246e28cfff1fdb071dff5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:46.462244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffe5cc15fe246e28cfff1fdb071dff5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:46.483794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffe5cc15fe246e28cfff1fdb071dff5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:46.492663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffe5cc15fe246e28cfff1fdb071dff5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:46.501373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4081/8148] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:24:46 2022] DELETE /identity/v3/users/9ffe5cc15fe246e28cfff1fdb071dff5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:46.506743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:46.507260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:46.507461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:46.527528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:46.529150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:46.608003 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4068/8149] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:46.619395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:46.620870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:46.691423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba5c4-a8f2-4a09-9650-f7a3c22e2c5d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:46.696362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:46.697076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:46.697492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:46.697826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:46.709047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:46.711049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:46.722482 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4082/8150] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:47.206611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:47.211454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:47.236027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b56e-f4fa-46f4-803b-3123688ed348 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:47.257818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:47.259580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:47.260023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:47.260635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] PATH_INFO: `/v3/projects/0293ee04883e4c2b95776200fa0b5862` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:47.264176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0293ee04883e4c2b95776200fa0b5862)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:47.269062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:47.396300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0293ee04883e4c2b95776200fa0b5862', 'request_id': 'req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.415147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0293ee04883e4c2b95776200fa0b5862', 'request_id': 'req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.424747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0293ee04883e4c2b95776200fa0b5862', 'request_id': 'req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.457731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] The token cache is being invalidate because project 0293ee04883e4c2b95776200fa0b5862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:24:47.458028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.458941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.465319 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4069/8151] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:24:47 2022] DELETE /identity/v3/projects/0293ee04883e4c2b95776200fa0b5862 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:47.465687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:47.480300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9dae6-938b-49e5-8349-f570922c3d40 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:47.535726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:47.601910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:47.603337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:47.603821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:47.604295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] PATH_INFO: `/v3/users/12fd6fb842634d31a397f8de8650bbf6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:47.605969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fd6fb842634d31a397f8de8650bbf6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:47.608272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:47.677102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fd6fb842634d31a397f8de8650bbf6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.677816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fd6fb842634d31a397f8de8650bbf6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.687872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fd6fb842634d31a397f8de8650bbf6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.704768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fd6fb842634d31a397f8de8650bbf6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.714661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bc21e4ba-18c7-4d78-80e9-9a56b47e6174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fd6fb842634d31a397f8de8650bbf6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:47.724467 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4083/8152] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:24:47 2022] DELETE /identity/v3/users/12fd6fb842634d31a397f8de8650bbf6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:24:48.478290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:48.488540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:48.533409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d3e9-3a11-4998-91e9-2ba0c3ca4250 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:48.649161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:48.651292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:48.651894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:48.652585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] PATH_INFO: `/v3/projects/237fc8ece20b4b219545d03483d35c62` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:48.656351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237fc8ece20b4b219545d03483d35c62)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:48.658900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:48.747126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:48.845972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237fc8ece20b4b219545d03483d35c62', 'request_id': 'req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:48.864266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237fc8ece20b4b219545d03483d35c62', 'request_id': 'req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:48.872537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237fc8ece20b4b219545d03483d35c62', 'request_id': 'req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:48.898406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] The token cache is being invalidate because project 237fc8ece20b4b219545d03483d35c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:24:48.899093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:48.900002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f32d524b-f02a-4c25-8b9a-d60c26e9a3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:24:48.936386 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4070/8153] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:24:48 2022] DELETE /identity/v3/projects/237fc8ece20b4b219545d03483d35c62 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:48.938156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:48.938628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:48.938716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:48.978201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:48.980300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:49.105112 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4084/8154] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:24:49.113985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.114252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.114537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.140991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:49.144234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:49.160736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.171757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edabae-7db6-4069-8bf1-31c9766621d0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.172777 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4071/8155] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:24:49.177679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.178440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.178661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.178993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.179922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:24:49.180239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.182012 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.201971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.206815 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4085/8156] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:24:49.213647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d8695-7d69-4d0f-a0b2-8678f3fb4410 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.219134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.219822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.220099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.220375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.221191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.224213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.277740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.285171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4072/8157] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:24:49 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:24:49.295504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77541533-4f5a-42a9-848e-995ce2bd5fdc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.342842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:49.392993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.393987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.394436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.394868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.395723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.398964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.432741 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4086/8158] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:24:49 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:24:49.434238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.452909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248479b-fde8-4a0f-bee8-410f6e45f221 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.459224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.459986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.460414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.460825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.462254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.464339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.484937 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4073/8159] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:24:49.486711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.499593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdb8f-1ceb-49dc-bc97-90b01ef4676e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.511803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.512546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.512840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.513122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.513866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.515827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d838-5949-4b22-bb3f-5e0f09e8c711 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.535340 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4087/8160] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:24:49.536619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.549285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4690-8af7-4b76-a395-af0b1c225989 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:49.561180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:49.562151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.562446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.562730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] PATH_INFO: `/v3/projects/d1a396ec47a346dc97426df498e54ab2/users/8d162afa6d9b48ef9fac1bf23c0c41e9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.596286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a396ec47a346dc97426df498e54ab2, user_id=8d162afa6d9b48ef9fac1bf23c0c41e9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:49.599995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:49.626203 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4074/8161] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:24:49 2022] PUT /identity/v3/projects/d1a396ec47a346dc97426df498e54ab2/users/8d162afa6d9b48ef9fac1bf23c0c41e9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:24:49.631512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:49.632079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:49.632669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:49.658126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:24:49.659448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:49.758177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4088/8162] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:24:49.927882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:49.930033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:50.113479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869f065-3031-407a-96b1-8a048436a845 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:50.118485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:50.119605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:50.119857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:50.120133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:50.144179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:50.145782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:50.166783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4075/8163] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:56.246489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:56.248623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:56.356789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d81d-f63b-4414-8225-e1c0edde2cad None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:56.366437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:56.367631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:56.367996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:56.368337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:56.370716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:56.395678 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:56.398240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bc247-6c70-4b95-bdd1-6ec11da97f05 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:56.425994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4089/8164] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:24:58.361190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:24:58.362785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:58.398399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea835fb-2c6a-442f-933f-a0e0570da51c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:24:58.414278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:24:58.417494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:24:58.418239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:24:58.418535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:24:58.425725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:24:58.459768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:24:58.461480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:24:58.499652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4076/8165] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:02.159837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.160319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.160625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.215677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:02.217725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:02.245112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:02.345488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4090/8166] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:02.349712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.362854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60b78-0e87-4f84-a3b3-4ccc40edd823 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.369237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.370098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.370458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.370794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.371547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:02.374480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:02.435261 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4077/8167] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:25:02 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:02.440305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.462730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62709-f118-4b73-b2cc-be34cadb7128 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.551279 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.552001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.552286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.552593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.553311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:02.559106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:02.596673 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4091/8168] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:25:02 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:02.600267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.621402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340091-9917-445c-bf4d-9a1c424a4905 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.637523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.638453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.638905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.639356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.640300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:02.642633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:02.663404 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4078/8169] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:02.670409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.685062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1cc0-2fc7-4dca-bd9e-022607a9af83 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.691216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.692474 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.692948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.693453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] PATH_INFO: `/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c/users/5cdfe6293a8c48cf82e96279440d48c0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.713050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfb5d7e0e9748f4b66bffb2e30f8f4c, user_id=5cdfe6293a8c48cf82e96279440d48c0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:02.717077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:02.743218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.749696 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4092/8170] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:02 2022] PUT /identity/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c/users/5cdfe6293a8c48cf82e96279440d48c0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:02.757306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239599e-c2d0-42cd-83d6-6a674b2986df admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.762912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:02.892742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.893768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.894314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.894771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.896181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:02.899454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:02.923394 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4079/8171] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:02.928606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:02.951754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41eac-3c04-4636-a8ef-5632c3ba1710 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:02.979211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:02.980133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:02.980413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:02.980785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] PATH_INFO: `/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c/users/5cdfe6293a8c48cf82e96279440d48c0/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:02.996072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfb5d7e0e9748f4b66bffb2e30f8f4c, user_id=5cdfe6293a8c48cf82e96279440d48c0, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:03.009790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa30fe0-9238-4b46-9fd2-67c18d43be2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:03.032698 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4093/8172] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:02 2022] PUT /identity/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c/users/5cdfe6293a8c48cf82e96279440d48c0/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:11.498274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:11.500541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:11.517950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ea42-ad32-4d56-a846-8c71127eaa3d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:11.617545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:11.618501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:11.618830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:11.619112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] PATH_INFO: `/v3/users/20ebbf3fbc8d4b36bebcf9e106ad578a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:11.620416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ebbf3fbc8d4b36bebcf9e106ad578a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:11.622538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:11.698406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ebbf3fbc8d4b36bebcf9e106ad578a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:11.712735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ebbf3fbc8d4b36bebcf9e106ad578a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:11.731667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ebbf3fbc8d4b36bebcf9e106ad578a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:11.732667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ebbf3fbc8d4b36bebcf9e106ad578a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:11.733367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ebbf3fbc8d4b36bebcf9e106ad578a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:11.752776 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4080/8173] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:25:11 2022] DELETE /identity/v3/users/20ebbf3fbc8d4b36bebcf9e106ad578a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:11.754608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a881-17f1-4154-927b-1aa2f2ab36ab None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:11.755125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a881-17f1-4154-927b-1aa2f2ab36ab None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:11.755266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a881-17f1-4154-927b-1aa2f2ab36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:11.777285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9499a881-17f1-4154-927b-1aa2f2ab36ab None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:11.778801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9499a881-17f1-4154-927b-1aa2f2ab36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:11.870661 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4094/8174] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:11.897114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:11.900953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:11.946828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:12.010275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5eda-47f5-4256-939f-4a5d2ed471d4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:12.021303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:12.022867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.023399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.023945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:12.036534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:12.038494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:12.054523 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4081/8175] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:12.172955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.173497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.173881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:12.195043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:12.221547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] MFA Rules not processed for user `5cdfe6293a8c48cf82e96279440d48c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:12.222997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:12.318984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4095/8176] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:12.334760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:12.337877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:12.402385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec38b-15b0-4bae-a15b-8298fd540a8c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:12.406148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:12.406816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.407098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.407375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:12.409305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:12.480237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:12.481835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ba903-377a-432b-bcd0-f15321f16c33 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:12.497681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4082/8177] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:12.581435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:12.582944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:12.605144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322a29-e725-4078-bedd-ca3d4abea56d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:12.617875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:12.618736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.618930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.619207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] PATH_INFO: `/v3/projects/14c9536811d448ce93934719b3cb1ee0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:12.624862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c9536811d448ce93934719b3cb1ee0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:12.626578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:12.755367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c9536811d448ce93934719b3cb1ee0', 'request_id': 'req-3455f5e3-502a-4872-9393-ba0b31d6b19e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:12.773842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c9536811d448ce93934719b3cb1ee0', 'request_id': 'req-3455f5e3-502a-4872-9393-ba0b31d6b19e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:12.783187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c9536811d448ce93934719b3cb1ee0', 'request_id': 'req-3455f5e3-502a-4872-9393-ba0b31d6b19e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:12.801339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] The token cache is being invalidate because project 14c9536811d448ce93934719b3cb1ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:25:12.801636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:12.804854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3455f5e3-502a-4872-9393-ba0b31d6b19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:12.819812 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4096/8178] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:25:12 2022] DELETE /identity/v3/projects/14c9536811d448ce93934719b3cb1ee0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:12.825633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.826451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.826962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:12.865117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:12.866477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:12.984294 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4083/8179] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:12.992532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:12.993123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:12.993693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.031959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:13.034499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:13.048108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4097/8180] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:13.052121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.068100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc26e8-01a6-4ee7-804c-e27e76cb024b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.084305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.085342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.085644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.085927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.086847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:25:13.087167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.090271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.130786 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4084/8181] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:25:13.135663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.164983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1482-76f3-4ab2-9cf3-70f692a930b6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.173754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.174827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.175341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.175949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.177335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.180342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.223357 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4098/8182] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:25:13 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:13.227510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.250878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1a64-4301-4276-8adf-1c303bb3e93c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.255833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:13.371063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.372597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.373031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.373893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.374896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.377699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.424921 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4085/8183] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:25:13 2022] POST /identity/v3/users => generated 281 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:13.429475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.444259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267086d-fc67-488f-9da1-e168a6521a20 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.453291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.454343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.454657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.455528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.456250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.457996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.473349 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4099/8184] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:13.477210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.492272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8fefd-6019-4fe3-9e2e-5483b7318488 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.505871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.506818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.507168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.507552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.508382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.511130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f16239-dfe7-40b7-a5cc-12aebf251ae4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.526340 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4086/8185] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:13.530110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.541154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d43f8-de84-48df-b7da-6ed897a07555 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:13.547597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:13.548848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.549696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.549696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] PATH_INFO: `/v3/projects/3db1c393cd3c420b8db400b33a84b2c1/users/cb028384e2374b3da59716aa35a8e428/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.623944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db1c393cd3c420b8db400b33a84b2c1, user_id=cb028384e2374b3da59716aa35a8e428, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:13.628904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:13.667366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4100/8186] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:13 2022] PUT /identity/v3/projects/3db1c393cd3c420b8db400b33a84b2c1/users/cb028384e2374b3da59716aa35a8e428/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:13.670863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:13.671202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:13.671496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:13.710826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] MFA Rules not processed for user `cb028384e2374b3da59716aa35a8e428`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:13.712600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:13.876590 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4087/8187] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:13.911797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:13.913765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:13.941655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:14.012917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:14.015611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:14.081701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56aa8-d727-4bf8-8c99-61097ecdf6bb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:14.094606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:14.095338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:14.095643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:14.096155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:14.118420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:14.119905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72568c8-956e-489b-aa2e-b4e62ef4f0e2 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:14.127360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07119cd4-effb-4dc7-9dc1-1bbf3ed16834 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:14.136141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:14.137408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:14.137923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:14.138473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] PATH_INFO: `/v3/users/255d2825475340b5a1005b5d78e8fd13` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:14.142059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4101/8188] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:14.144785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255d2825475340b5a1005b5d78e8fd13)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:14.147959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:14.171952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:14.260924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255d2825475340b5a1005b5d78e8fd13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:14.276846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255d2825475340b5a1005b5d78e8fd13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:14.305115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255d2825475340b5a1005b5d78e8fd13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:14.306142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255d2825475340b5a1005b5d78e8fd13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:14.307050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255d2825475340b5a1005b5d78e8fd13'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:14.340875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071050-884c-41c1-8104-ec498bbea270 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:14.341324 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4088/8189] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:25:14 2022] DELETE /identity/v3/users/255d2825475340b5a1005b5d78e8fd13 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:14.341628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071050-884c-41c1-8104-ec498bbea270 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:14.342416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071050-884c-41c1-8104-ec498bbea270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:14.366555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-94071050-884c-41c1-8104-ec498bbea270 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:14.368320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94071050-884c-41c1-8104-ec498bbea270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:14.524497 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4102/8190] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:14.543202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:14.546549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:14.629505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c541-9e9d-420d-ad58-b025f40cd5c8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:14.633905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:14.634579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:14.634868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:14.635148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:14.649707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:14.652158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e61e7-a7b0-4759-b6a7-3a24260a41fd service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:14.668743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4089/8191] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:15.605261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94071050-884c-41c1-8104-ec498bbea270 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:15.606834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94071050-884c-41c1-8104-ec498bbea270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:15.641822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94071050-884c-41c1-8104-ec498bbea270 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:15.656207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:15.667412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:15.667719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:15.667991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] PATH_INFO: `/v3/projects/a982aebb43484fb28b46c65b41427bd9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:15.675007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a982aebb43484fb28b46c65b41427bd9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:15.681309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:15.852892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a982aebb43484fb28b46c65b41427bd9', 'request_id': 'req-5bceae39-3e0f-4c20-b9c1-244c82e6769d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:15.867156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a982aebb43484fb28b46c65b41427bd9', 'request_id': 'req-5bceae39-3e0f-4c20-b9c1-244c82e6769d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:15.879185 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a982aebb43484fb28b46c65b41427bd9', 'request_id': 'req-5bceae39-3e0f-4c20-b9c1-244c82e6769d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:15.928369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] The token cache is being invalidate because project a982aebb43484fb28b46c65b41427bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:25:15.928627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:15.929446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5bceae39-3e0f-4c20-b9c1-244c82e6769d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:15.934395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4103/8192] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:25:15 2022] DELETE /identity/v3/projects/a982aebb43484fb28b46c65b41427bd9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:15.936192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:15.936701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:15.937348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:15.973641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:15.976781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:16.095621 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4090/8193] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:16.106462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b347-a84a-477e-8d22-c8565760592c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.109738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b347-a84a-477e-8d22-c8565760592c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.110555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b347-a84a-477e-8d22-c8565760592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.159555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5556b347-a84a-477e-8d22-c8565760592c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:16.161411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5556b347-a84a-477e-8d22-c8565760592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:16.187405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4104/8194] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:16.191932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.218277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353e955-f0bc-4a83-8592-5791845b3bd4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.227063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.228251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.230197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.230690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.231678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:25:16.232252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.234270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.258583 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4091/8195] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:25:16.262657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556b347-a84a-477e-8d22-c8565760592c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.275019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556b347-a84a-477e-8d22-c8565760592c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.285554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.286345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.287276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.288755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.289605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.294137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.344262 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4105/8196] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:25:16 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:16.348826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.368671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6510b5c-5d60-475c-ab2f-9f8ad649cc70 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.420244 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:16.507121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.509287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.509581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.509869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.510913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.514182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.585299 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.604529 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4092/8197] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:25:16 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:16.610064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca14b0-62af-4666-931a-0d4796193017 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.617737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.618860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.619706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.620196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.621616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.623562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.630660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:16.645110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.656545 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4106/8198] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:16.659620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90955ded-3ae4-49e2-851a-a44c7748bb83 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.677107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.678870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.680351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.680721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.681469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.683146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03933265-9d07-479a-b32d-6da8a673bb5a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.704756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.716478 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4093/8199] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:16.723774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd85f1-d130-416a-8118-5401882b8a2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:16.737610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:16.739628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.740325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.740894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] PATH_INFO: `/v3/projects/6714ba2dbb394f68a10cf23aef6a0c62/users/c18c15e909c64d56b4d8b9d7e61928af/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.767821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6714ba2dbb394f68a10cf23aef6a0c62, user_id=c18c15e909c64d56b4d8b9d7e61928af, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:16.772345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:16.800174 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4107/8200] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:16 2022] PUT /identity/v3/projects/6714ba2dbb394f68a10cf23aef6a0c62/users/c18c15e909c64d56b4d8b9d7e61928af/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:16.811595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565835-4aa4-445e-aff5-b906856e555d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:16.812459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565835-4aa4-445e-aff5-b906856e555d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:16.812741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565835-4aa4-445e-aff5-b906856e555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:16.877718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-88565835-4aa4-445e-aff5-b906856e555d None None] MFA Rules not processed for user `c18c15e909c64d56b4d8b9d7e61928af`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:16.879923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-88565835-4aa4-445e-aff5-b906856e555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:16.970974 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4094/8201] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:16.983256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:16.988830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:17.083069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de7927-e1ed-4c48-bb3e-aa49b449bd87 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:17.089641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:17.090483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:17.090710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:17.091037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:17.101402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:17.103030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:17.116484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4108/8202] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:18.122107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:18.123064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:18.123642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:18.185750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:18.189674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:18.327510 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4095/8203] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:19.122816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:19.124985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:19.147251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ada3e-80b5-461f-88ab-8d60ac441407 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:19.160609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:19.163945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:19.165677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:19.167250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:19.177331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:19.213242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:19.215352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d858-82b1-42df-afcc-6855faff19cf service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:19.238272 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4109/8204] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:28.296873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:29.221499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:37.993916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:38.136787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247780ec-3d98-4acf-b024-9d9ae753a5a9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:38.141912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:38.142837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:38.143136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:38.143422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] PATH_INFO: `/v3/users/c18c15e909c64d56b4d8b9d7e61928af` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:38.144744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18c15e909c64d56b4d8b9d7e61928af)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:38.146830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:38.222165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18c15e909c64d56b4d8b9d7e61928af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:38.235229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18c15e909c64d56b4d8b9d7e61928af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:38.254584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18c15e909c64d56b4d8b9d7e61928af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:38.256562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18c15e909c64d56b4d8b9d7e61928af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:38.258628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18c15e909c64d56b4d8b9d7e61928af'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:38.292120 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4096/8205] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:25:37 2022] DELETE /identity/v3/users/c18c15e909c64d56b4d8b9d7e61928af => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:38.297446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:38.299001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:38.299828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:38.323438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:38.325843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:38.420730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4110/8206] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:25:38.444950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:38.450944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:38.581446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e780e-64b4-49ed-95fa-dfb50a752ef1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:38.588141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:38.589050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:38.589207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:38.589409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:38.599723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:38.601381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc5827-b955-4690-9ac8-f40dc92deb77 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:38.616017 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4097/8207] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:39.337085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:39.339446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:39.363735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac8df-2f90-4371-bbf7-a4c8ea8ccffd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:39.376865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:39.377812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:39.378102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:39.378383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] PATH_INFO: `/v3/projects/6714ba2dbb394f68a10cf23aef6a0c62` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:39.381253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6714ba2dbb394f68a10cf23aef6a0c62)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:39.386815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:39.470164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6714ba2dbb394f68a10cf23aef6a0c62', 'request_id': 'req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:39.482017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6714ba2dbb394f68a10cf23aef6a0c62', 'request_id': 'req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:39.490157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6714ba2dbb394f68a10cf23aef6a0c62', 'request_id': 'req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:39.504113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] The token cache is being invalidate because project 6714ba2dbb394f68a10cf23aef6a0c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:25:39.504734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:39.505681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-56bfdf6f-aa92-4ba3-a329-d4a682bc1874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:25:39.507787 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4111/8208] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:25:39 2022] DELETE /identity/v3/projects/6714ba2dbb394f68a10cf23aef6a0c62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:39.513094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:39.514692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:39.515179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:39.552967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:39.554777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:39.596654 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:39.706499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:39.706935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:39.707311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:39.719649 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4098/8209] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:25:39.729098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:39.730615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:39.746093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:39.753457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4112/8210] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:39.758496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0fc73-6f02-42b1-9287-7f4049ab0707 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:39.764913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:39.765942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:39.766489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:39.766932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:39.768039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:25:39.768591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:39.770959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:39.798766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:39.827556 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4099/8211] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:25:39.831856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c8aa8-831c-4ff1-966d-522e2c4dd73d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:39.845389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:39.846492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:39.846849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:39.847199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:39.848127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:39.852973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:39.938080 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4113/8212] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:25:39 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:39.941933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:39.969135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcd58-4c28-49be-b083-144ab05a3eef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.137207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:40.141356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.141755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.142060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.142788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:40.154613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:40.204700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4100/8213] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:25:39 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:40.214036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:40.244666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb12-af8a-479c-8faf-9acd5bd0b160 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.254984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:40.256663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.257236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.257706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.258828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:40.270608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:40.289560 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4114/8214] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:40.290274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:40.310114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b874eb-3e56-41a7-aaf3-d6dc15942e2d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.325211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:40.326011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.326600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.326952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.327932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:40.329677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf3097-2010-452d-bdf5-181b7c7059ef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:40.358603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4101/8215] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:25:40.362409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:40.391594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf5975-ea3a-453b-8329-f9ae78ddeb2b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.406967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:40.408194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.408515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.408847 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] PATH_INFO: `/v3/projects/5f734d027051406d8cf743a5ac95b1ce/users/8dab83d255f1435497f834b621cc9cbe/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.455751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f734d027051406d8cf743a5ac95b1ce, user_id=8dab83d255f1435497f834b621cc9cbe, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:40.458581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:40.484978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4115/8216] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:40 2022] PUT /identity/v3/projects/5f734d027051406d8cf743a5ac95b1ce/users/8dab83d255f1435497f834b621cc9cbe/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:40.497461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.498721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.499258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.569348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] MFA Rules not processed for user `8dab83d255f1435497f834b621cc9cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:40.572748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:40.694280 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4102/8217] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:40.698222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:40.734073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:40.831723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b87c72-989a-46c1-abeb-20ec4a55b241 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.838028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:40.839144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:40.839435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:40.839885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:40.840636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:40.842608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:40.912899 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4116/8218] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:25:40 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:40.917911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:40.940761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ed89-1fca-45cb-8964-b5b9ce8bdf5d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:40.965310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:41.096807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.097710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.098104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.098484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.100142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.102862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.144234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4103/8219] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:25:40 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:25:41.147519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:41.172455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595455-b039-4436-b67f-a234dd12236b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:41.181561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.182549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.188464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.189326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.190450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.192415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.210533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4117/8220] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:41.216122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:41.231717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cd848-d047-448b-8594-3c707490c116 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:41.239112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.240670 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.241124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.241587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] PATH_INFO: `/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19/users/95ca4c48fcab40829eb943dc098c99f8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.277054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc236c7ae0be441ab48f85d5fb4aba19, user_id=95ca4c48fcab40829eb943dc098c99f8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.281583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.319719 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4104/8221] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:41 2022] PUT /identity/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19/users/95ca4c48fcab40829eb943dc098c99f8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:41.322578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:41.353769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0973-2acb-43b2-9bbd-2473d388d057 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:41.486104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.486823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.487115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.487445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.488313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.490996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e1ac4-170e-4fbc-952e-678f7cd5532c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.514176 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4118/8222] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:25:41.518445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:41.533742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23b53-9d46-4043-bf2f-a0027aa297f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:41.552815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.554497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.555843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.556250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] PATH_INFO: `/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19/users/95ca4c48fcab40829eb943dc098c99f8/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.561409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc236c7ae0be441ab48f85d5fb4aba19, user_id=95ca4c48fcab40829eb943dc098c99f8, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.565884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.601198 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4105/8223] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:25:41 2022] PUT /identity/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19/users/95ca4c48fcab40829eb943dc098c99f8/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:25:41.611444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.612035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.612561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.671835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] MFA Rules not processed for user `95ca4c48fcab40829eb943dc098c99f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:41.673554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:41.776167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4119/8224] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:25:41.788686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:41.791269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:41.956716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a753a-69e7-4629-ae61-564bfe275e76 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:41.962747 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:41.963958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:41.964445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:41.964927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:41.981927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:41.984065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d056-a610-4535-bea5-f2d4b6e25387 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:41.999521 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4106/8225] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:42.120031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:25:42.144782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243298ae-923e-4a5c-a1bf-05ef97602cb0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:25:42.158916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:25:42.159626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:42.159922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:42.160198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:42.218170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:42.347579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:25:42.349331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592dc5e-35ac-4d96-b425-1de07bb42838 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:25:42.372697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4120/8226] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:25:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:25:48.333985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:25:48.334851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:25:48.335324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:25:48.380299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:25:48.381604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:25:48.504724 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4107/8227] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:25:52.366074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=21 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:58.483614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:09.986007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:09.986545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:09.986545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:10.028169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:10.029715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:10.144394 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4121/8228] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:10.204393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:10.205966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:10.310056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499f7b-60b3-444c-ab1a-86cc56d27f74 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:10.316637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:10.317340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:10.317630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:10.317934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:10.328874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:10.330617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639715f-4b44-4a5e-b01b-4648edc4fd14 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:10.339516 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4108/8229] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:26:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:26:10.768925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:10.770597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:10.841725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013d2e-02e7-4334-8342-712e2b69d21c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:10.846865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:10.847873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:10.848227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:10.848613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] PATH_INFO: `/v3/users/8e07c099c85d41d8b115eaa0c947a3fd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:10.849903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e07c099c85d41d8b115eaa0c947a3fd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:10.852261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:10.909085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e07c099c85d41d8b115eaa0c947a3fd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:10.909688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e07c099c85d41d8b115eaa0c947a3fd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:10.917979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e07c099c85d41d8b115eaa0c947a3fd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:10.932006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e07c099c85d41d8b115eaa0c947a3fd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:10.939306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e07c099c85d41d8b115eaa0c947a3fd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:10.945789 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4122/8230] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:10 2022] DELETE /identity/v3/users/8e07c099c85d41d8b115eaa0c947a3fd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:10.950782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:10.951077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:10.951362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:10.969280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:10.970512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.034197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4109/8231] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:11.044304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.045865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.057134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:11.115543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e15658-c096-4d75-8c08-86949124dd5f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.121620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.122289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.122575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.122855 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.133242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.134948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da854adb-b124-4953-8e10-8b58f7b3675d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.146057 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4123/8232] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:11.331327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.333068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.356560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a409cf-5169-498f-b9b3-ec56e4f96651 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.371589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.372633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.372921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.373227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] PATH_INFO: `/v3/projects/62272cf7284344b4bb414585d2c6c040` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.374659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62272cf7284344b4bb414585d2c6c040)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.376780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.444646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62272cf7284344b4bb414585d2c6c040', 'request_id': 'req-77430d79-0a27-4b82-a676-973e70bf97a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:11.454793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62272cf7284344b4bb414585d2c6c040', 'request_id': 'req-77430d79-0a27-4b82-a676-973e70bf97a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:11.463331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62272cf7284344b4bb414585d2c6c040', 'request_id': 'req-77430d79-0a27-4b82-a676-973e70bf97a5'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:11.480172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] The token cache is being invalidate because project 62272cf7284344b4bb414585d2c6c040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:11.481054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:11.482008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-77430d79-0a27-4b82-a676-973e70bf97a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:11.484154 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4110/8233] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:11 2022] DELETE /identity/v3/projects/62272cf7284344b4bb414585d2c6c040 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:11.489548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.489843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.490124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.512703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:11.513939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.597536 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4124/8234] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:11.605165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.605459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.605740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.614776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:11.634962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:11.637599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.652461 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4111/8235] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:11.654232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.669027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b27811-0d27-4481-be59-04f9fb0800cb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.678931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.679635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.679922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.680202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.680977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:11.681288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.683036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82c498-be0b-432e-a591-2961fd4cba36 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.703332 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4125/8236] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:11.704329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.719755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683783a-34e3-4d26-b98a-724f119a5a0d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.741578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.742126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.742420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.742857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.744415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.750651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.753551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.756748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.761391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.766770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:11.768057 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:11.800096 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4112/8237] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:11 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:11.804712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.850811 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4126/8238] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:11.884072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e02c-293b-4b3e-8aa3-e40d444b9444 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.889679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.890370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.890842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.891122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.891811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.893788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.923555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4113/8239] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:11 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:11.924944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.936182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e0efe-2c7a-4809-be8d-5b5b9574b624 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.940806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.941500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.941820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.942098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.942854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.944533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.957792 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4127/8240] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:11.959309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:11.969641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26a71-1015-4fa7-8f80-c9f23c4218a0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:11.974395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:11.975096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:11.975380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:11.975671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:11.976393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:11.978062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b9f2-6805-4d3e-af86-ca26611158ef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:11.991626 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4114/8241] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:11.992881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.003459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693025-293c-4c47-9362-0c32d8265e42 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.008727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.009680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.009958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.010865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] PATH_INFO: `/v3/projects/9b601a1bbdb44245a1396050141652e8/users/c5d06f7af97649f58b1552b8700db835/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.030718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b601a1bbdb44245a1396050141652e8, user_id=c5d06f7af97649f58b1552b8700db835, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.037229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.060498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4128/8242] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:11 2022] PUT /identity/v3/projects/9b601a1bbdb44245a1396050141652e8/users/c5d06f7af97649f58b1552b8700db835/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:12.067364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.067655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.067930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.114812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] MFA Rules not processed for user `c5d06f7af97649f58b1552b8700db835`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:12.116141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:12.200051 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4115/8243] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:12.204511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.215770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:12.292702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39618846-621b-4099-bfd8-7934ed361161 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.297850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.299060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.299060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.299290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.299872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.301914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.340541 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4129/8244] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:12 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:12.344228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.356283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc604-6a2b-4b4f-bb57-021476aea577 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.415467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:12.436789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.438104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.438592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.439785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.440483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.442709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.472043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4116/8245] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:12 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:12.472910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.486261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e16-ef3e-4097-969e-06701c47a518 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.492092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.492862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.493916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.493916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.494628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.497210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.511097 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4130/8246] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:12.515948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.527859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaf51-df35-4a77-9530-77c5757be090 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.533851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.534765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.535051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.535398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] PATH_INFO: `/v3/projects/f2f021b2f8804f7da59108df70070856/users/705be6e059654a128416036115d80f84/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.554944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f021b2f8804f7da59108df70070856, user_id=705be6e059654a128416036115d80f84, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.557909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.575652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4117/8247] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:12 2022] PUT /identity/v3/projects/f2f021b2f8804f7da59108df70070856/users/705be6e059654a128416036115d80f84/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:12.579950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.591538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e2e48-4fab-41a8-b0df-0a545740090f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.681407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.682191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.683254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.683613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.684491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.686250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb367fc5-1e3f-47d0-bea5-b906ecf57818 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.705098 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4131/8248] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:12.709414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.726423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da305a4-0b14-4327-aaa6-773eef6d2295 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:12.732822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:12.733964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.734314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.734665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] PATH_INFO: `/v3/projects/f2f021b2f8804f7da59108df70070856/users/705be6e059654a128416036115d80f84/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.739998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f021b2f8804f7da59108df70070856, user_id=705be6e059654a128416036115d80f84, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:12.743201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:12.760122 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4118/8249] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:12 2022] PUT /identity/v3/projects/f2f021b2f8804f7da59108df70070856/users/705be6e059654a128416036115d80f84/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:12.774649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:12.775121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:12.775539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:12.853687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] MFA Rules not processed for user `705be6e059654a128416036115d80f84`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:12.856672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:12.981717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4132/8250] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:12.991428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:12.993839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:13.126671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688387b-3f08-430c-8318-1429f9d38587 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:13.133708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:13.134936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:13.135545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:13.135952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:13.150668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:13.152517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:13.166975 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4119/8251] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:13.299021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:13.305192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:13.315020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d08f5-1a32-4e9a-bcb0-75d7118cf27a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:13.323714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:13.325108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:13.325685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:13.326110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:13.405751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:13.407541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888339ab-b9dd-4a80-acda-a22fba7ee983 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:13.433323 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4133/8252] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:23.160460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=50,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.416069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=27 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.926439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:24.025709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71acc-3338-4af6-9f7d-7242671f9355 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:24.031087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:24.032113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.032570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.032942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] PATH_INFO: `/v3/users/c5d06f7af97649f58b1552b8700db835` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.034338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d06f7af97649f58b1552b8700db835)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:24.037344 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:24.096668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d06f7af97649f58b1552b8700db835'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.106859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d06f7af97649f58b1552b8700db835'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.124527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d06f7af97649f58b1552b8700db835'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.125307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d06f7af97649f58b1552b8700db835'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.126142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d06f7af97649f58b1552b8700db835'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.141421 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4120/8253] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:23 2022] DELETE /identity/v3/users/c5d06f7af97649f58b1552b8700db835 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:24.147108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.147403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.148072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.168364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:24.169650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:24.259947 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4134/8254] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:24.270272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:24.271713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:24.349216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf12ec-1caf-4a02-b83e-a8e1e44e14cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:24.355267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:24.356380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.356947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.357466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.373180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:24.376096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:24.397326 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4121/8255] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:24.763240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:24.766267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:24.782846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a786a-e8f8-447b-97d7-b6ff5e1d8184 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:24.789640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:24.790951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.791203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.791677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] PATH_INFO: `/v3/users/8dab83d255f1435497f834b621cc9cbe` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.793081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dab83d255f1435497f834b621cc9cbe)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:24.795066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:24.868681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dab83d255f1435497f834b621cc9cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.872178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dab83d255f1435497f834b621cc9cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.873073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:24.877220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:24.884591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dab83d255f1435497f834b621cc9cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.904127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa0264-043c-45db-83af-5ee1b04007b6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:24.912164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:24.913182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.913471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.914235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] PATH_INFO: `/v3/projects/9b601a1bbdb44245a1396050141652e8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.914853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dab83d255f1435497f834b621cc9cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.916462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b601a1bbdb44245a1396050141652e8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:24.918563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:24.926072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32e8f5ed-3dbd-45f7-8d3d-df714af58e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dab83d255f1435497f834b621cc9cbe'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.937456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4135/8256] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:24 2022] DELETE /identity/v3/users/8dab83d255f1435497f834b621cc9cbe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:24.939820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:24.941941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:24.942750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:24.942750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:24.972054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:24.973481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:24.981855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b601a1bbdb44245a1396050141652e8', 'request_id': 'req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.990917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b601a1bbdb44245a1396050141652e8', 'request_id': 'req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:24.997866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b601a1bbdb44245a1396050141652e8', 'request_id': 'req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.026407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] The token cache is being invalidate because project 9b601a1bbdb44245a1396050141652e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:25.027117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.028819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.031315 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4122/8257] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:24 2022] DELETE /identity/v3/projects/9b601a1bbdb44245a1396050141652e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:25.037290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:25.041186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:25.058761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4136/8258] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:25.068952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:25.071098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:25.094778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:25.161152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5918e-0c7e-4e1a-956d-6aa21466ccb0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:25.169384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:25.170755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:25.171245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:25.172083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] PATH_INFO: `/v3/users/705be6e059654a128416036115d80f84` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:25.172885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e373085-7e05-43b5-804c-7875740e4d7b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:25.174923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705be6e059654a128416036115d80f84)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:25.177384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:25.177984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:25.178161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:25.178482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:25.178791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:25.193016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:25.194796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:25.210411 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4137/8259] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:25.250677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705be6e059654a128416036115d80f84'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.265559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705be6e059654a128416036115d80f84'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.281555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705be6e059654a128416036115d80f84'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.282351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705be6e059654a128416036115d80f84'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.282981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705be6e059654a128416036115d80f84'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:25.302488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4123/8260] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:25 2022] DELETE /identity/v3/users/705be6e059654a128416036115d80f84 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:25.769056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:25.784119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7a3c-c052-4fe0-bb0a-38751897ad80 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:25.878435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:25.879683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:25.880310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:25.880858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] PATH_INFO: `/v3/projects/f2f021b2f8804f7da59108df70070856` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:25.883061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f021b2f8804f7da59108df70070856)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:25.885332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:25.909858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:25.912628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:25.927699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819ec7-09ef-40c1-b28e-4105f9435779 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:25.933283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:25.934506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:25.945605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:25.946555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] PATH_INFO: `/v3/projects/5f734d027051406d8cf743a5ac95b1ce` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:25.948916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f734d027051406d8cf743a5ac95b1ce)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:25.952295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:25.996861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:26.019800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f021b2f8804f7da59108df70070856', 'request_id': 'req-6247e8ce-3f38-4845-a871-edc48108dfd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.031251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f021b2f8804f7da59108df70070856', 'request_id': 'req-6247e8ce-3f38-4845-a871-edc48108dfd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.040275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f021b2f8804f7da59108df70070856', 'request_id': 'req-6247e8ce-3f38-4845-a871-edc48108dfd0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.046671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f734d027051406d8cf743a5ac95b1ce', 'request_id': 'req-5fe98db1-e194-4d33-b319-2842393b8a3e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.057708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] The token cache is being invalidate because project f2f021b2f8804f7da59108df70070856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:26.058134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.058333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f734d027051406d8cf743a5ac95b1ce', 'request_id': 'req-5fe98db1-e194-4d33-b319-2842393b8a3e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.058929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6247e8ce-3f38-4845-a871-edc48108dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.065373 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4138/8261] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:25 2022] DELETE /identity/v3/projects/f2f021b2f8804f7da59108df70070856 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:26.067573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f734d027051406d8cf743a5ac95b1ce', 'request_id': 'req-5fe98db1-e194-4d33-b319-2842393b8a3e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.069631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21885-a4fc-4ae6-b874-d39d3f15ffd7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.072703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21885-a4fc-4ae6-b874-d39d3f15ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.073096 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21885-a4fc-4ae6-b874-d39d3f15ffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.084647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] The token cache is being invalidate because project 5f734d027051406d8cf743a5ac95b1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:26.085523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.086509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.088692 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4124/8262] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:25 2022] DELETE /identity/v3/projects/5f734d027051406d8cf743a5ac95b1ce => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:26.094639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.096696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:26.136627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-42e21885-a4fc-4ae6-b874-d39d3f15ffd7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:26.138473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-42e21885-a4fc-4ae6-b874-d39d3f15ffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:26.180392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe98db1-e194-4d33-b319-2842393b8a3e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.186363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.187706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.188512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.189110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] PATH_INFO: `/v3/users/95ca4c48fcab40829eb943dc098c99f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.190695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ca4c48fcab40829eb943dc098c99f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.193027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.193181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:26.226029 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4139/8263] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:26.227495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.227824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.228199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.250055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:26.251455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:26.261167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ca4c48fcab40829eb943dc098c99f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.261814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4140/8264] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:26.269655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.270641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ca4c48fcab40829eb943dc098c99f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.283300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942a2e4-8c40-4da2-87cd-f7557cc9793f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.287079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ca4c48fcab40829eb943dc098c99f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.287937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ca4c48fcab40829eb943dc098c99f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.288680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ca4c48fcab40829eb943dc098c99f8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:26.289894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.290960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.291785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.292152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.293244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:26.293747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.296337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.307335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4125/8265] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:26 2022] DELETE /identity/v3/users/95ca4c48fcab40829eb943dc098c99f8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:26.323366 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4141/8266] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:26.332597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.334107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:26.382620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:26.461643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e9db-f6eb-459c-8a9c-1c0a1241453c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.469601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.470348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.470638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.471169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.472324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.473905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.512215 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4126/8267] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:26 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:26.515694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.537843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2990af-c602-4259-960a-cde4becf4240 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.645257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.645994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.646281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.646564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.647494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.649772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.681266 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4142/8268] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:26 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:26.687811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.705504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdad33-9b5b-48e7-8109-64e90b9500a3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.712358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.713849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.714387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.714880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.715804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.718409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.750799 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4127/8269] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:26.756107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.772917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6603d-6a30-4190-ac96-3001beec0455 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.773812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.775879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:26.789092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.790356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.790356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.790595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.791127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.793467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.809969 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4143/8270] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:26.816049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c164ae-d9b5-49d8-835b-edcba820d37b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.827162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:26.845701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.849017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.850772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.851006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b3d0-876f-488f-b7cc-81ee2c575404 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:26.851450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] PATH_INFO: `/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.854789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc236c7ae0be441ab48f85d5fb4aba19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.861585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.864868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:26.865802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.866093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.866395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] PATH_INFO: `/v3/projects/a75e718d6b4742d8b04dc9012467cc53/users/3681c7f9c6384d63b76beea6c820da9e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.889852 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75e718d6b4742d8b04dc9012467cc53, user_id=3681c7f9c6384d63b76beea6c820da9e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:26.893303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f684cea-4a11-47a8-a352-f006d3b9fd14 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:26.931943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4144/8271] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:26 2022] PUT /identity/v3/projects/a75e718d6b4742d8b04dc9012467cc53/users/3681c7f9c6384d63b76beea6c820da9e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:26.944733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:26.946401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:26.946699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:26.991187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc236c7ae0be441ab48f85d5fb4aba19', 'request_id': 'req-9a270362-142b-4991-a73e-e8ae60ebc8ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:27.014341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc236c7ae0be441ab48f85d5fb4aba19', 'request_id': 'req-9a270362-142b-4991-a73e-e8ae60ebc8ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:27.029947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc236c7ae0be441ab48f85d5fb4aba19', 'request_id': 'req-9a270362-142b-4991-a73e-e8ae60ebc8ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:27.043511 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] MFA Rules not processed for user `3681c7f9c6384d63b76beea6c820da9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:27.044796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:27.046393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] The token cache is being invalidate because project bc236c7ae0be441ab48f85d5fb4aba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:27.051559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:27.053057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9a270362-142b-4991-a73e-e8ae60ebc8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:27.057968 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4128/8272] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:26 2022] DELETE /identity/v3/projects/bc236c7ae0be441ab48f85d5fb4aba19 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:27.075303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa5ca-8165-4680-a482-e5b92f0154ba None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.075878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa5ca-8165-4680-a482-e5b92f0154ba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.076383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa5ca-8165-4680-a482-e5b92f0154ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.104140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e96fa5ca-8165-4680-a482-e5b92f0154ba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:27.120877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e96fa5ca-8165-4680-a482-e5b92f0154ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:27.177994 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4145/8273] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:27.181617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.184571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:27.225958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:27.263029 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4129/8274] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:27.361801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.362642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.362642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.381535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176b3b-18b3-42f7-8188-2fa3711f8e0d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.386238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.387021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.387507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.387762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:27.387917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.389145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:27.389446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.391471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.402169 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4130/8275] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:27.403489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.422461 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4146/8276] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:27.423131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c2d84-cf75-45b0-890d-3f689f698d33 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.428757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.446725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:27.519589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.520604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.521121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.521499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.522828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:27.523240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.525333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.525556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9c79-bb9e-45b3-a168-b40f84b7931e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.535543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.536261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.537584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.537877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.538601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.540690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.544543 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4131/8277] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:27.548157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.561555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68a537-fd6f-4e6e-9cc0-15ff084fe272 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.574340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.575040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.575333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.575608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.582273 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4147/8278] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:27.582482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.585645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.588358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.600613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11e08-9d5e-4354-9941-a92ec99eab4f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.606726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.607429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.607826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.608188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.609052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.610967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.624704 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4148/8279] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:27.629014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.629356 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4132/8280] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:27.633253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.640980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a4f39-7891-47c6-af6b-7fa3d0f7d215 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.715504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002068c4-a753-4d2a-9962-a02d7797bc3b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.720077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.721238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.721703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.721923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.722657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.723022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.723314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.723449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] PATH_INFO: `/v3/projects/9fe57ff414e0444083265712456b401d/users/e36e270e3fef4175a95f15932f10dee6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.724012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.726758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.761761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe57ff414e0444083265712456b401d, user_id=e36e270e3fef4175a95f15932f10dee6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.768174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.784497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4133/8281] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:27 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:27.791336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:27.793116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.798665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4149/8282] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:27 2022] PUT /identity/v3/projects/9fe57ff414e0444083265712456b401d/users/e36e270e3fef4175a95f15932f10dee6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:27.808506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.808752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378f6b-cff1-4594-bb15-55f0f5b2cc23 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.903566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c40e9-0100-482f-a470-df1044a2bbe0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.905399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.906716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.906961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.910211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.912911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.915814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.916569 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.916859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.917116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.917858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.918545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.919778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.935376 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4150/8283] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:27.940665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.957272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5a28-7e88-4ba7-84c8-e962b61111eb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.958971 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4134/8284] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:27.961060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:27.966823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:27.974883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:27.975176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:27.975609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] PATH_INFO: `/v3/projects/9fe57ff414e0444083265712456b401d/users/e36e270e3fef4175a95f15932f10dee6/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:27.978791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe57ff414e0444083265712456b401d, user_id=e36e270e3fef4175a95f15932f10dee6, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:27.983317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a57bb-1048-4b06-a40c-3cfaa236c0ee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:27.990250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99402e3-facb-44ad-8a38-e8f72db82455 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:27.999557 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4151/8285] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:27 2022] PUT /identity/v3/projects/9fe57ff414e0444083265712456b401d/users/e36e270e3fef4175a95f15932f10dee6/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:28.012683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.013327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.013868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.024995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:28.079466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] MFA Rules not processed for user `e36e270e3fef4175a95f15932f10dee6`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:28.084383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:28.130973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.131765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.132123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.133702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.134657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.156600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.180122 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4152/8286] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:28.184271 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4135/8287] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:28.190566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.192136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.200458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:28.211712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8feec3-d281-4a78-9534-1c542155026d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.218188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.220311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.220951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.221629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] PATH_INFO: `/v3/projects/dd8a3a08e1194a5986f7a1547de1dfd3/users/c8c7af72140d4ab0a3ab8f59bc6e9e30/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.256825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8a3a08e1194a5986f7a1547de1dfd3, user_id=c8c7af72140d4ab0a3ab8f59bc6e9e30, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.261533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43cbe3-b6b0-4960-a298-566d552a056b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.279242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ce113-b10d-40e7-9645-78106e68c0f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.286769 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4153/8288] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:28 2022] PUT /identity/v3/projects/dd8a3a08e1194a5986f7a1547de1dfd3/users/c8c7af72140d4ab0a3ab8f59bc6e9e30/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:28.297917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.299485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.299923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.341165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] MFA Rules not processed for user `c8c7af72140d4ab0a3ab8f59bc6e9e30`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:28.344782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:28.386241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.388374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.388863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.390477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.402587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:28.459550 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4154/8289] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:28.464270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.478022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.479644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.496902 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4136/8290] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:28.552055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab67dc3-a7d1-4c1d-bd32-23d744bd1faa None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.558948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.560251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.560925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.561548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.563194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.566314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.600842 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4155/8291] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:28 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:28.604629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.616308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ca44-cfef-4056-8126-08ae1a8e0a42 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.639523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:28.692957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.693796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.694143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.694512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.695283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.697579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.739479 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4137/8292] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:28 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:28.740123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.752834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a836-a58a-4f07-b7d7-33b4f5b08928 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.757827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.758663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.759056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.759468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.760335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.762084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.779205 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4156/8293] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:28.783459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.796529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54155b-4362-4b48-a2fb-4da6940f5d94 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:28.825446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:28.835983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:28.838395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:28.838560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] PATH_INFO: `/v3/projects/d907336bc2f74fa2b15f375da137308f/users/6ea15cc49ddf46978436cc9a04a8a203/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:28.904633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d907336bc2f74fa2b15f375da137308f, user_id=6ea15cc49ddf46978436cc9a04a8a203, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:28.919913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:28.952517 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4138/8294] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:28 2022] PUT /identity/v3/projects/d907336bc2f74fa2b15f375da137308f/users/6ea15cc49ddf46978436cc9a04a8a203/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:28.956021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:28.967915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b77c-7d61-4f25-950a-5cd1be47ab17 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.047184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.048010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.048340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.048614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.049349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.051076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e563a8-30bd-4307-a6b9-a6082c44f048 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.062305 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4157/8295] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:29.067021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:29.079126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44f91-a3f5-40a1-8e96-3b3dc4a9ab7c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.084396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.085966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.086247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.086525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] PATH_INFO: `/v3/projects/d907336bc2f74fa2b15f375da137308f/users/6ea15cc49ddf46978436cc9a04a8a203/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.088665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d907336bc2f74fa2b15f375da137308f, user_id=6ea15cc49ddf46978436cc9a04a8a203, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.091382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.108517 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4139/8296] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:29 2022] PUT /identity/v3/projects/d907336bc2f74fa2b15f375da137308f/users/6ea15cc49ddf46978436cc9a04a8a203/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:29.116540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.116839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.117129 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.157624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] MFA Rules not processed for user `6ea15cc49ddf46978436cc9a04a8a203`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:29.158893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.216808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:29.219228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.221751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:29.291600 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4158/8297] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:29.292694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:29.297199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.342398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c300d-0177-49ac-a58a-044333027436 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.348123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.348827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.349117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.349391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.351204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.366233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.368194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.379056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3c86-6b5d-4fbe-b554-a8aa7402db0e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.382228 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4140/8298] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:29.384819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.385782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.386087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.386367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] PATH_INFO: `/v3/users/cb028384e2374b3da59716aa35a8e428` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.387618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb028384e2374b3da59716aa35a8e428)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.389522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:29.390061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.447731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb028384e2374b3da59716aa35a8e428'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:29.448729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb028384e2374b3da59716aa35a8e428'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:29.460003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb028384e2374b3da59716aa35a8e428'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:29.467814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d5189-1b16-457e-8aa4-44e11b03703c service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.475259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.476004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.476401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.476797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.478833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.479377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb028384e2374b3da59716aa35a8e428'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:29.490841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b22ed600-ce6e-48aa-9b5a-b89a50b42d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb028384e2374b3da59716aa35a8e428'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:29.497173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.498844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.508701 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4159/8299] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:29 2022] DELETE /identity/v3/users/cb028384e2374b3da59716aa35a8e428 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:29.513313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.513610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.513894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.516123 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4141/8300] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:29.533567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:29.535090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.597156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:29.616633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4160/8301] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:29.627992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:29.629794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:29.668401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:29.745915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04755f-4e95-4194-ba52-73d515250b40 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:29.821555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:29.822221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:29.822501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:29.825090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:29.837629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:29.839151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:29.849846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4142/8302] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:30.031727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.033282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.048491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaca79-6faa-4092-b1d1-c9e5e69d3844 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.055092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.056075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.056365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.056990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] PATH_INFO: `/v3/users/c8c7af72140d4ab0a3ab8f59bc6e9e30` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.059001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c7af72140d4ab0a3ab8f59bc6e9e30)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.061114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.103116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.104652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.138901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f723-5cc4-4e6f-a100-1e5fe6696fac service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.152173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.153698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.154572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.155192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] PATH_INFO: `/v3/projects/3db1c393cd3c420b8db400b33a84b2c1` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.159234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db1c393cd3c420b8db400b33a84b2c1)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.161598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.167094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c7af72140d4ab0a3ab8f59bc6e9e30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.168605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c7af72140d4ab0a3ab8f59bc6e9e30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.184002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c7af72140d4ab0a3ab8f59bc6e9e30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.203641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c7af72140d4ab0a3ab8f59bc6e9e30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.213098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-27ede163-e272-4e0d-8c8b-a811b9c7cdb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c7af72140d4ab0a3ab8f59bc6e9e30'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.224162 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4161/8303] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:30 2022] DELETE /identity/v3/users/c8c7af72140d4ab0a3ab8f59bc6e9e30 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:30.228909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.229201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.230159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.238317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db1c393cd3c420b8db400b33a84b2c1', 'request_id': 'req-fce06115-1e57-4a20-89e6-e7f1c7e23b20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.250160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db1c393cd3c420b8db400b33a84b2c1', 'request_id': 'req-fce06115-1e57-4a20-89e6-e7f1c7e23b20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.255104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:30.256684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.257930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db1c393cd3c420b8db400b33a84b2c1', 'request_id': 'req-fce06115-1e57-4a20-89e6-e7f1c7e23b20'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.273329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] The token cache is being invalidate because project 3db1c393cd3c420b8db400b33a84b2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:30.273865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.274642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fce06115-1e57-4a20-89e6-e7f1c7e23b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.279197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4143/8304] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:30 2022] DELETE /identity/v3/projects/3db1c393cd3c420b8db400b33a84b2c1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:30.284288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4be8-ef3e-40a5-8877-086b8e2795ae None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.284721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4be8-ef3e-40a5-8877-086b8e2795ae None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.285340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4be8-ef3e-40a5-8877-086b8e2795ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.313674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cfec4be8-ef3e-40a5-8877-086b8e2795ae None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:30.315851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cfec4be8-ef3e-40a5-8877-086b8e2795ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.355067 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4162/8305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:30.366698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.368247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.383834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:30.400808 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4144/8306] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:30.408567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.409018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.409308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.428148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:30.429414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.437897 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4145/8307] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:30.442091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.442388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1bdc-ccb6-4e2e-b3da-3889dfe51f05 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.446115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.446789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.447062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.447337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.452405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951bbf-5ba1-4bc9-95d1-91656c311670 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.457342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.457480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.457988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.458277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.458562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.458791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.459289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:30.459605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.461263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.468498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4163/8308] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:30.474681 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4146/8309] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:26:30.479087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.484546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:30.491599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234388-9433-4393-b3dc-1d1e151c30ed service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.498115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.498932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.499220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.499495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.500291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.502192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.531010 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4164/8310] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:30.535420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.546840 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522df4-c5b3-4dab-ab0b-af4632d80950 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.607452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.608047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.608337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.608667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.609559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.611288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.638462 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4147/8311] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:30.642759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.654904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595c8b8-352a-4bd8-a06b-d395c1e68505 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.660369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.661311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.661725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.662008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.662807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.664634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.676248 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4165/8312] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:30.680440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.691953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975278a1-836a-457f-9a7f-c5ecf771bfa5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.697682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.698367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.698687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.699287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.700078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.701818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.712775 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4148/8313] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:30.717114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.728011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c7a1-316d-496d-91e8-fafea888e8cf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.734427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.735350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.735641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.735919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] PATH_INFO: `/v3/projects/6e0672b10e3e477e8ac5b780ff13c454/users/00a7c2c53ddd47f384c69f233f3611c7/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.754293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0672b10e3e477e8ac5b780ff13c454, user_id=00a7c2c53ddd47f384c69f233f3611c7, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.757066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991e29c-71ce-446a-a5e9-74c4c4d137a0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.766834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.768999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.772488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4166/8314] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:30 2022] PUT /identity/v3/projects/6e0672b10e3e477e8ac5b780ff13c454/users/00a7c2c53ddd47f384c69f233f3611c7/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:30.783619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.783880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.784755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.797447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536359-8717-4c4d-9acf-c9141d461a0c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.818122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] MFA Rules not processed for user `00a7c2c53ddd47f384c69f233f3611c7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:30.819404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:30.878504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:30.879302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:30.879585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:30.879861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] PATH_INFO: `/v3/projects/dd8a3a08e1194a5986f7a1547de1dfd3` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:30.881178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8a3a08e1194a5986f7a1547de1dfd3)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:30.883234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:30.891259 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4167/8315] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:30.902032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.938756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8a3a08e1194a5986f7a1547de1dfd3', 'request_id': 'req-ce4b783d-c84e-4944-8dfb-3a00c89d847b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.940835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:30.949453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8a3a08e1194a5986f7a1547de1dfd3', 'request_id': 'req-ce4b783d-c84e-4944-8dfb-3a00c89d847b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.956662 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8a3a08e1194a5986f7a1547de1dfd3', 'request_id': 'req-ce4b783d-c84e-4944-8dfb-3a00c89d847b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.964389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde369d3-8c9f-4c08-bff9-7402192c456c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:30.968876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] The token cache is being invalidate because project dd8a3a08e1194a5986f7a1547de1dfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:30.969171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.969907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:30.971948 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4149/8316] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:30 2022] DELETE /identity/v3/projects/dd8a3a08e1194a5986f7a1547de1dfd3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:30.975960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:30.977603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.016233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.016950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.017240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.017654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.019694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.025395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:31.045465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b783d-c84e-4944-8dfb-3a00c89d847b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.050719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.052094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.052379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.052742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] PATH_INFO: `/v3/users/6ea15cc49ddf46978436cc9a04a8a203` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.053936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea15cc49ddf46978436cc9a04a8a203)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.055940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.083429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.085215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.096017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4168/8317] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:31.110991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.113770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.116240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea15cc49ddf46978436cc9a04a8a203'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.125060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea15cc49ddf46978436cc9a04a8a203'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.128321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ecaf-1dad-47b2-8e06-9b5a3125d485 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.134804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.135669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.135960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.136235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] PATH_INFO: `/v3/users/00a7c2c53ddd47f384c69f233f3611c7` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.137502 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a7c2c53ddd47f384c69f233f3611c7)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.139442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.142328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea15cc49ddf46978436cc9a04a8a203'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.143250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea15cc49ddf46978436cc9a04a8a203'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.144014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-23e399a5-7db2-4079-9ac1-88fac3a6ff4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea15cc49ddf46978436cc9a04a8a203'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.157916 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4150/8318] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:30 2022] DELETE /identity/v3/users/6ea15cc49ddf46978436cc9a04a8a203 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:31.195021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a7c2c53ddd47f384c69f233f3611c7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.196967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a7c2c53ddd47f384c69f233f3611c7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.207160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a7c2c53ddd47f384c69f233f3611c7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.239071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a7c2c53ddd47f384c69f233f3611c7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.252363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a7c2c53ddd47f384c69f233f3611c7'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.273512 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4169/8319] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:31 2022] DELETE /identity/v3/users/00a7c2c53ddd47f384c69f233f3611c7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:31.278408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909b00-e151-4305-8614-53b0401e2154 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.278724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909b00-e151-4305-8614-53b0401e2154 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.279032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909b00-e151-4305-8614-53b0401e2154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.306981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-47909b00-e151-4305-8614-53b0401e2154 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:31.308717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47909b00-e151-4305-8614-53b0401e2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.380143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:31.399530 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4151/8320] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:31.407832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.409723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.487104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47909b00-e151-4305-8614-53b0401e2154 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.488631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-47909b00-e151-4305-8614-53b0401e2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.502982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c772b-1d51-4235-8d41-b090f19ba9e1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.507989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.508898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.509212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.509491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.511418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47909b00-e151-4305-8614-53b0401e2154 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.524274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.525384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.525633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.525987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] PATH_INFO: `/v3/projects/d907336bc2f74fa2b15f375da137308f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.529383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d907336bc2f74fa2b15f375da137308f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.532477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.536572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.538688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3640f3d-ee13-4b6b-affd-a642f9aa5591 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.553783 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4170/8321] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:31.597936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd907336bc2f74fa2b15f375da137308f', 'request_id': 'req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.607401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd907336bc2f74fa2b15f375da137308f', 'request_id': 'req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.614838 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd907336bc2f74fa2b15f375da137308f', 'request_id': 'req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.627615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] The token cache is being invalidate because project d907336bc2f74fa2b15f375da137308f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:31.627950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.628640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-ed42bd2d-7b7e-4e2e-a8b9-7bccfec4b812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:31.632941 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4152/8322] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:31 2022] DELETE /identity/v3/projects/d907336bc2f74fa2b15f375da137308f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:31.635661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.635952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.636588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.668509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:31.668509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.680644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:31.744085 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4171/8323] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:31.753520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.753793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.754077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.775982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:31.775982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:31.784813 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4153/8324] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:31.789550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.802957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955cc6-86f6-498a-a501-8892d36e0591 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.813201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.814739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.820539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.820539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.820539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:31.820539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.820539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.834979 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4172/8325] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:31.842287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.851928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218fb84-dd80-422e-bb86-666cecc34abc None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.863095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:31.864517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:31.864517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:31.864887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:31.865500 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:31.867561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:31.908949 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4154/8326] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:31 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:31.910723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.928707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ebfb-141a-4cc7-90cf-eb31107fac25 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:31.970403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:31.973823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.026015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.027375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.027887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.028467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.029197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.032937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.060226 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4173/8327] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:31 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:32.064383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.078919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0382-e60f-480d-9596-6b06bb629c0e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.082642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e694484-f5da-4113-a7c2-ad2af9df8fc7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.084683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.085560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.086270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.086605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.087496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.088909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.089552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.089869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.090226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.090508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] PATH_INFO: `/v3/projects/6e0672b10e3e477e8ac5b780ff13c454` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.091897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0672b10e3e477e8ac5b780ff13c454)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.094613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.104790 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4174/8328] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:32.109433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.121440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d38d9-d661-4c41-814e-fa64cef8ef71 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.127411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.128386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.128735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.129705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.130729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.132394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.147453 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4175/8329] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:32.151972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.167189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b14c6-749c-432c-8b74-338376046595 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.168806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0672b10e3e477e8ac5b780ff13c454', 'request_id': 'req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:32.173671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:32.180179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0672b10e3e477e8ac5b780ff13c454', 'request_id': 'req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:32.190333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0672b10e3e477e8ac5b780ff13c454', 'request_id': 'req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:32.209393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] The token cache is being invalidate because project 6e0672b10e3e477e8ac5b780ff13c454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:32.209864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:32.212708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-35bc93bd-243d-49b8-a5aa-e6de1bd12b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:32.215265 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4155/8330] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:31 2022] DELETE /identity/v3/projects/6e0672b10e3e477e8ac5b780ff13c454 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:32.221603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffc620-3388-43a7-9aa3-e1fd39b469bc None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.221976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffc620-3388-43a7-9aa3-e1fd39b469bc None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.222240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffc620-3388-43a7-9aa3-e1fd39b469bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.238671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.238671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.238671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.238671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] PATH_INFO: `/v3/projects/9019ed89d8a14c938f1d77f72f7e48c6/users/a838f3db6c844e3b97f5813e5bfefc5d/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.259666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3dffc620-3388-43a7-9aa3-e1fd39b469bc None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:32.266897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9019ed89d8a14c938f1d77f72f7e48c6, user_id=a838f3db6c844e3b97f5813e5bfefc5d, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.272781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.276976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3dffc620-3388-43a7-9aa3-e1fd39b469bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.289133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:32.302660 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4176/8331] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:32 2022] PUT /identity/v3/projects/9019ed89d8a14c938f1d77f72f7e48c6/users/a838f3db6c844e3b97f5813e5bfefc5d/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:32.303906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.314281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.406181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67aa5b-ec7f-4000-ba77-713e95d3e681 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.413735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.414551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.427247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.427635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.434050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.493688 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4156/8332] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:32.498851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.499406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.499610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.549012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] MFA Rules not processed for user `a838f3db6c844e3b97f5813e5bfefc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:32.550481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.574512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.576619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845b4bd-30a8-4328-8317-768a61f08e63 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.600910 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4177/8333] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:32.602462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.602757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.603040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.635951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:32.637399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.649070 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4178/8334] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:32.650077 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4157/8335] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:32.657581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.658005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.659709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:32.677610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a1759-c09b-45bf-9082-df12693988e5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.680380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78bbf-fc44-4e81-b108-b700c2c92f56 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.684270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.685047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.685338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.685827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.686873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:32.687449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.689479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.689964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.692042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.693824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.694764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.695146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.697704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.736414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4179/8336] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:32.736934 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4158/8337] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:32.745347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.748865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.765179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e5809-ff1d-44a7-928f-ac02a2713b8b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.880675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:32.886554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.887173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.887461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.887747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.893268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.895887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.905517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bb89-0752-4362-8514-42be0453bbba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:32.913663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:32.914599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:32.914885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:32.915331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:32.916029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:32.918206 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:32.942480 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4180/8338] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:32.946727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.955804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4159/8339] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:32.957311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:32.969515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:32.971630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01985d4-24cc-42fa-b894-a140caf4f6f7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.044912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee6034-3af3-4115-a176-9361401d7d8a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.052589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.056000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.056499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.056928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.057727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.061212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.072725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.074207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.074854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.075141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.075997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.079250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.093973 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4181/8340] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:32 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:33.098281 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.108628 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4160/8341] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:33.112696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8b307-7d2b-4513-bd00-79f22aae78ce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.114051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.119618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.120771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.121260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.122092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.123648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.125887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.129634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db6a-dab9-473d-8a66-81598b9a5c8d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.141027 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4182/8342] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:33.144862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.153417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.155493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.157165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.157801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] PATH_INFO: `/v3/projects/b14a6ad81e544de89759183e4aa5dfad/users/05e5f3a89969498787ca384dbe6b624f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.163775 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d525f2-2ad1-4186-af08-f131105300f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.172630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.173345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.173841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.173989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.176006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.178595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.195201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14a6ad81e544de89759183e4aa5dfad, user_id=05e5f3a89969498787ca384dbe6b624f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.200507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.201699 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4183/8343] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:33.206816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.221891 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4161/8344] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:33 2022] PUT /identity/v3/projects/b14a6ad81e544de89759183e4aa5dfad/users/05e5f3a89969498787ca384dbe6b624f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:33.226413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.229245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6719-7b14-4849-8115-a2a0206d3feb admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.301980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.303194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.303615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.303907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] PATH_INFO: `/v3/projects/bb1a3e4544a24851936752bd2cf77d2d/users/3a2088dc09c24456803afbdb9a6f5884/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.327691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1a3e4544a24851936752bd2cf77d2d, user_id=3a2088dc09c24456803afbdb9a6f5884, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.329657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc737-3b6c-4c1d-9d5a-f1d45c0a1bb6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.330590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d090d3c-d528-43b0-8913-1bd6f461db8c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.335650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.336529 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.336919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.337171 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.338233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.340774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.348668 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4184/8345] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:33 2022] PUT /identity/v3/projects/bb1a3e4544a24851936752bd2cf77d2d/users/3a2088dc09c24456803afbdb9a6f5884/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:33.359192 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4162/8346] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:33.361173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.361462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.361743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.364149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.378380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b2a9-cc9e-4318-8bb4-9f8c55fa5f2d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.398706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] MFA Rules not processed for user `3a2088dc09c24456803afbdb9a6f5884`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:33.400819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:33.438711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:33.459263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.460627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.460928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.461345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] PATH_INFO: `/v3/projects/b14a6ad81e544de89759183e4aa5dfad/users/05e5f3a89969498787ca384dbe6b624f/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.464985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14a6ad81e544de89759183e4aa5dfad, user_id=05e5f3a89969498787ca384dbe6b624f, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.467811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f5095-dc42-4c55-818c-e8bd3b95290f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.481827 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4163/8347] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:33 2022] PUT /identity/v3/projects/b14a6ad81e544de89759183e4aa5dfad/users/05e5f3a89969498787ca384dbe6b624f/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:33.489364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:33.494519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.495083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.495083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.507835 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4185/8348] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:33.519389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.521121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:33.532671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] MFA Rules not processed for user `05e5f3a89969498787ca384dbe6b624f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:33.534228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:33.594593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588eb4d-e762-4478-a0a6-fcae89b670c4 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.610888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4164/8349] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:33.625406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.653070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.653853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.653997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.654245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.690628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df5536-9f1c-41d9-ab42-ae3f9046e845 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.694701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.695507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.695881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.696199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.708944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.710400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.719402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.720290 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4165/8350] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:33.722529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9468ce0-6844-4a6a-99f0-d20e7d10c60a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.732713 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4186/8351] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:33.794996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:33.874872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b1012-1794-4d3d-b028-03d0b36aa1f5 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:33.880180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:33.881337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:33.881509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:33.881640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] PATH_INFO: `/v3/users/a838f3db6c844e3b97f5813e5bfefc5d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:33.882995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a838f3db6c844e3b97f5813e5bfefc5d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:33.885048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:33.901554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:33.949620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a838f3db6c844e3b97f5813e5bfefc5d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:33.959395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a838f3db6c844e3b97f5813e5bfefc5d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:33.977202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a838f3db6c844e3b97f5813e5bfefc5d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:33.978126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a838f3db6c844e3b97f5813e5bfefc5d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:33.978759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a838f3db6c844e3b97f5813e5bfefc5d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:33.996085 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4166/8352] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:33 2022] DELETE /identity/v3/users/a838f3db6c844e3b97f5813e5bfefc5d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:34.000968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:34.001839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:34.002127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:34.031901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:34.035675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:34.160071 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4187/8353] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:34.170026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:34.171858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:34.300287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb413d4-51e6-47c0-83eb-d056271cb2ad admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:34.305470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:34.306187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:34.306517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:34.306775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:34.320951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:34.324275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:34.338080 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4167/8354] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:34.847930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:34.855743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:34.873175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=100 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:34.880127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad58b2-c6ec-4810-ab7d-a94e462e3dd3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:34.889759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:34.890803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:34.891117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:34.891507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] PATH_INFO: `/v3/projects/9019ed89d8a14c938f1d77f72f7e48c6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:34.893271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9019ed89d8a14c938f1d77f72f7e48c6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:34.896379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:34.978358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9019ed89d8a14c938f1d77f72f7e48c6', 'request_id': 'req-cd540870-6498-4366-b9d7-ab4acc701751'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:34.992382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9019ed89d8a14c938f1d77f72f7e48c6', 'request_id': 'req-cd540870-6498-4366-b9d7-ab4acc701751'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.006135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9019ed89d8a14c938f1d77f72f7e48c6', 'request_id': 'req-cd540870-6498-4366-b9d7-ab4acc701751'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.033721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] The token cache is being invalidate because project 9019ed89d8a14c938f1d77f72f7e48c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:35.034021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.035842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.040624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4188/8355] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:34 2022] DELETE /identity/v3/projects/9019ed89d8a14c938f1d77f72f7e48c6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:35.043301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:35.056879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393502d-a35d-47b1-9135-dadcb3b24f24 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:35.153850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:35.155785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:35.156081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:35.156525 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] PATH_INFO: `/v3/users/05e5f3a89969498787ca384dbe6b624f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:35.157778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e5f3a89969498787ca384dbe6b624f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:35.160013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:35.222600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:35.255953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e5f3a89969498787ca384dbe6b624f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.288774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e5f3a89969498787ca384dbe6b624f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.313694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e5f3a89969498787ca384dbe6b624f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.315008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e5f3a89969498787ca384dbe6b624f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.315517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-fdb3455b-c302-45ee-9bdc-5c08e43ef1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e5f3a89969498787ca384dbe6b624f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:35.341637 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4168/8356] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:35 2022] DELETE /identity/v3/users/05e5f3a89969498787ca384dbe6b624f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:35.775155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:35.776975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:35.795404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd540870-6498-4366-b9d7-ab4acc701751 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:35.911891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:35.913804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:35.916893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:35.917364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] PATH_INFO: `/v3/projects/b14a6ad81e544de89759183e4aa5dfad` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:35.919233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14a6ad81e544de89759183e4aa5dfad)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:35.928141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.028655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14a6ad81e544de89759183e4aa5dfad', 'request_id': 'req-32460414-57e6-4a42-b253-ce66e98352f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:36.041874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14a6ad81e544de89759183e4aa5dfad', 'request_id': 'req-32460414-57e6-4a42-b253-ce66e98352f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:36.053659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14a6ad81e544de89759183e4aa5dfad', 'request_id': 'req-32460414-57e6-4a42-b253-ce66e98352f5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:36.072023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] The token cache is being invalidate because project b14a6ad81e544de89759183e4aa5dfad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:36.072746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:36.073711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-32460414-57e6-4a42-b253-ce66e98352f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:36.077056 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4189/8357] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:35 2022] DELETE /identity/v3/projects/b14a6ad81e544de89759183e4aa5dfad => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:36.082778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.083793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.083793 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.119534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:36.120817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:36.258956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4169/8358] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:36.267973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.268214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.268504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.291442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:36.292776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:36.308302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4190/8359] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:36.310636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.328029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdcb14-363a-4b21-933a-a0058ba06d69 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.337487 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.339011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.339382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.339661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.341341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:36.344849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.347441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.375551 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4170/8360] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:36.382901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.394432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9a2f4-f32a-48a4-a3aa-3fcc16f912e0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.403177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.404152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.404628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.404997 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.406008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.408109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.434904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:36.475150 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4191/8361] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:36 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:36.478697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.494903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eb48-52e1-4a83-a2fd-fd7abf433154 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.633397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.634133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.634577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.634927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.635742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.637932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.674324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.684486 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4171/8362] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:36 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:36.697784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b697-d2a4-441f-b17d-dd8cb3d43af4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.711451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.712304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.713101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.713101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.713694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.715714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.731257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4192/8363] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:36.735205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.751030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef6b26-8dea-430b-9895-08a1188681b8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.765193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.767368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.767668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.767957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.772073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.774461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2277c-2729-4cf1-8344-fcf3f061b7d1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:36.806982 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4172/8364] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:36.812224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:36.850903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627007a-92b3-450a-8647-fd90a152ddce admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:36.939919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:36.939919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:36.939919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:36.939919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] PATH_INFO: `/v3/projects/ebb64ec5921b4cdb8be38f821a0efe65/users/d1d48aacdb8342b4901f4886569605f4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:36.972166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb64ec5921b4cdb8be38f821a0efe65, user_id=d1d48aacdb8342b4901f4886569605f4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:36.981262 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.010081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4193/8365] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:36 2022] PUT /identity/v3/projects/ebb64ec5921b4cdb8be38f821a0efe65/users/d1d48aacdb8342b4901f4886569605f4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:37.030259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.030839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.031204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.124070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] MFA Rules not processed for user `d1d48aacdb8342b4901f4886569605f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:37.125388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:37.138069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:37.278558 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4173/8366] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:37.284900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.381662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b34ea-9d47-4d9d-8787-ef7cfbd1523c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.388022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.388760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.389103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.389411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.390287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.392503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.440201 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4194/8367] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:37 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:37.441207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.472822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577c593-fe63-447a-9b4a-d78307ac5de2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.568322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.569239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.569728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.570468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.571303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.573639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.607507 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4174/8368] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:37 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:37.610215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.627318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2dc8-d132-4dba-82b3-313ef0bb218b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.634105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.634984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.635360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.635806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.636697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.639449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.655150 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4195/8369] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:37.656931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.670166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe421-d766-457f-9adc-c13bd1817728 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.677790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.679270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.679772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.680082 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] PATH_INFO: `/v3/projects/4ca594d63336456faf9fd175663e2b2f/users/4f250d9e4c664a6782624469b77d900c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.702488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca594d63336456faf9fd175663e2b2f, user_id=4f250d9e4c664a6782624469b77d900c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.705714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.725534 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4175/8370] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:37 2022] PUT /identity/v3/projects/4ca594d63336456faf9fd175663e2b2f/users/4f250d9e4c664a6782624469b77d900c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:37.730907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.751204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f3503-f263-4eb5-b7eb-66e4d3f232d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.840371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.841252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.843418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.843793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.845931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.847933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623d5fa-4474-413e-b915-43c1d6afe8dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.861664 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4196/8371] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:37.865762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:37.879276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a022-2628-4abb-b165-f50c1d56c309 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:37.884934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:37.885857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.886146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.886428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] PATH_INFO: `/v3/projects/4ca594d63336456faf9fd175663e2b2f/users/4f250d9e4c664a6782624469b77d900c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.888851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca594d63336456faf9fd175663e2b2f, user_id=4f250d9e4c664a6782624469b77d900c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:37.891548 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:37.903350 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4176/8372] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:37 2022] PUT /identity/v3/projects/4ca594d63336456faf9fd175663e2b2f/users/4f250d9e4c664a6782624469b77d900c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:37.915957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:37.916276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:37.916765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:37.947445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] MFA Rules not processed for user `4f250d9e4c664a6782624469b77d900c`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:37.949133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:37.961931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:38.054209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4197/8373] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:38.065687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:38.067684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:38.187974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eeb0e-bc26-42b2-873d-6c335e775895 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:38.209777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:38.211274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:38.211657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:38.212029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:38.250151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:38.253760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78549b-d5a3-494a-b0d1-c12e2d2c0014 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:38.267035 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4177/8374] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:38.870473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:39.055910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff471b8-80b1-4bc4-971b-7cf838d7e140 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:39.070525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:39.071693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:39.072097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:39.073039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] PATH_INFO: `/v3/users/d1d48aacdb8342b4901f4886569605f4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:39.074837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d48aacdb8342b4901f4886569605f4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:39.077636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:39.185993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d48aacdb8342b4901f4886569605f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:39.186596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d48aacdb8342b4901f4886569605f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:39.200661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d48aacdb8342b4901f4886569605f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:39.231418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d48aacdb8342b4901f4886569605f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:39.244244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d48aacdb8342b4901f4886569605f4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:39.253234 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4198/8375] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:38 2022] DELETE /identity/v3/users/d1d48aacdb8342b4901f4886569605f4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:39.258071 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:39.258624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:39.258771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:39.265420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:39.287962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:39.290596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:39.417794 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4178/8376] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:39.452324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:39.454527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:39.530901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:39.625254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bec9b-995f-4edb-9b57-36fbee905c16 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:39.651378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:39.655251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:39.657324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:39.658058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:39.686224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:39.689594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:39.717282 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4199/8377] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:40.297277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:40.299582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:40.334444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f86d-ac86-48b8-945c-d7492149f766 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:40.352980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:40.354113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:40.354415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:40.354768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] PATH_INFO: `/v3/projects/ebb64ec5921b4cdb8be38f821a0efe65` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:40.363852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb64ec5921b4cdb8be38f821a0efe65)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:40.367233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:40.510973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb64ec5921b4cdb8be38f821a0efe65', 'request_id': 'req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.530080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb64ec5921b4cdb8be38f821a0efe65', 'request_id': 'req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.544015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb64ec5921b4cdb8be38f821a0efe65', 'request_id': 'req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.570470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] The token cache is being invalidate because project ebb64ec5921b4cdb8be38f821a0efe65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:40.571024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.573416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.577073 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4179/8378] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:40 2022] DELETE /identity/v3/projects/ebb64ec5921b4cdb8be38f821a0efe65 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:40.581182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:40.596796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dcdb9-da7b-473e-9de7-f60bd841ce65 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:40.718095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:40.720296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:40.720911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:40.721280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] PATH_INFO: `/v3/users/4f250d9e4c664a6782624469b77d900c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:40.724846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f250d9e4c664a6782624469b77d900c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:40.727705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:40.827341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f250d9e4c664a6782624469b77d900c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.829029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f250d9e4c664a6782624469b77d900c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.849432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f250d9e4c664a6782624469b77d900c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.876019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f250d9e4c664a6782624469b77d900c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.914909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8e559bf7-16e4-4f9a-8f11-2763d89dc0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f250d9e4c664a6782624469b77d900c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:40.939594 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4200/8379] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:40 2022] DELETE /identity/v3/users/4f250d9e4c664a6782624469b77d900c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:41.614146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:41.615976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:41.637501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00a18-6c3b-4115-84ed-d8d35b90c9ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:41.748885 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:41.750072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:41.750302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:41.750865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] PATH_INFO: `/v3/projects/4ca594d63336456faf9fd175663e2b2f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:41.752371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca594d63336456faf9fd175663e2b2f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:41.754855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:41.793392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:41.819594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca594d63336456faf9fd175663e2b2f', 'request_id': 'req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:41.830771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca594d63336456faf9fd175663e2b2f', 'request_id': 'req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:41.844969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca594d63336456faf9fd175663e2b2f', 'request_id': 'req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:41.860042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] The token cache is being invalidate because project 4ca594d63336456faf9fd175663e2b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:41.860614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:41.861455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-709e9f14-a5a9-44c9-844d-eaa4b50d7a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:41.863306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4180/8380] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:41 2022] DELETE /identity/v3/projects/4ca594d63336456faf9fd175663e2b2f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:41.870139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:41.870711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:41.871116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:41.897087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:41.898561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:41.963679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:41.986981 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4201/8381] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:41.995920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:41.997040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:41.997040 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.020819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:42.022057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:42.030843 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4181/8382] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:42.035673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.046512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882174c-2fa0-4c54-be73-92766a9d9b76 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.051499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.052190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.052510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.052963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.053653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:42.053962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.055587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.074189 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4202/8383] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:42.078937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.092966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2bc19-8eac-4020-acd7-ed9a242b96a5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.098812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.099492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.099774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.100050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.100901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.102890 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.143197 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4182/8384] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:42 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:42.148882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.161869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e57fd-be26-4587-871a-d2ff76fc040a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.244376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.245383 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.245699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.245905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.246611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.249177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.275990 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4203/8385] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:42 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:42.280160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.291601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f306f5-e833-406d-ac99-c14a7049eba0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.296782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.297475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.297810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.298038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.298761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.300984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.311930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4183/8386] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:42.316390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.328242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfda3f-1781-44b3-8b59-a5e77a2ef0d0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.333402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.334123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.334404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.334707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.335494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.337230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6545ce-f321-48c1-b850-f32e14f9001a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.348752 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4204/8387] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:42.352860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.363791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54186e4-1941-499d-8919-cb6f6a98607a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.368777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.369697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.369980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.370256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] PATH_INFO: `/v3/projects/a78b2a07e659460ca4d2e9b2d29ad87a/users/dbead338fd8047ea980ce985c05806e4/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.387018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78b2a07e659460ca4d2e9b2d29ad87a, user_id=dbead338fd8047ea980ce985c05806e4, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.389128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.403783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4184/8388] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:42 2022] PUT /identity/v3/projects/a78b2a07e659460ca4d2e9b2d29ad87a/users/dbead338fd8047ea980ce985c05806e4/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:42.414607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.414975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.415319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.449982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] MFA Rules not processed for user `dbead338fd8047ea980ce985c05806e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:42.451489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:42.554364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4205/8389] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:42.563712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:42.565786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:42.646135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9258-81c9-482e-bf0f-0ac4c4dc5cc2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:42.651436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:42.652230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:42.652613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:42.653095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:42.665268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:42.666804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2c293-3954-4473-94fa-c0e47fa93d8c service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:42.679834 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4185/8390] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:46.843501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:46.967329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:47.018486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39426e95-e464-4fb8-b6bd-f6ba295d08e8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:47.042349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:47.043342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:47.043755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:47.044137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] PATH_INFO: `/v3/users/dbead338fd8047ea980ce985c05806e4` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:47.048654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbead338fd8047ea980ce985c05806e4)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:47.051303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:47.130023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbead338fd8047ea980ce985c05806e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:47.130824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbead338fd8047ea980ce985c05806e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:47.142313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbead338fd8047ea980ce985c05806e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:47.164689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbead338fd8047ea980ce985c05806e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:47.174972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbead338fd8047ea980ce985c05806e4'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:47.185615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4206/8391] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:46 2022] DELETE /identity/v3/users/dbead338fd8047ea980ce985c05806e4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:47.194914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:47.196454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:47.197111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:47.226061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:47.227436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:47.287021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:47.320524 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4186/8392] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:47.336604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:47.339494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:47.586615 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51379f6b-eeb6-4b9d-972c-bbe4a21de10d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:47.596924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:47.597637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:47.597937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:47.598242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:47.612246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:47.617240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb92a3-32f8-4639-938c-694160ff897d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:47.632510 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4207/8393] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:48.497969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:48.499605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:48.522540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217e694-aef2-4254-bb5e-381f8f77f7d7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:48.538230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:48.539169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:48.539464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:48.539735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] PATH_INFO: `/v3/projects/a78b2a07e659460ca4d2e9b2d29ad87a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:48.541077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78b2a07e659460ca4d2e9b2d29ad87a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:48.543130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:48.601305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78b2a07e659460ca4d2e9b2d29ad87a', 'request_id': 'req-9199d6c0-529e-4759-bb8b-9eefc082854f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:48.612129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78b2a07e659460ca4d2e9b2d29ad87a', 'request_id': 'req-9199d6c0-529e-4759-bb8b-9eefc082854f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:48.620494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78b2a07e659460ca4d2e9b2d29ad87a', 'request_id': 'req-9199d6c0-529e-4759-bb8b-9eefc082854f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:48.638298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] The token cache is being invalidate because project a78b2a07e659460ca4d2e9b2d29ad87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:48.638725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:48.639586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-9199d6c0-529e-4759-bb8b-9eefc082854f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:48.641356 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4187/8394] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:48 2022] DELETE /identity/v3/projects/a78b2a07e659460ca4d2e9b2d29ad87a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:48.647397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:48.648254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:48.648613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:48.670097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:48.672006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:48.745652 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4208/8395] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:48.753453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:48.753940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:48.754407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:48.775966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:48.777461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:48.787483 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4188/8396] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:48.792750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:48.807354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ee88-c1fb-4c4e-958e-47bfc90ccf65 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:48.811251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:48.812074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:48.812355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:48.812680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:48.813413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:48.813719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:48.815682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:48.819582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:48.835178 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4209/8397] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:48.841729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:48.855734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57dcdb-b05a-4ab9-8d04-02c4d48945d6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:48.866384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:48.866384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:48.866384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:48.866918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:48.867282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:48.869618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:48.903892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4189/8398] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:48 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:48.909114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:48.938702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf6e4-46ea-4709-8b4b-3007f9ba611d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.039200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.040287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.040765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.041371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.044078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.046677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.077697 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4210/8399] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:48 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:49.083855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.100679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5e8bb-fc39-4c4f-8397-743ecdebdde2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.108237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.109235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.109605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.109977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.110835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.112970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.131239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4190/8400] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:49.135180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.147697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e01e-3b0e-4b14-8318-f07d93391018 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.152784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.153648 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.154006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.154294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.155020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.156699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22238886-0ef7-4125-861a-2d3952757ef5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.168529 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4211/8401] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:49.172786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.186873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffed07-6afa-4c26-bf58-0ded1d8c4265 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.192322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.193305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.193702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.193999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] PATH_INFO: `/v3/projects/1578a50f2f074a0f8027d8376717a39c/users/61f7e0c206e349a196bbd2c6562ee0e2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.216930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1578a50f2f074a0f8027d8376717a39c, user_id=61f7e0c206e349a196bbd2c6562ee0e2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.221219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.239504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4191/8402] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:49 2022] PUT /identity/v3/projects/1578a50f2f074a0f8027d8376717a39c/users/61f7e0c206e349a196bbd2c6562ee0e2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:49.251462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.252162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.252507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.292723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] MFA Rules not processed for user `61f7e0c206e349a196bbd2c6562ee0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:49.294064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:49.440015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.448167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4212/8403] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:49.545012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339c4a-3616-4c92-a897-bd5f0505acb7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.552521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.554135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.555044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.555044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.556148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.559610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.573299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:49.593162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4192/8404] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:49 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:49.597584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.610018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6d13-cbfd-47c8-bf7d-53f45c1abae1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.698924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.699656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.699913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.700386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.701115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.703158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.712300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:49.726661 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4213/8405] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:49 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:49.730740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.741208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827af3d-27d4-4577-bc9f-66ce44813c72 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.745764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.746433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.746718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.746990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.747764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.749356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.763579 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4193/8406] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:49.765573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.777141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7f76-0995-4a8c-b3a6-22d6d2d031d0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.781912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.782594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.782876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.783151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.783912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.785567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d0aa8-4d8c-42e3-a9eb-24583bbd0fa3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.796028 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4214/8407] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:49.800456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.811203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87728e-323d-4ce4-82fb-808103f33dce admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:49.817131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:49.818044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.818327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.818606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] PATH_INFO: `/v3/projects/a3f66b91d26244f49f1e0ce0b1440537/users/78be1188a7e14055890e9aa815ba7d38/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.839502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f66b91d26244f49f1e0ce0b1440537, user_id=78be1188a7e14055890e9aa815ba7d38, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:49.842484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:49.856765 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4194/8408] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:49 2022] PUT /identity/v3/projects/a3f66b91d26244f49f1e0ce0b1440537/users/78be1188a7e14055890e9aa815ba7d38/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:49.868395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:49.868721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:49.869006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:49.904292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] MFA Rules not processed for user `78be1188a7e14055890e9aa815ba7d38`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:49.905589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:49.976097 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4215/8409] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:49.977799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.995284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:49.997725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.056247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b1da2-7fdf-488b-b577-6f9956cabc4d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.061719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.062389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.062870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.063158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.063940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.066546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.077550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220774-1fe2-4f55-bc3e-c63d9636022c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.082141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.083031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.083311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.083587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] PATH_INFO: `/v3/users/3a2088dc09c24456803afbdb9a6f5884` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.084890 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2088dc09c24456803afbdb9a6f5884)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.086816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.093206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4195/8410] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:49 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:50.097783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.153691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2088dc09c24456803afbdb9a6f5884'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.154862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2088dc09c24456803afbdb9a6f5884'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.165738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2088dc09c24456803afbdb9a6f5884'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.179386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2088dc09c24456803afbdb9a6f5884'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.181658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071665d-bc02-4b67-9627-cf6534a60e15 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.182062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.188073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bf2db506-254d-4f7f-bfcd-009cd50b4da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2088dc09c24456803afbdb9a6f5884'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.188201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.189190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.189518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.191941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.193062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.194991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.198379 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4216/8411] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:49 2022] DELETE /identity/v3/users/3a2088dc09c24456803afbdb9a6f5884 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:50.201208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.201836 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.202335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.219113 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4196/8412] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:50 2022] POST /identity/v3/users => generated 301 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:50.227014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.232972 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.233087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:50.234592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.255720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6cc88-505c-44ca-93fa-844d56b26e86 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.306147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.345171 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4217/8413] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:50.355108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.356409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.356725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.357034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.357175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.357891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.358758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.360303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.381153 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4197/8414] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:50.382495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.394656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2d201-f24f-4944-b3f8-8e8461b05dbe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.402249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.403203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.403483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.403791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] PATH_INFO: `/v3/projects/3aee9299a52643dc9b9a2a3776010e03/users/d5c0b36bf20c48aeac639d108aa4360d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.421222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee9299a52643dc9b9a2a3776010e03, user_id=d5c0b36bf20c48aeac639d108aa4360d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.424083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.433583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a2270-32c8-4d85-ba04-b15083004103 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.437799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.438492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.439035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.439145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.445887 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4198/8415] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:50 2022] PUT /identity/v3/projects/3aee9299a52643dc9b9a2a3776010e03/users/d5c0b36bf20c48aeac639d108aa4360d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:50.450506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.450787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.452220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.465445 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4218/8416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:50.538141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dd185-4f37-4fa5-a2cd-c211dcd8863b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.543969 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.544929 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.545047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.545637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.546182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.548842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d20e-b315-45f2-8860-971403b32ea8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.560689 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4199/8417] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:50.565175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.577635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9131c-040a-43a7-8bd3-fc5e9b22ecc0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.585293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.586314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.586834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.586967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] PATH_INFO: `/v3/projects/3aee9299a52643dc9b9a2a3776010e03/users/d5c0b36bf20c48aeac639d108aa4360d/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.589292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee9299a52643dc9b9a2a3776010e03, user_id=d5c0b36bf20c48aeac639d108aa4360d, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.592213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.607002 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4219/8418] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:50 2022] PUT /identity/v3/projects/3aee9299a52643dc9b9a2a3776010e03/users/d5c0b36bf20c48aeac639d108aa4360d/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:50.618070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.618358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.618634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.652397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] MFA Rules not processed for user `d5c0b36bf20c48aeac639d108aa4360d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:50.653752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.683686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.685571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.771464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4200/8419] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:50.782651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0990b2-5fd4-4659-bced-b31b9faf0a09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.789357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:50.791436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.793315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.794337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.794603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.795144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] PATH_INFO: `/v3/projects/bb1a3e4544a24851936752bd2cf77d2d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.796379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1a3e4544a24851936752bd2cf77d2d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:50.799676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:50.833573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.839122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.896147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1a3e4544a24851936752bd2cf77d2d', 'request_id': 'req-8d5083d4-034a-4bf1-b815-463ff611d908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.907861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1a3e4544a24851936752bd2cf77d2d', 'request_id': 'req-8d5083d4-034a-4bf1-b815-463ff611d908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.913202 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008157-b882-420d-828f-ac8b29bdef6b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:50.915998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1a3e4544a24851936752bd2cf77d2d', 'request_id': 'req-8d5083d4-034a-4bf1-b815-463ff611d908'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.931738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] The token cache is being invalidate because project bb1a3e4544a24851936752bd2cf77d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:50.932034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.932750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8d5083d4-034a-4bf1-b815-463ff611d908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:50.934548 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4220/8420] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:50 2022] DELETE /identity/v3/projects/bb1a3e4544a24851936752bd2cf77d2d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:50.939300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07748446-7a62-4f0b-b9d5-1a8f5708ec02 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.939606 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07748446-7a62-4f0b-b9d5-1a8f5708ec02 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.939877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07748446-7a62-4f0b-b9d5-1a8f5708ec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.959352 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-07748446-7a62-4f0b-b9d5-1a8f5708ec02 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:50.960627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-07748446-7a62-4f0b-b9d5-1a8f5708ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:50.992564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:50.993222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:50.993503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:50.993779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:50.995553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.019747 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4221/8421] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:51.029201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.029493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.029848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.048797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:51.050030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.054951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.056726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.058404 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4222/8422] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:51.062577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.068489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4201/8423] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:51.071837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ae276-1452-4a57-b558-7656c06c9cba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.077032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.077688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.077971 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.078301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.078968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:51.079271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.080951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.093756 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4223/8424] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:26:51.099636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.112757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c392630-8fb9-4f05-b248-05219ebd07a2 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.120306 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.121126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.121300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.121577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.122310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.124283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.152620 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4202/8425] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:51.156842 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.167760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb05ba-4298-46f4-9095-abb04ca5e9cf admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.235232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.235951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.236240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.236560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.237370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.239457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.261572 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4224/8426] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:51 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:51.265751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.276906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919aef7-65bf-4cbd-8675-26aaa1e047f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.281837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.282524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.282814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.283116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.283882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.285582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.303185 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4203/8427] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:51.304978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.316005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2ffd-2998-41a9-9b3c-88ceed0d17b0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.320051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.321863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.322348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.322697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.322972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.323248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.324357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.326035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.337604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4225/8428] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:51.337762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d220c-e79f-46c4-b5a8-8bb842c8e273 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.341777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.342434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.343317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.343601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.344163 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] PATH_INFO: `/v3/users/3681c7f9c6384d63b76beea6c820da9e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.345113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3681c7f9c6384d63b76beea6c820da9e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.347111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.352930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5436-0678-49c2-bdd9-29863ff962b3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.357685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.358579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.358858 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.359136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] PATH_INFO: `/v3/projects/5dbee16d8fa44dc780967c33f8015a03/users/2e3ba17db7fc4ac78cc25cf631da8ffd/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.369354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:51.373935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:51.379833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbee16d8fa44dc780967c33f8015a03, user_id=2e3ba17db7fc4ac78cc25cf631da8ffd, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.383846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeb19e-d010-4378-94cb-00743b71c8c6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.402170 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4226/8429] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:51 2022] PUT /identity/v3/projects/5dbee16d8fa44dc780967c33f8015a03/users/2e3ba17db7fc4ac78cc25cf631da8ffd/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:51.409749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3681c7f9c6384d63b76beea6c820da9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:51.412778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.413125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.413494 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.420047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3681c7f9c6384d63b76beea6c820da9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:51.436340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3681c7f9c6384d63b76beea6c820da9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:51.438036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3681c7f9c6384d63b76beea6c820da9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:51.438738 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a528571d-f493-47d3-9436-dd3a2be14700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3681c7f9c6384d63b76beea6c820da9e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:51.446735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] MFA Rules not processed for user `2e3ba17db7fc4ac78cc25cf631da8ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:51.458876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.468665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4204/8430] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:51 2022] DELETE /identity/v3/users/3681c7f9c6384d63b76beea6c820da9e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:51.470178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.472894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.472894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.500615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:51.502000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.577884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4205/8431] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:51.579978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4227/8432] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:51.581900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.583419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.587253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:51.589302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:51.657154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635cdfa-5d38-4d49-89d9-4f8152d13910 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.661392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.662248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.662728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.662985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db4e6-7bf8-487e-b532-4fbe1f7b962f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:51.663479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.666605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:51.667255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:51.667539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:51.667820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:51.678646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.680112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.690399 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4228/8433] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:51.725628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:51.729713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:51.731199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:51.744389 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4206/8434] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:52.150668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:52.152182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:52.168173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3496-3ad9-4a0f-b903-870e7abe9892 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:52.174470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:52.175532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:52.175970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:52.176466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] PATH_INFO: `/v3/users/2e3ba17db7fc4ac78cc25cf631da8ffd` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:52.177770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3ba17db7fc4ac78cc25cf631da8ffd)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:52.179791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:52.238055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3ba17db7fc4ac78cc25cf631da8ffd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.238896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3ba17db7fc4ac78cc25cf631da8ffd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.247935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3ba17db7fc4ac78cc25cf631da8ffd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.253587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:52.255288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:52.275152 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1299-7fad-4fab-bdbd-5d0a5de59095 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:52.279128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3ba17db7fc4ac78cc25cf631da8ffd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.280340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:52.281285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:52.281573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:52.282101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] PATH_INFO: `/v3/projects/a75e718d6b4742d8b04dc9012467cc53` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:52.282537 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:52.283083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75e718d6b4742d8b04dc9012467cc53)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:52.285976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:52.293027 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-b2ec94d2-1540-4669-a88a-92bc505caa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3ba17db7fc4ac78cc25cf631da8ffd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.313644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4229/8435] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:52 2022] DELETE /identity/v3/users/2e3ba17db7fc4ac78cc25cf631da8ffd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:52.316639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:52.316916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:52.317206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:52.347907 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:52.349429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:52.361370 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75e718d6b4742d8b04dc9012467cc53', 'request_id': 'req-cb305144-ba22-4a95-aaf6-b5a4fc28d826'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.370363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75e718d6b4742d8b04dc9012467cc53', 'request_id': 'req-cb305144-ba22-4a95-aaf6-b5a4fc28d826'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.379417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75e718d6b4742d8b04dc9012467cc53', 'request_id': 'req-cb305144-ba22-4a95-aaf6-b5a4fc28d826'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.392323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] The token cache is being invalidate because project a75e718d6b4742d8b04dc9012467cc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:52.392765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.393534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.395391 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4207/8436] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:52 2022] DELETE /identity/v3/projects/a75e718d6b4742d8b04dc9012467cc53 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:52.399211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:52.400664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:52.429576 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4230/8437] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:52.436389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:52.437963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:52.489259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305144-ba22-4a95-aaf6-b5a4fc28d826 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:52.494704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:52.495645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:52.496024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:52.496630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] PATH_INFO: `/v3/users/e36e270e3fef4175a95f15932f10dee6` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:52.497637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36e270e3fef4175a95f15932f10dee6)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:52.499913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:52.514376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a7c4-bcfa-421c-9870-f368d6bb307c None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:52.518598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:52.519259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:52.519642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:52.519951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:52.533374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:52.535256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:52.547533 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4231/8438] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:52.562494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36e270e3fef4175a95f15932f10dee6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.571354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36e270e3fef4175a95f15932f10dee6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.589495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36e270e3fef4175a95f15932f10dee6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.590689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36e270e3fef4175a95f15932f10dee6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.591504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36e270e3fef4175a95f15932f10dee6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:52.599428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:52.616497 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4208/8439] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:52 2022] DELETE /identity/v3/users/e36e270e3fef4175a95f15932f10dee6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:52.995400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.015127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e926-6c12-4668-a381-61fa14e8d689 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.022112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.023835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.102188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.103134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.103524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.103807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] PATH_INFO: `/v3/projects/9fe57ff414e0444083265712456b401d` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.105347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe57ff414e0444083265712456b401d)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.107422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.114940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193100-cace-4338-9fea-87ec30ea9514 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.119963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.120524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.120873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.121217 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] PATH_INFO: `/v3/projects/5dbee16d8fa44dc780967c33f8015a03` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.122495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbee16d8fa44dc780967c33f8015a03)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.125233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.153127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:53.163619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe57ff414e0444083265712456b401d', 'request_id': 'req-cc1c0caa-68f0-495c-9d3a-515a17f80015'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.172767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe57ff414e0444083265712456b401d', 'request_id': 'req-cc1c0caa-68f0-495c-9d3a-515a17f80015'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.179256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe57ff414e0444083265712456b401d', 'request_id': 'req-cc1c0caa-68f0-495c-9d3a-515a17f80015'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.184440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbee16d8fa44dc780967c33f8015a03', 'request_id': 'req-18477535-47bd-45bf-9179-2ecf37792d75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.193793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] The token cache is being invalidate because project 9fe57ff414e0444083265712456b401d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:53.194341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.194891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-cc1c0caa-68f0-495c-9d3a-515a17f80015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.200475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4232/8440] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:52 2022] DELETE /identity/v3/projects/9fe57ff414e0444083265712456b401d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:53.202240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbee16d8fa44dc780967c33f8015a03', 'request_id': 'req-18477535-47bd-45bf-9179-2ecf37792d75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.203391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e64c7-e3ef-4c1a-babf-ebea9fa7c9f7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.204079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e64c7-e3ef-4c1a-babf-ebea9fa7c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.204079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e64c7-e3ef-4c1a-babf-ebea9fa7c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.214484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbee16d8fa44dc780967c33f8015a03', 'request_id': 'req-18477535-47bd-45bf-9179-2ecf37792d75'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.230084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4a3e64c7-e3ef-4c1a-babf-ebea9fa7c9f7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:53.231394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4a3e64c7-e3ef-4c1a-babf-ebea9fa7c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.233291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] The token cache is being invalidate because project 5dbee16d8fa44dc780967c33f8015a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:53.233607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.234290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:53.235923 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4209/8441] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:53 2022] DELETE /identity/v3/projects/5dbee16d8fa44dc780967c33f8015a03 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:53.236853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.238266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.303067 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18477535-47bd-45bf-9179-2ecf37792d75 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.312868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.313036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4233/8442] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:53.313160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.313160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.313160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.313355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52785a-034b-477a-bb87-641d9063c260 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.313355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52785a-034b-477a-bb87-641d9063c260 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.313355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52785a-034b-477a-bb87-641d9063c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.315284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.333566 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6b52785a-034b-477a-bb87-641d9063c260 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:53.334792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6b52785a-034b-477a-bb87-641d9063c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.343282 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4234/8443] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:53.344487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949aa78-20c4-4964-bf5e-3caff07226bd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.344794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949aa78-20c4-4964-bf5e-3caff07226bd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.345059 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949aa78-20c4-4964-bf5e-3caff07226bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.363338 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d949aa78-20c4-4964-bf5e-3caff07226bd None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:53.364564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d949aa78-20c4-4964-bf5e-3caff07226bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.371842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:53.373108 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4235/8444] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:53.374575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.374695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.374927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.396652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:53.397938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.403535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.405140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.413059 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4236/8445] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:53.414172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.418695 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4210/8446] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:53.419561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.430608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795fb9-28d4-45c0-bfa7-cd48f7990d20 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.431014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925a94-c4e4-44ed-b60b-2951647bf4a6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.435837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.436362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.436665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.437727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.437851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.437934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.438014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.438014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.438372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:53.438485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.439149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:53.439553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.440162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.441685 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.456910 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4237/8447] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:53.460932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4211/8448] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:53.465618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.465762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.478473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdfffd-755f-40d4-932f-397156c65300 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.482892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896328a8-816d-4524-9cbc-bee60cf1ef72 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.489584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.491073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.491453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.491829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.492971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.495343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.495561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.496313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.496705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.496984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.497927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.499896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.532674 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4238/8449] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:53.534413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.540131 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4212/8450] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/projects => generated 353 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:53.544259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.615165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c83151-50a7-4dd6-860f-6394be597fa9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.627653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e15bad-5058-48d2-88bd-06b81818340d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.634040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:53.634222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.635273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.635661 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.637407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.637407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.639430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.679067 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4213/8451] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/users => generated 277 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:53.680973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.698008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eb187-995d-4fe9-9577-a39e2f0c88c0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.703354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.703528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.704203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.704327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.704649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.704826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.705037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.705429 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.706288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.706408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.708383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.708589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.722376 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4214/8452] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:53.727677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.741253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4239/8453] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:53.745022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.753090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5c9a-9478-434b-8232-447ef1113f78 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.759781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5698f0-0832-4d52-a38e-5c7122a93e30 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.761205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.763060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.763643 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.764108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.765032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.766855 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.768661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.770329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.770817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.771285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.773454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.775331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.790369 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4215/8454] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:53.791947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.800858 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4240/8455] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:26:53.803296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.818435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd606c54-b0cb-45f6-9a2b-6e68e8a579a1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.825686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.826542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.826975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.828852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c9cdd-b662-4ae1-9366-968eb99428e4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.829166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.831743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.832556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.833596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.834199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.834555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.834913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] PATH_INFO: `/v3/projects/e7233b590f284032a6cc51c93061ae79/users/4740775ca89841faa42cc2c48dd4b172/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.849583 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4241/8456] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:53.850989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:53.853287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7233b590f284032a6cc51c93061ae79, user_id=4740775ca89841faa42cc2c48dd4b172, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.857363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ddb65-6ac0-4c02-97c5-94600fd24b4c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.863344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73431347-5ea9-4d98-a725-cd384d61037a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:53.869568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:53.870902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.871343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.871683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] PATH_INFO: `/v3/projects/02688d6232cf47479d0060bf8539bcb6/users/51ce29a8e0964b1a9b3467f8ab9a36e6/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.877878 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4216/8457] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:53 2022] PUT /identity/v3/projects/e7233b590f284032a6cc51c93061ae79/users/4740775ca89841faa42cc2c48dd4b172/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:53.889488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02688d6232cf47479d0060bf8539bcb6, user_id=51ce29a8e0964b1a9b3467f8ab9a36e6, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:53.892470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c0409-c72a-450c-a6c4-8f0ea57174e7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:53.924313 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4242/8458] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:53 2022] PUT /identity/v3/projects/02688d6232cf47479d0060bf8539bcb6/users/51ce29a8e0964b1a9b3467f8ab9a36e6/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:26:53.938894 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.939188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.939466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:53.980258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] MFA Rules not processed for user `51ce29a8e0964b1a9b3467f8ab9a36e6`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:53.981610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:53.981981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:53.982475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:53.982996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.017933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] MFA Rules not processed for user `4740775ca89841faa42cc2c48dd4b172`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:54.019557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:54.030214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:54.088586 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4217/8459] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:54.091469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.122335 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4243/8460] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:54.132788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.134533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:54.174993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8558-5cf2-4795-b21b-d0e0ae8d7ee2 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.181183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.182010 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.182390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.182839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.183633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.186018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.226658 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4218/8461] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:54 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:26:54.230651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.241595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e807d1-2f28-4314-a76b-e62d1c8a1935 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.245608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:54.308206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.309259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.309653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.310076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.343805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744b435-6903-4cec-b3a0-6c59df2ecff4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.349707 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.350984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.351584 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.351996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.352940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.355538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.391780 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4219/8462] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:54 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:54.391977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.392703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.393618 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.404460 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4244/8463] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:54.407023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feb05f-c2f5-4837-a100-d3fdb1646f7e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.412228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.413051 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.413240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.413533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.414266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.415962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.427599 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4220/8464] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:54.431949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.443500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936cc3-7c88-4f81-b3c5-a2ad1bad93b0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.449700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.450728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.451110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.451447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] PATH_INFO: `/v3/projects/706260dbeda34196a51ec7d521009b3b/users/3f8586e0efca44dab8330e4b9e49e7e1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.470017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=706260dbeda34196a51ec7d521009b3b, user_id=3f8586e0efca44dab8330e4b9e49e7e1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.473651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.494279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4245/8465] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:54 2022] PUT /identity/v3/projects/706260dbeda34196a51ec7d521009b3b/users/3f8586e0efca44dab8330e4b9e49e7e1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:54.495850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.508178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a32de-b93a-424e-a7fd-d9c31eb03efc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.552834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:54.587880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.590149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.590149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.590149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.590149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.591480 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877f37-5a19-4621-97bc-ff1e6c8ef21f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.610148 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4221/8466] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:54.614728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.627198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab884e-8574-4ff4-aae8-9f9df0c59c3f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.634101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.635091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.635318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.635583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] PATH_INFO: `/v3/projects/706260dbeda34196a51ec7d521009b3b/users/3f8586e0efca44dab8330e4b9e49e7e1/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.638515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706260dbeda34196a51ec7d521009b3b, user_id=3f8586e0efca44dab8330e4b9e49e7e1, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.641355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.655465 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4246/8467] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:54 2022] PUT /identity/v3/projects/706260dbeda34196a51ec7d521009b3b/users/3f8586e0efca44dab8330e4b9e49e7e1/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:54.665768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.666687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.666974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.697130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] MFA Rules not processed for user `3f8586e0efca44dab8330e4b9e49e7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:54.699399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:54.782317 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4222/8468] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:54.794781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:54.797780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:54.895324 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839705-4391-4183-a759-d8e9b3283622 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:54.900139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:54.901095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:54.901471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:54.901849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:54.913734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:54.914947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:54.932508 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4247/8469] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:55.072414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:55.077381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:55.097359 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7bd21-1188-4c21-b8fe-44b1a302bfdb None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:55.110281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:55.111833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:55.112132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:55.112408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:55.261401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:55.262892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31283e-ff66-474d-bfe4-37366d65ed46 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:55.278624 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4223/8470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:57.020576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:57.093866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:57.161745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9df7f-63ee-41c2-8f99-d2d1af455fc7 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:57.168384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:57.169330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:57.169613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:57.169882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] PATH_INFO: `/v3/users/4740775ca89841faa42cc2c48dd4b172` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:57.171115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4740775ca89841faa42cc2c48dd4b172)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:57.173106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:57.271892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4740775ca89841faa42cc2c48dd4b172'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:57.274721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4740775ca89841faa42cc2c48dd4b172'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:57.298286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4740775ca89841faa42cc2c48dd4b172'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:57.330824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4740775ca89841faa42cc2c48dd4b172'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:57.349211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4740775ca89841faa42cc2c48dd4b172'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:57.366208 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4248/8471] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:57 2022] DELETE /identity/v3/users/4740775ca89841faa42cc2c48dd4b172 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:57.372294 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6c64-0016-4c41-ae7d-548d5077dbc6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:57.374757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6c64-0016-4c41-ae7d-548d5077dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:57.375856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6c64-0016-4c41-ae7d-548d5077dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:57.424504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-42fb6c64-0016-4c41-ae7d-548d5077dbc6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:57.426759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-42fb6c64-0016-4c41-ae7d-548d5077dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:57.557452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:57.571395 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4224/8472] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:57.584646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:57.588213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:57.709515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a58595-42a3-4a88-80ef-0eee7f73a3a9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:57.728358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:57.730428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:57.731135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:57.731850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:57.764064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:57.765641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:57.794132 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4249/8473] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:26:58.036090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1ce2-6acc-43d3-9770-3b708fd10bc1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.036385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1ce2-6acc-43d3-9770-3b708fd10bc1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.036703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1ce2-6acc-43d3-9770-3b708fd10bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.078801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-10ab1ce2-6acc-43d3-9770-3b708fd10bc1 None None] MFA Rules not processed for user `61f7e0c206e349a196bbd2c6562ee0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:58.080614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-10ab1ce2-6acc-43d3-9770-3b708fd10bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.141821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:58.143409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.173740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7b6e-5a56-4d73-b9ef-83fb58acb66c service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:58.183456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:58.185449 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.186123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.186949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] PATH_INFO: `/v3/projects/e7233b590f284032a6cc51c93061ae79` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.191297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7233b590f284032a6cc51c93061ae79)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:58.195715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:58.234148 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4225/8474] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:58.334166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:58.339724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7233b590f284032a6cc51c93061ae79', 'request_id': 'req-a1107d22-63f7-4580-847e-8c734b7b8489'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.360296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7233b590f284032a6cc51c93061ae79', 'request_id': 'req-a1107d22-63f7-4580-847e-8c734b7b8489'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.369186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7233b590f284032a6cc51c93061ae79', 'request_id': 'req-a1107d22-63f7-4580-847e-8c734b7b8489'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.397584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] The token cache is being invalidate because project e7233b590f284032a6cc51c93061ae79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:26:58.397979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.398969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.403119 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4250/8475] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:58 2022] DELETE /identity/v3/projects/e7233b590f284032a6cc51c93061ae79 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:58.408259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51d1e-879a-43bf-95d8-1ed4935392f6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.408892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51d1e-879a-43bf-95d8-1ed4935392f6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.408981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51d1e-879a-43bf-95d8-1ed4935392f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.433717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c3c51d1e-879a-43bf-95d8-1ed4935392f6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:58.435130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c3c51d1e-879a-43bf-95d8-1ed4935392f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.531307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:58.533122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.534496 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4226/8476] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:58.536567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.536906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.537199 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.559409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107d22-63f7-4580-847e-8c734b7b8489 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:58.560681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:58.563567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.571917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:58.572980 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.573278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.574036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] PATH_INFO: `/v3/users/51ce29a8e0964b1a9b3467f8ab9a36e6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.576073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ce29a8e0964b1a9b3467f8ab9a36e6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:58.580162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:58.593865 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4227/8477] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:58.594953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:58.625414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44619a-49ef-4c3f-8326-3b30cf579b9c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:58.641394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:58.642159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.642453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.642758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.643608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:26:58.643997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:58.646345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:58.670237 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4228/8478] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:26:58.690038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:58.712698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ce29a8e0964b1a9b3467f8ab9a36e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.713696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ce29a8e0964b1a9b3467f8ab9a36e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.724185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea05d-a025-4392-a828-0ff31bca255b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:58.730371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ce29a8e0964b1a9b3467f8ab9a36e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.738877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:58.740005 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.740507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.740960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.741898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:58.749044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:58.750484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ce29a8e0964b1a9b3467f8ab9a36e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.760356 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-716e07e1-47fb-4e70-97d5-0eebb24aab62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ce29a8e0964b1a9b3467f8ab9a36e6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:26:58.768925 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4251/8479] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:26:58 2022] DELETE /identity/v3/users/51ce29a8e0964b1a9b3467f8ab9a36e6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:58.774014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.774308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.774575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.809778 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4229/8480] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:58.815897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:58.819788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.853140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:58.854110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:58.952663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985112-7cc0-4f07-848e-261182f045cd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:58.979398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:58.980640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:58.982180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:58.982504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:58.983266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:58.987856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.007611 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:59.043466 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4252/8482] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:26:59.044614 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.045882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4230/8481] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:58 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:59.058061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.060511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:59.065594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585679b8-9393-430b-bde3-1808aaab02c2 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.072717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.073810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.074148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.074418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.075437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.077463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.096716 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4253/8483] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:59.098872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.115005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b4896-0c3b-47e8-bbed-1408c5d8bdba admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.121707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.122819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.123117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.123538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.127653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.131416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.162138 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4254/8484] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:26:59.167689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.196863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0751f29-e175-47b3-8337-e7f72d0dcd54 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.218754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.220395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.220395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.220395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] PATH_INFO: `/v3/projects/8cab14c1e01a4a81822207adb25a5847/users/e9184cba1bfd4cb4871f29c9bdd748f2/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.248916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839bdd-58f7-42de-bf84-e619a7ca49d6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.255382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.256824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.257276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.258375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.260215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cab14c1e01a4a81822207adb25a5847, user_id=e9184cba1bfd4cb4871f29c9bdd748f2, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.263427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cadc0-2484-464f-a15b-488987cb8c50 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.285937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:59.293901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4255/8485] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:26:59 2022] PUT /identity/v3/projects/8cab14c1e01a4a81822207adb25a5847/users/e9184cba1bfd4cb4871f29c9bdd748f2/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:26:59.298120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.300372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.305301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.305747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.306773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.317002 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4231/8486] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:26:59.355797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] MFA Rules not processed for user `e9184cba1bfd4cb4871f29c9bdd748f2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:26:59.357209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:59.519054 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4256/8487] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:26:59.520955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.547144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ce20-59fa-43cb-bcaa-d3107e20ee5a service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.712726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.713354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.713668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.714678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.715865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.719856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.768996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4232/8488] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:26:59 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:59.773499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.787538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2fdd7-bc8a-4181-b812-253e80034dc1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.885020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.886061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.886432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.886818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.888143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.890542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:26:59.933848 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4257/8489] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:26:59 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:26:59.937612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.950596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:26:59.954655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:26:59.958497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270493-f0c7-4d8a-9745-edca152c30f4 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:26:59.968248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:26:59.968994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:26:59.969475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:26:59.970079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:26:59.970508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:26:59.972576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.004727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666766d-a04f-4783-a225-810c25ed21a2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.006025 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4233/8490] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:00.009850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:00.019473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.020480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.020864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.021247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] PATH_INFO: `/v3/projects/02688d6232cf47479d0060bf8539bcb6` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.023139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02688d6232cf47479d0060bf8539bcb6)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.024733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.034673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787542-fcf8-4d2b-aa9e-7897d3480cf7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.046084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.046979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.047267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.047549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] PATH_INFO: `/v3/projects/7fb3329dc5894516a5b72611bf0e1c79/users/c21f4b51db634f5db5f2c6c6cbd9d7ec/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.081516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb3329dc5894516a5b72611bf0e1c79, user_id=c21f4b51db634f5db5f2c6c6cbd9d7ec, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.089718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.119823 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4234/8491] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:00 2022] PUT /identity/v3/projects/7fb3329dc5894516a5b72611bf0e1c79/users/c21f4b51db634f5db5f2c6c6cbd9d7ec/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:00.124224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:00.148233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02688d6232cf47479d0060bf8539bcb6', 'request_id': 'req-838d844c-49c2-4e70-9b07-5553962db6d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.184040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02688d6232cf47479d0060bf8539bcb6', 'request_id': 'req-838d844c-49c2-4e70-9b07-5553962db6d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.199622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02688d6232cf47479d0060bf8539bcb6', 'request_id': 'req-838d844c-49c2-4e70-9b07-5553962db6d1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.216934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:00.221487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] The token cache is being invalidate because project 02688d6232cf47479d0060bf8539bcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:00.222095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.223706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.226172 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4258/8492] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:26:59 2022] DELETE /identity/v3/projects/02688d6232cf47479d0060bf8539bcb6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:00.247160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:00.250166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:00.254670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:00.271630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376cb5-bab7-4b36-a76b-1c5d20b6ac08 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.399947 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.400676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.402364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.402727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.403429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.405128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.436238 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4235/8493] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:27:00.439677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:00.444044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:00.477947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d844c-49c2-4e70-9b07-5553962db6d1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.495835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.500753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.501983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.503235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] PATH_INFO: `/v3/users/3f8586e0efca44dab8330e4b9e49e7e1` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.506969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8586e0efca44dab8330e4b9e49e7e1)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.512293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.535075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58decc-7a77-4ea6-b278-b9ba8da64377 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.546490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.548374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.548794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.551418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.552905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:00.660491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8586e0efca44dab8330e4b9e49e7e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.661137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8586e0efca44dab8330e4b9e49e7e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.674795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8586e0efca44dab8330e4b9e49e7e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.682640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.685127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.703475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8586e0efca44dab8330e4b9e49e7e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.707247 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4236/8494] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:00.718060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-ce64c745-d2f8-4c62-aebe-9c825894171b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8586e0efca44dab8330e4b9e49e7e1'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:00.719379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:00.724394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:00.728462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4259/8495] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:27:00 2022] DELETE /identity/v3/users/3f8586e0efca44dab8330e4b9e49e7e1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:00.748091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298045-98cf-48e1-9b3f-f0ef2ff534f6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:00.793639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:00.853973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:00.856034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.856760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.857230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] PATH_INFO: `/v3/projects/7fb3329dc5894516a5b72611bf0e1c79/users/c21f4b51db634f5db5f2c6c6cbd9d7ec/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.860922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb3329dc5894516a5b72611bf0e1c79, user_id=c21f4b51db634f5db5f2c6c6cbd9d7ec, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:00.865401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:00.891045 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4237/8496] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:00 2022] PUT /identity/v3/projects/7fb3329dc5894516a5b72611bf0e1c79/users/c21f4b51db634f5db5f2c6c6cbd9d7ec/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:00.905642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:00.906159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:00.906452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:00.962518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] MFA Rules not processed for user `c21f4b51db634f5db5f2c6c6cbd9d7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:00.963725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.109177 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4260/8497] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:01.130963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.133371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.254971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b6b5-ff21-4593-84de-2b867180cfce admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:01.260827 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:01.261819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.262239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.262995 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.266113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.268283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.280106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:01.282877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:01.285764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:01.309065 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4238/8498] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:27:01.378095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe5bdb-17ed-40df-9a11-94e3a088ec06 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:01.383693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:01.384833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.385121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.385402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] PATH_INFO: `/v3/projects/706260dbeda34196a51ec7d521009b3b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.386664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706260dbeda34196a51ec7d521009b3b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:01.388666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:01.412467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.425405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de33775-3dca-4bb6-988d-c5a67db12910 service cinder] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:01.431638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:01.432711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.433128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.433592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.436065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.466760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706260dbeda34196a51ec7d521009b3b', 'request_id': 'req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:01.480795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706260dbeda34196a51ec7d521009b3b', 'request_id': 'req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:01.488596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706260dbeda34196a51ec7d521009b3b', 'request_id': 'req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:01.507116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] The token cache is being invalidate because project 706260dbeda34196a51ec7d521009b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:01.507562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:01.509700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-864c36a0-4ac4-4e19-acb7-4ad3a2bb1ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:01.513909 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4261/8499] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:27:01 2022] DELETE /identity/v3/projects/706260dbeda34196a51ec7d521009b3b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:01.522493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.522722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.523007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.550739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:01.552543 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.559301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:01.561608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76db729-8e59-4f6b-98ba-4991d1fc23cf service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:01.586684 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4239/8500] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:01.678518 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4262/8501] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:01.680483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.680778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.681081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.740864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:01.741711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:01.763171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4240/8502] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:01.769345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.782244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aa003-d5fb-4c16-9cc3-a6da12eb417f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:01.789134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:01.790208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.790410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.790786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.791628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:27:01.793462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:01.798695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:01.842262 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4263/8503] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:27:01.844165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.858346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bb4c-bd67-4155-b2f6-f803f766578d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:01.870951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:01.872139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:01.873532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:01.873863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:01.874688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:01.880846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:01.949107 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4241/8504] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:01.950755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:01.970226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5be49-f09e-4278-ae3d-d3dc2fc71b28 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.002250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:02.074468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.075355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.075788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.076196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.076993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.079108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.105544 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4264/8505] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:27:01 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:02.108748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.131539 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab0183-c314-49e9-af6b-e78ffdabe797 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.138055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.138753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.139102 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.139387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.140167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.142185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.166940 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4242/8506] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:02.171650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.186561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adae1a1-a106-46f1-ae45-46bc54f5f5ff admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.191774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.192593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.192989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.193378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.194275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.196062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a706767-fea0-40b8-83b8-a8b1924cc92d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.213335 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4265/8507] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:02.217618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.229961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5743f6e-7e26-472f-b7e3-dd6de969c166 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.236276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.237445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.237732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.238013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] PATH_INFO: `/v3/projects/9a317cd6c2364f3f830b944193156b0c/users/a404774db2cb4c648aa61a136709142e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.262137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a317cd6c2364f3f830b944193156b0c, user_id=a404774db2cb4c648aa61a136709142e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.265144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.275905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:02.288164 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4243/8508] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:02 2022] PUT /identity/v3/projects/9a317cd6c2364f3f830b944193156b0c/users/a404774db2cb4c648aa61a136709142e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:02.298034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.298487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.298487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.362617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] MFA Rules not processed for user `a404774db2cb4c648aa61a136709142e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:02.364036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:02.469474 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4266/8509] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:02.484749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.487013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:02.562761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1035d-0ef9-4d15-b1d6-e04a6a8dfcef admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.566960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.567639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.567924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.568546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.578194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.579692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9c3c1-d672-41af-8761-c5c3046930a1 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.590206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4244/8510] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:02.613065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.698794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c759-ac2a-4c6e-a934-ca2691db896a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:02.707765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:02.709125 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.709713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.710434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] PATH_INFO: `/v3/users/a404774db2cb4c648aa61a136709142e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.714643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a404774db2cb4c648aa61a136709142e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:02.719082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:02.777522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:02.794504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a404774db2cb4c648aa61a136709142e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:02.795278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a404774db2cb4c648aa61a136709142e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:02.812874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a404774db2cb4c648aa61a136709142e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:02.842048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a404774db2cb4c648aa61a136709142e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:02.858194 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a404774db2cb4c648aa61a136709142e'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:02.873362 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4267/8511] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:27:02 2022] DELETE /identity/v3/users/a404774db2cb4c648aa61a136709142e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:02.878638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:02.879015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:02.879986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:02.900205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:02.901639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:02.983648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4245/8512] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:02.994768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:02.996348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:03.070937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f008ba-4bab-462a-b624-d697dae9968e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:03.078190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:03.079212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.080287 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.080985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.102019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:03.104217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f8d18-ed94-4be8-be68-cfeb270459b1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:03.121382 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4268/8513] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:03.493950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:03.495800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:03.510888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0309d-227a-471a-bc08-deda51ad1825 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:03.518285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:03.519388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.524499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.524499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] PATH_INFO: `/v3/projects/9a317cd6c2364f3f830b944193156b0c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.527564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a317cd6c2364f3f830b944193156b0c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:03.528948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:03.602597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a317cd6c2364f3f830b944193156b0c', 'request_id': 'req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:03.612531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a317cd6c2364f3f830b944193156b0c', 'request_id': 'req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:03.623141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a317cd6c2364f3f830b944193156b0c', 'request_id': 'req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:03.643496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] The token cache is being invalidate because project 9a317cd6c2364f3f830b944193156b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:03.643726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:03.644940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7249d4b2-90fb-40a9-9b9b-d56b7ae18683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:03.651043 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4246/8514] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:27:03 2022] DELETE /identity/v3/projects/9a317cd6c2364f3f830b944193156b0c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:03.652901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.653402 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.653500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.677563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:03.679233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:03.765011 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4269/8515] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:03.772772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.773442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.774031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.796048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:03.797443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:03.817652 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4247/8516] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:03.828037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:03.840170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724acd24-c78b-42ef-92ed-a584540b0013 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:03.845538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:03.846497 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.846783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.847060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.847815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:27:03.848247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:03.850127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:03.868199 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4270/8517] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:27:03.869431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:03.879434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b81f5-d115-4d20-b29b-ecafe66ec488 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:03.884602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:03.884899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:03.885185 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:03.885460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:03.886160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:03.888179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:03.912053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:03.928555 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4248/8518] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:27:03 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:03.929544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:03.941225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628607f-0353-4e0c-8e87-294e9ce5fcfa admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:03.986117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:04.015351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:04.016008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.016296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.016612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.018608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:04.019450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:04.047920 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4271/8519] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:27:03 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:04.049212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:04.070452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854ff5-2a4f-4d9d-a66f-6d5fd57e7e73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:04.080055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:04.081599 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.081935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.082168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.082922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:04.085350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:04.105329 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4249/8520] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:04.109433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:04.123960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc055a-5b0e-4d09-b3cd-8ca44fc24b6d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:04.129440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:04.130137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.130423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.130698 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.131441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:04.133169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5ff8-5c9e-42b3-a13a-593db3a86e36 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:04.148538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4272/8521] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:27:04.150034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:04.161346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37f466-d68d-4068-981f-fbf8c9bc4abc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:04.166515 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:04.167457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.167815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.168170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] PATH_INFO: `/v3/projects/1bcc376f050c4e16a0a4e3597b7b8d4d/users/e45a866b09f844deba51275e4ac1f354/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.185523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcc376f050c4e16a0a4e3597b7b8d4d, user_id=e45a866b09f844deba51275e4ac1f354, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:04.188486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:04.205446 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4250/8522] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:04 2022] PUT /identity/v3/projects/1bcc376f050c4e16a0a4e3597b7b8d4d/users/e45a866b09f844deba51275e4ac1f354/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:04.216761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.217270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.217659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.249508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] MFA Rules not processed for user `e45a866b09f844deba51275e4ac1f354`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:04.250628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:04.336456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4273/8523] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:04.348499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:04.350366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:04.425494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e2bc-5e10-4777-862d-dd2b110fec6a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:04.429262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:04.430029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:04.430379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:04.430720 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:04.439478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:04.441194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:04.450538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4251/8524] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:06.045829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:06.047450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:06.109938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9229bcc-c334-4ee2-b4f8-4ccda72c7d65 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:06.113893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:06.114553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:06.114835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:06.115109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:06.116947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:06.175490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:06.195745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:06.197253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aae91-3456-4d2b-8c3b-98d72223a78c service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:06.211946 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4274/8525] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:07.926742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:07.928228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:07.995285 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da361cdf-1f68-4f77-9f57-4c387e5cf8b4 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:08.000107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:08.001043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:08.001336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:08.001610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] PATH_INFO: `/v3/users/e9184cba1bfd4cb4871f29c9bdd748f2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:08.003115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9184cba1bfd4cb4871f29c9bdd748f2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:08.005167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:08.054224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9184cba1bfd4cb4871f29c9bdd748f2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.061440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9184cba1bfd4cb4871f29c9bdd748f2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.072377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:08.075498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9184cba1bfd4cb4871f29c9bdd748f2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.076507 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9184cba1bfd4cb4871f29c9bdd748f2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.077479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9184cba1bfd4cb4871f29c9bdd748f2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.091009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4252/8526] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:27:07 2022] DELETE /identity/v3/users/e9184cba1bfd4cb4871f29c9bdd748f2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:08.095927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:08.096473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:08.096563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:08.114593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:08.115732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:08.176134 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4275/8527] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:08.188942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:08.190549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:08.251928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876339b-b408-4e41-a20c-43588469a359 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:08.256338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:08.257042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:08.257326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:08.257609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:08.267725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:08.269248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:08.279513 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4253/8528] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:08.581015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:08.582670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:08.609745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a462f-806a-428e-9510-776db34e41a1 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:08.615026 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:08.616507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:08.616753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:08.617051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] PATH_INFO: `/v3/projects/8cab14c1e01a4a81822207adb25a5847` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:08.618275 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cab14c1e01a4a81822207adb25a5847)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:08.620179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:08.670993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cab14c1e01a4a81822207adb25a5847', 'request_id': 'req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.679435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cab14c1e01a4a81822207adb25a5847', 'request_id': 'req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.685568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cab14c1e01a4a81822207adb25a5847', 'request_id': 'req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.697535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] The token cache is being invalidate because project 8cab14c1e01a4a81822207adb25a5847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:08.698048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.699988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.701647 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4276/8529] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:27:08 2022] DELETE /identity/v3/projects/8cab14c1e01a4a81822207adb25a5847 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:08.707832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:08.718981 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d93e-2850-4180-8f9f-d2531748f3e3 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:08.777262 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:08.778174 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:08.778457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:08.779053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] PATH_INFO: `/v3/users/c21f4b51db634f5db5f2c6c6cbd9d7ec` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:08.779934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21f4b51db634f5db5f2c6c6cbd9d7ec)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:08.781968 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:08.839130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21f4b51db634f5db5f2c6c6cbd9d7ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.847272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21f4b51db634f5db5f2c6c6cbd9d7ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.859692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21f4b51db634f5db5f2c6c6cbd9d7ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.860292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21f4b51db634f5db5f2c6c6cbd9d7ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.860937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-e5f8a90f-12eb-4e93-a499-089ebd9502a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21f4b51db634f5db5f2c6c6cbd9d7ec'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:08.873627 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4254/8530] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:27:08 2022] DELETE /identity/v3/users/c21f4b51db634f5db5f2c6c6cbd9d7ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:09.161035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.162634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:09.181794 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aacdf4-e59d-4acc-9a3c-b62fb96cd71b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.243047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.243938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.244230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.244553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] PATH_INFO: `/v3/projects/7fb3329dc5894516a5b72611bf0e1c79` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.245832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb3329dc5894516a5b72611bf0e1c79)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.247771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.264589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:09.306241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb3329dc5894516a5b72611bf0e1c79', 'request_id': 'req-5a7d4a47-8176-42ed-9647-dcfcead4dd60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:09.313873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb3329dc5894516a5b72611bf0e1c79', 'request_id': 'req-5a7d4a47-8176-42ed-9647-dcfcead4dd60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:09.319409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb3329dc5894516a5b72611bf0e1c79', 'request_id': 'req-5a7d4a47-8176-42ed-9647-dcfcead4dd60'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:09.330994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] The token cache is being invalidate because project 7fb3329dc5894516a5b72611bf0e1c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:09.331284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:09.331993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5a7d4a47-8176-42ed-9647-dcfcead4dd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:09.333895 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4277/8531] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:27:09 2022] DELETE /identity/v3/projects/7fb3329dc5894516a5b72611bf0e1c79 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:09.339311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.339776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.339887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.353692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:09.360767 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:09.362764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:09.430563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4255/8532] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:09.438882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.439218 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.439482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.463861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:09.465167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:09.475088 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4278/8533] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:09.479502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.490273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690411e-0d3b-4b33-bc9a-3c3ee772aef6 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.497407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.498089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.498375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.498644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.499613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:27:09.499828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.501549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.520317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.524688 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4256/8534] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:27:09.532403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdcae-6a81-49fb-b262-5f0ef5754f62 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.539651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.540792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.541080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.541403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.542160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.545014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.589855 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4279/8535] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:27:09 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:09.594797 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.606879 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2547-2355-4281-9574-1c4e3c7c875f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.701650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.702345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.702626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.702900 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.703594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.705626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.728001 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4257/8536] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:27:09 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:09.732167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.745825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dbfa-8327-45f5-8e8c-597025e7492d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.751630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.752311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.752731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.753008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.764860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.766985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.780414 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4280/8537] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:27:09.786857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.800248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283df7-ef7e-46ca-88f4-8ebdc1775f95 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.813616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.814315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.814600 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.814877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.815709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.819354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72930198-df87-4041-99c9-9cc766b39c9d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.841739 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4258/8538] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:09.846551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:09.859361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610cdb7-3461-43b5-b847-23dff1a9e335 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:09.866779 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:09.867679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.867944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.868220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] PATH_INFO: `/v3/projects/b43e0900925e4794b3be4da0a844654f/users/15a1ef42555447b2b55b74917e926040/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.888865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43e0900925e4794b3be4da0a844654f, user_id=15a1ef42555447b2b55b74917e926040, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:09.891486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:09.910246 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4281/8539] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:09 2022] PUT /identity/v3/projects/b43e0900925e4794b3be4da0a844654f/users/15a1ef42555447b2b55b74917e926040/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:27:09.922443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dc58f-1369-4ba5-b03f-5743d9215fec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:09.922832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dc58f-1369-4ba5-b03f-5743d9215fec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:09.923238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dc58f-1369-4ba5-b03f-5743d9215fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:09.954795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-227dc58f-1369-4ba5-b03f-5743d9215fec None None] MFA Rules not processed for user `15a1ef42555447b2b55b74917e926040`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:09.956732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-227dc58f-1369-4ba5-b03f-5743d9215fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:10.054209 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4259/8540] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:10.066601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:10.068375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:10.141809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e9a7-5b35-49cb-aadb-7d32606c1331 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:10.147687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:10.148728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:10.149222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:10.149660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:10.160088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:10.161568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:10.172038 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4282/8541] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:10.738831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8508d-955a-4ed2-93d7-ab63c964dd8f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:10.739267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8508d-955a-4ed2-93d7-ab63c964dd8f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:10.739406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8508d-955a-4ed2-93d7-ab63c964dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:10.745780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:10.760149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a3e8508d-955a-4ed2-93d7-ab63c964dd8f None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:10.761404 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a3e8508d-955a-4ed2-93d7-ab63c964dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:10.817074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4260/8542] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:10.866410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:10.867998 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:10.918742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:10.948051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4c348-19ce-43dd-ae7f-5f97ac5894d4 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:10.954536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:10.955206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:10.955493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:10.955812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:10.965145 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:10.966707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca335c9-6481-4c48-ad82-e84c3dcff67a service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:10.975263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4283/8543] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:11.550681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:11.551420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:11.551854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:11.580935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] MFA Rules not processed for user `15a1ef42555447b2b55b74917e926040`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:11.582319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:11.592745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4261/8544] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:16.356801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:16.357357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:16.358877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:16.387439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:16.389226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:16.520508 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4284/8545] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:17.878083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:17.879545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:17.944253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ff33a-87d8-4f72-a0ab-13ac3b485eb9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:17.948685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:17.949350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:17.949637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:17.949915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:17.951818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:17.965293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:17.966758 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9d560-8747-4004-b0fb-ff5d76115ac3 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:17.978477 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4262/8546] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:20.621489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:20.624229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:20.731884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b31c7-c072-4ab4-a3aa-889ce01745d8 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:20.737844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:20.738824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:20.739111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:20.739508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] PATH_INFO: `/v3/users/e45a866b09f844deba51275e4ac1f354` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:20.741629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45a866b09f844deba51275e4ac1f354)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:20.743751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:20.818457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45a866b09f844deba51275e4ac1f354'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:20.818457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45a866b09f844deba51275e4ac1f354'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:20.832259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45a866b09f844deba51275e4ac1f354'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:20.848247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45a866b09f844deba51275e4ac1f354'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:20.854348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:20.856413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45a866b09f844deba51275e4ac1f354'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:20.863782 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4285/8547] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:27:20 2022] DELETE /identity/v3/users/e45a866b09f844deba51275e4ac1f354 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:20.868646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:20.869118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:20.869118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:20.889422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:20.890660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:20.960298 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4263/8548] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:20.969788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:20.971374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:21.098155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7051d-b2b2-4ef8-9e25-a8080be787e6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.107037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.107841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.108376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.108686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.139401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:21.144863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea1bb-fc5f-4694-a404-578dc7568447 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:21.180381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4286/8549] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:21.534447 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:21.539891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:21.560287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ce67-307e-4fdb-9d28-1e296c1d3150 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.565124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.566488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.566754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.567026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] PATH_INFO: `/v3/projects/1bcc376f050c4e16a0a4e3597b7b8d4d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.568324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcc376f050c4e16a0a4e3597b7b8d4d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:21.570288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:21.615419 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:21.625346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcc376f050c4e16a0a4e3597b7b8d4d', 'request_id': 'req-f563d601-01b3-4484-b1e5-7ab5d43e2c97'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:21.635891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcc376f050c4e16a0a4e3597b7b8d4d', 'request_id': 'req-f563d601-01b3-4484-b1e5-7ab5d43e2c97'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:21.643328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcc376f050c4e16a0a4e3597b7b8d4d', 'request_id': 'req-f563d601-01b3-4484-b1e5-7ab5d43e2c97'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:21.654883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] The token cache is being invalidate because project 1bcc376f050c4e16a0a4e3597b7b8d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:27:21.655180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:21.655848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-f563d601-01b3-4484-b1e5-7ab5d43e2c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:27:21.657560 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4264/8550] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:27:21 2022] DELETE /identity/v3/projects/1bcc376f050c4e16a0a4e3597b7b8d4d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:21.662821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.663557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.663557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.681433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:21.682659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:21.745091 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4287/8551] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:27:21.753427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.753746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.754030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.774479 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:21.775945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:21.784504 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4265/8552] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:21.788788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:21.799039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5260-c21d-47d7-ae34-9fedc49cb2d7 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.804070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.804625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.804908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.805180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.805910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:27:21.806216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:21.807828 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:21.822233 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4288/8553] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:27:21.827652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:21.837320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b404fe-a8b7-4a13-a786-e208313b603b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.842172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.842839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.843653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.843653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.844090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:21.846207 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:21.875236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4266/8554] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:21.879505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:21.891922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c666e-b5d4-4cb2-a486-2d8cfe271022 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.951862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.952594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:21.952884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:21.953161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:21.953853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:21.955956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:21.978733 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4289/8555] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:27:21 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:21.982970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:21.994301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbaeb4-101d-44c9-9450-696354f75c02 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:21.999169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:21.999904 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:22.000209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:22.000499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:22.001224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:22.002844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:22.014172 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4267/8556] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:22.018551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:22.030470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7cdc-6b57-4bd9-82a3-f0fd55575a91 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:22.036023 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:22.036787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:22.037060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:22.037319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:22.038058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:22.039824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f6450-558e-47b7-9e29-76fc6a3ab060 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:22.051792 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4290/8557] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:22.055910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:22.067096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61b49-3dc2-40d4-bb44-68e44811aa8d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:22.072169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:22.073587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:22.073950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:22.075401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] PATH_INFO: `/v3/projects/039691ff93174f54aaaa13770a444aa2/users/f7ea2397650748afa9edf0864829c434/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:22.091668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039691ff93174f54aaaa13770a444aa2, user_id=f7ea2397650748afa9edf0864829c434, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:22.094794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:22.112512 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4268/8558] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:22 2022] PUT /identity/v3/projects/039691ff93174f54aaaa13770a444aa2/users/f7ea2397650748afa9edf0864829c434/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:22.116066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44270a-8228-4891-9dfa-0e86b558afb9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:22.116362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44270a-8228-4891-9dfa-0e86b558afb9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:22.116670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44270a-8228-4891-9dfa-0e86b558afb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:22.124621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:22.139610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9b44270a-8228-4891-9dfa-0e86b558afb9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:22.140838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9b44270a-8228-4891-9dfa-0e86b558afb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:22.211722 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4291/8559] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:22.221748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:22.223902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:22.287093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f3b8-4122-4636-8ba6-aa4527faf738 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:22.293024 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:22.293980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:22.294862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:22.295442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:22.309197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:22.310800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:22.322354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4269/8560] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:26.758984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:26.758984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:26.758984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:26.793470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] MFA Rules not processed for user `f7ea2397650748afa9edf0864829c434`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:26.793470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:26.876334 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4292/8561] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:27:26.880743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:26.892957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db0ec4-5e96-4e21-bb7a-79acd6e7b93b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:26.909557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:26.910503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:26.910610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:26.911089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:26.912798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:26.914286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:26.970994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4270/8562] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:27:26 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:27:26.974879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:26.989454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dc562-b92b-420f-ab61-dc0e04a47455 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:27.076813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:27.077534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:27.077816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:27.078098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:27.078819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:27.080859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:27.113090 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4293/8563] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:27:26 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:27:27.117431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:27.134830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e64b3-6add-4155-8c02-132d919636b7 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:27.139499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:27.140451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:27.140749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:27.141036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:27.142271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:27.144143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:27.160622 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4271/8564] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:27.163368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:27.174846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da65f-0fe5-4841-a59a-95b8eb5f0386 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:27.179596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:27.180558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:27.180850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:27.181131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] PATH_INFO: `/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e/users/0012741fcfdc484aab3d6f0bc2595f25/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:27.197923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bf9f9abb9e4e128ea77d29ee63c66e, user_id=0012741fcfdc484aab3d6f0bc2595f25, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:27.201094 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:27.213066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:27.220475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4294/8565] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:27 2022] PUT /identity/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e/users/0012741fcfdc484aab3d6f0bc2595f25/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:27:27.223013 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:27.234964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413f4bf-2a1c-475c-8d2a-cafd994cee8e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:27.277783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:27.309650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:27.310268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:27.310559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:27.310839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:27.311575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:27.313517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:27.327892 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4272/8566] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:27:27.330326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:27.341605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f820-35bd-45fe-b3ed-cfc6757a0e41 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:27.346517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:27.347428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:27.347753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:27.348035 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] PATH_INFO: `/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e/users/0012741fcfdc484aab3d6f0bc2595f25/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:27.350097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bf9f9abb9e4e128ea77d29ee63c66e, user_id=0012741fcfdc484aab3d6f0bc2595f25, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:27.352850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03ee35-bac3-4320-9e4f-00f7a940005a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:27.364509 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4295/8567] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:27:27 2022] PUT /identity/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e/users/0012741fcfdc484aab3d6f0bc2595f25/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:27:31.383216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:31.501075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fea090-9c3b-4508-b3e0-1c05fe1541e2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:31.586614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:31.588036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:31.589304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:31.591281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:31.596640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:31.701961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:31.704938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:31.733455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4273/8568] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:33.922432 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:33.923206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:33.923206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:33.978647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] MFA Rules not processed for user `0012741fcfdc484aab3d6f0bc2595f25`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:33.979961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:34.071552 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4296/8569] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:27:34.083791 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:34.085816 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:34.138530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:34.160172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039075-0316-4577-ac7c-c4b52f5cb313 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:34.165188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:34.165998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:34.166284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:34.166559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:34.274008 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:34.275520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a442e-5ad4-44a3-9b2a-db0333d0da01 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:34.285530 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4274/8570] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:44.067240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:44.281063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=32 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:45.997198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:27:46.011819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c07a0-123f-47cf-81b9-f30624def21a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:27:46.015875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:27:46.016730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:46.017087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:46.017425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:46.019396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:46.033413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:27:46.035050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:27:46.049192 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4297/8571] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:27:56.041215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:58.555328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:27:58.555888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:27:58.555888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:27:58.582087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] MFA Rules not processed for user `f7ea2397650748afa9edf0864829c434`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:27:58.583690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:27:58.595866 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4275/8572] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:02.107202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:02.108978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:02.125288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cffa9-a329-499c-a59c-3b6faff5bebd service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:02.130074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:02.130934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:02.131146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:02.131610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:02.133517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:02.151669 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:02.153727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:02.184853 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4298/8573] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:08.573189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:10.777825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:10.793458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a51bd-5da0-4fce-b67d-a8c50aea4067 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:10.797166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:10.797829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:10.798118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:10.798397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:10.807960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:10.809538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a056373-ce52-4f4c-b70a-68d1bfc65f4d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:10.819617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4276/8574] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:12.060010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:12.061981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:12.141676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9f62a-0e54-4b78-a635-396a5f7f67da service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:12.147104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:12.148009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:12.148293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:12.148891 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] PATH_INFO: `/v3/users/15a1ef42555447b2b55b74917e926040` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:12.149926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a1ef42555447b2b55b74917e926040)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:12.151927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:12.209095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a1ef42555447b2b55b74917e926040'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:12.209923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a1ef42555447b2b55b74917e926040'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:12.217859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a1ef42555447b2b55b74917e926040'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:12.233389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a1ef42555447b2b55b74917e926040'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:12.242037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a1ef42555447b2b55b74917e926040'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:12.250596 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4299/8575] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:12 2022] DELETE /identity/v3/users/15a1ef42555447b2b55b74917e926040 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:28:12.256087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:12.257191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:12.257586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:12.279477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:12.281016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:12.353447 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4277/8576] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:12.365376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:12.367193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:12.435738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72070e-ce4c-49d5-ab08-3d907c3b29d7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:12.439747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:12.440531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:12.440827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:12.441097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:12.452344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:12.453887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2260-3ca7-4f1f-bfc6-b112399d7e21 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:12.466110 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4300/8577] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:12.875718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:12.877373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:12.902910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16234acb-ac66-4175-b8a7-ee63053c2ea8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:12.911453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:12.912882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:12.913325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:12.913750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] PATH_INFO: `/v3/projects/b43e0900925e4794b3be4da0a844654f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:12.917104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43e0900925e4794b3be4da0a844654f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:12.921265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.002499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43e0900925e4794b3be4da0a844654f', 'request_id': 'req-02114ba0-a3d9-45e4-8cb4-473390d37f2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:13.015213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43e0900925e4794b3be4da0a844654f', 'request_id': 'req-02114ba0-a3d9-45e4-8cb4-473390d37f2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:13.033882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43e0900925e4794b3be4da0a844654f', 'request_id': 'req-02114ba0-a3d9-45e4-8cb4-473390d37f2b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:13.059182 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] The token cache is being invalidate because project b43e0900925e4794b3be4da0a844654f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:13.059609 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:13.060889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-02114ba0-a3d9-45e4-8cb4-473390d37f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:13.064385 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4278/8578] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:12 2022] DELETE /identity/v3/projects/b43e0900925e4794b3be4da0a844654f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:13.072839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.074113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.074421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.109659 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:13.111099 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:13.117668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:13.225308 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4301/8579] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:13.233805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.234297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.234550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.262705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:13.265459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:13.276603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4279/8580] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:13.281268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.294436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc27a9-cf24-4001-8c3e-297274d8eeaf None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.301423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.302585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.302927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.303149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.303966 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:28:13.304271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.306583 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.325681 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4302/8581] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:28:13.330089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.343812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003cff-ebe3-49e5-a63b-103610b25f9b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.353944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.355490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.356189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.356519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.357909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.360320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.420326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.420884 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4280/8582] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:13 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:13.433425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9e3a-a8c3-419d-92eb-387ef7a70a8c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.511252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.512301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.512703 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.513049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.513910 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.517160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.550323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.551633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4303/8583] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:13 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:13.565744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18770b9-5f8a-46e3-a0b3-83b2537b6012 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.572706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.573787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.574033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.574230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.575017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.576846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.591264 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4281/8584] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:28:13.595756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.607175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341bfb-f191-4030-ae20-c416c8d68b4a admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.611937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.612672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.614840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.614840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.614840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.615813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50111e-9e0b-4f93-8d53-9bbd369e2a87 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.629665 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4304/8585] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:13.633062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.645677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390a481-4e7d-4804-b723-2698fc75fa48 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.652716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.654388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.654681 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.654965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] PATH_INFO: `/v3/projects/d63f351e447949f18301dac1e599ecaf/users/c03893d97aca4b5b8b319f02ec4851da/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.673351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63f351e447949f18301dac1e599ecaf, user_id=c03893d97aca4b5b8b319f02ec4851da, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.676763 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.695310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4282/8586] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:13 2022] PUT /identity/v3/projects/d63f351e447949f18301dac1e599ecaf/users/c03893d97aca4b5b8b319f02ec4851da/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:13.708493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.708954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.709633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.761573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] MFA Rules not processed for user `c03893d97aca4b5b8b319f02ec4851da`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:13.762762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:13.850586 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4305/8587] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:13.862973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:13.865030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:13.877722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:13.951646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe05e6-5dc8-4758-b538-ee38ddbb9cb8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:13.957259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:13.959041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:13.959413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:13.959756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:13.973140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:13.975126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40bab0-9e4e-488b-b4f3-ecdfea485edc service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:13.990639 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4283/8588] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:16.627927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:16.634622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:16.708983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12c46d-047a-4146-a1a3-7c415d84a977 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:16.714548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:16.715549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:16.715857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:16.716163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] PATH_INFO: `/v3/users/c03893d97aca4b5b8b319f02ec4851da` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:16.717594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03893d97aca4b5b8b319f02ec4851da)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:16.719645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:16.779068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03893d97aca4b5b8b319f02ec4851da'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:16.779764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03893d97aca4b5b8b319f02ec4851da'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:16.790544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03893d97aca4b5b8b319f02ec4851da'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:16.803850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03893d97aca4b5b8b319f02ec4851da'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:16.811456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03893d97aca4b5b8b319f02ec4851da'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:16.818249 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4306/8589] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:16 2022] DELETE /identity/v3/users/c03893d97aca4b5b8b319f02ec4851da => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:16.824119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:16.825050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:16.825949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:16.849058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:16.850496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:16.918464 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4284/8590] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:16.929077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:16.930611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:17.002687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0216-cacf-499e-86e0-c3cdfcf745e4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.008033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.008766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.009072 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.009438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.020796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.022074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e061-1ef9-49cf-9195-2d5873e98937 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.034711 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4307/8591] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:17.343886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.345394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:17.360485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb8fb-bb7d-4734-856e-612199724cad None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.365944 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.366667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.366966 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.367295 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] PATH_INFO: `/v3/projects/d63f351e447949f18301dac1e599ecaf` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.368729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63f351e447949f18301dac1e599ecaf)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.370792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.426143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63f351e447949f18301dac1e599ecaf', 'request_id': 'req-4645dee2-bfc2-416a-8611-739234c15ef4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:17.434578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63f351e447949f18301dac1e599ecaf', 'request_id': 'req-4645dee2-bfc2-416a-8611-739234c15ef4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:17.440785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63f351e447949f18301dac1e599ecaf', 'request_id': 'req-4645dee2-bfc2-416a-8611-739234c15ef4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:17.453409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] The token cache is being invalidate because project d63f351e447949f18301dac1e599ecaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:17.453743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:17.455041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4645dee2-bfc2-416a-8611-739234c15ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:17.456711 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4285/8592] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:17 2022] DELETE /identity/v3/projects/d63f351e447949f18301dac1e599ecaf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:17.462120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.462499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.462895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.481848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:17.483135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:17.505455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:17.551036 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4308/8593] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:28:17.559466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.559761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.560041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.580290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:17.581550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:17.590366 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4286/8594] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:17.594905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.606007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87d08-dc2e-41e4-b645-8852a76e770b None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.611037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.611725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.612032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.612333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.613128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:28:17.613438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.615147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.629210 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4309/8595] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:28:17.633831 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.643992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a6d2-7ed7-4ed8-973f-0786bdc0b1e8 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.649833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.650602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.650994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.651408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.652234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.654355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.682678 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4287/8596] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:17 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:17.686963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.699769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a3ee6-de94-45fd-bacb-6f3f047e758d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.764186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.765016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.765384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.765720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.766407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.768458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.795253 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4310/8597] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:17 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:17.796580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.808865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:17.809363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba6d7-4d8c-483d-9ad0-22b49c6ec42a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.817329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.818434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.818814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.819148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.820086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.823785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.837029 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4288/8598] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:17.840873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.852849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e0232-6a14-4f1a-b01e-22d4b5e340a5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.858723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.859410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.859696 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.859978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.860739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.862425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c49bba-2903-4abf-9f0e-7790b79397dc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.873771 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4311/8599] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:28:17.878853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:17.891790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11f51-5c9f-44f7-b6bb-b285a4672cc0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:17.901509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:17.902468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.902754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.903075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] PATH_INFO: `/v3/projects/07c9d809d528495aa21eb19f29cd90fa/users/25a48ce52b8e4f609a3526d0cdbd5560/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.920901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c9d809d528495aa21eb19f29cd90fa, user_id=25a48ce52b8e4f609a3526d0cdbd5560, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:17.923854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:17.938859 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4289/8600] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:17 2022] PUT /identity/v3/projects/07c9d809d528495aa21eb19f29cd90fa/users/25a48ce52b8e4f609a3526d0cdbd5560/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:17.951490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:17.951867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:17.952189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:17.981993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] MFA Rules not processed for user `25a48ce52b8e4f609a3526d0cdbd5560`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:17.983230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:18.058151 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4312/8601] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:18.070188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:18.072069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:18.142971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc45cc-aa3c-449e-8698-2360495730d2 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:18.147175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:18.147870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:18.148155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:18.148503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:18.158362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:18.160077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb816a-059f-499e-940b-2efadb1ea4e9 service cinder] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:18.170476 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4290/8602] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:18.199840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:18.241411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:18.285772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef9cbe-4f1d-4189-b360-a5705dbd61c0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:18.290658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:18.291560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:18.291895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:18.292181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] PATH_INFO: `/v3/users/25a48ce52b8e4f609a3526d0cdbd5560` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:18.293637 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a48ce52b8e4f609a3526d0cdbd5560)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:18.295623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:18.355709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a48ce52b8e4f609a3526d0cdbd5560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.356523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a48ce52b8e4f609a3526d0cdbd5560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.364933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a48ce52b8e4f609a3526d0cdbd5560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.377869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a48ce52b8e4f609a3526d0cdbd5560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.385533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a48ce52b8e4f609a3526d0cdbd5560'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.392675 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4313/8603] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:18 2022] DELETE /identity/v3/users/25a48ce52b8e4f609a3526d0cdbd5560 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:28:18.398125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:18.398418 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:18.398698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:18.416717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:18.417937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:18.483392 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4291/8604] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:18.494651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:18.495972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:18.562371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addf1d-7cb3-4f47-8ec1-a380f8e7edbd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:18.567091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:18.567975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:18.568239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:18.568704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:18.579486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:18.581246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb1856-752a-4fce-865b-717118bacf59 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:18.592316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4314/8605] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:28:18.878641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:18.880125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:18.893991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba9892-1dbe-4b4c-be21-de87bd5f8f09 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:18.900041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:18.900962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:18.901254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:18.901556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] PATH_INFO: `/v3/projects/07c9d809d528495aa21eb19f29cd90fa` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:18.902865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c9d809d528495aa21eb19f29cd90fa)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:18.905190 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:18.959133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c9d809d528495aa21eb19f29cd90fa', 'request_id': 'req-97ca06a3-bc45-44ed-a5bd-6e686ca89786'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.967345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c9d809d528495aa21eb19f29cd90fa', 'request_id': 'req-97ca06a3-bc45-44ed-a5bd-6e686ca89786'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.975267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c9d809d528495aa21eb19f29cd90fa', 'request_id': 'req-97ca06a3-bc45-44ed-a5bd-6e686ca89786'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.979920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:18.993100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] The token cache is being invalidate because project 07c9d809d528495aa21eb19f29cd90fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:18.993870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.995048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-97ca06a3-bc45-44ed-a5bd-6e686ca89786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:18.997366 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4292/8606] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:18 2022] DELETE /identity/v3/projects/07c9d809d528495aa21eb19f29cd90fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:19.002531 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.002991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.003308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.026069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:19.028069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:19.072498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:19.094192 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4315/8607] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:19.102343 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.102680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.103089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.122694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:19.123918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:19.132566 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4293/8608] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:19.137008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.147144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc6d2c-a082-494c-9965-83f5727becbb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.152184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.152960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.153271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.153529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.154297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:28:19.154683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.156298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.169361 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4316/8609] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:28:19.173951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.184750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7b31-2c9b-4999-bd0b-5a75403e5a1c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.190084 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.190844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.191253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.191572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.192576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.195113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.227046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4294/8610] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:19 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:19.234315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.250454 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d171d-713b-4f0c-b99b-436bd861acb4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.317360 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.318047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.318382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.318664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.319327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.321398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.349545 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4317/8611] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:19 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:19.350920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.363387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1fce-c986-46fc-b474-e11c66d8963e admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.369801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.370591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.370893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.371177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.372270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.374177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.387289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4295/8612] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:19.391748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.404345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a75e-b0a4-494e-bff3-4ea5a260c87e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.410077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.410832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.411304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.411650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.412816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.414665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89469c9a-cb9e-4dbc-8ebd-3ff049a45155 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.426963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4318/8613] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:19.431754 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.449798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d22bb1-49bb-4dc1-8b0f-c660e61a3b18 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.455220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.456266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.456649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.457003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] PATH_INFO: `/v3/projects/0600178085744eb3925c615c9ee732c2/users/721e354ea8204dd7a77a6d01e9ca520b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.481943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0600178085744eb3925c615c9ee732c2, user_id=721e354ea8204dd7a77a6d01e9ca520b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.485977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.502709 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4296/8614] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:19 2022] PUT /identity/v3/projects/0600178085744eb3925c615c9ee732c2/users/721e354ea8204dd7a77a6d01e9ca520b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:28:19.507868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cfd-5f2a-437b-a84f-a2c426b1ef79 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.508150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cfd-5f2a-437b-a84f-a2c426b1ef79 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.508468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cfd-5f2a-437b-a84f-a2c426b1ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.528020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2ad15cfd-5f2a-437b-a84f-a2c426b1ef79 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:19.529303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2ad15cfd-5f2a-437b-a84f-a2c426b1ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:19.595827 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4319/8615] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:19.607321 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:19.609975 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:19.677644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291002f-255c-4c9b-a1a2-fd4d151f5dc1 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:19.682687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:19.683395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:19.683748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:19.684029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:19.694424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:19.695923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:19.707947 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4297/8616] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:20.402964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.403504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.403689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.441641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] MFA Rules not processed for user `721e354ea8204dd7a77a6d01e9ca520b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:20.443838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:20.496970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:20.530064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4320/8617] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:20.535064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.546488 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37de8f3-62e6-44ef-a3e2-bb6bf08fd190 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.552614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.553423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.553864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.554121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.554824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.556942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.591000 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4298/8618] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:20 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:20.596295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.611050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e93e-66f5-45da-b718-f8c71030e85a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.671906 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.672626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.672918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.673207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.673909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.675829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.704565 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4321/8619] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:20 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:20.709153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.721593 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af11-eca0-454a-bbaf-25038f55b97d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.730472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.731208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.734896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.735377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.736224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.738030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.755277 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4299/8620] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:20.756791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.768764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab5ed-3171-4ce4-97bb-052e2a9fcde9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.773947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.775157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.775444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.775866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] PATH_INFO: `/v3/projects/2befb1af715e435ca598651c3e0f3960/users/6faab55d2bce417ba37a1144802c5259/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.792609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2befb1af715e435ca598651c3e0f3960, user_id=6faab55d2bce417ba37a1144802c5259, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.795768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.811998 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4322/8621] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:20 2022] PUT /identity/v3/projects/2befb1af715e435ca598651c3e0f3960/users/6faab55d2bce417ba37a1144802c5259/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:20.818877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.833453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a2cbb-f751-48e2-ba08-957fd49925ca admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.900320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.900959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.901243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.901524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.902250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.903937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6eea4-080a-46a0-b5cb-a150d7ef595f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.906133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:20.918139 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4300/8622] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:20.922941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:20.934108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21e034-c1da-4d4e-a765-e34ad7344776 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:20.939954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:20.940833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:20.941110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:20.941388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] PATH_INFO: `/v3/projects/2befb1af715e435ca598651c3e0f3960/users/6faab55d2bce417ba37a1144802c5259/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:20.943565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2befb1af715e435ca598651c3e0f3960, user_id=6faab55d2bce417ba37a1144802c5259, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:20.946335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eadc9-4b70-4a3f-af91-b873a4b72e1b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:20.958488 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4323/8623] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:20 2022] PUT /identity/v3/projects/2befb1af715e435ca598651c3e0f3960/users/6faab55d2bce417ba37a1144802c5259/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:21.601415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:21.601957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:21.602197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:21.632772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] MFA Rules not processed for user `6faab55d2bce417ba37a1144802c5259`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:21.634039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:21.723405 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4301/8624] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:21.729091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc91d7-71e9-4802-9c7c-ea77117a7a98 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:21.729623 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc91d7-71e9-4802-9c7c-ea77117a7a98 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:21.729731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc91d7-71e9-4802-9c7c-ea77117a7a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:21.748717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-29bc91d7-71e9-4802-9c7c-ea77117a7a98 None None] MFA Rules not processed for user `721e354ea8204dd7a77a6d01e9ca520b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:21.749936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-29bc91d7-71e9-4802-9c7c-ea77117a7a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:21.809987 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4324/8625] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:21.822592 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:21.824166 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:21.902440 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2045b9-06cc-43e5-bd0e-b7b36459534f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:21.909012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:21.909706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:21.909993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:21.910269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:21.919503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:21.921717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:21.931603 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4302/8626] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:27.746714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:27.748455 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:27.748976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:27.773872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] MFA Rules not processed for user `61f7e0c206e349a196bbd2c6562ee0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:27.775568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:27.825090 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:27.863898 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4325/8627] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:28:31.624187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:31.626749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:31.709129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2b17f-99d7-4ca8-8aad-770c4bc9a442 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:31.729400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:31.730314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:31.732112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:31.732585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:31.741826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:31.793818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:31.795138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:31.834294 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4303/8628] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:37.846647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=8 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:41.813490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=75 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:44.122294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:44.123833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:44.208887 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd03765-9412-45ca-876f-0412a829e32f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:44.217265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:44.218188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:44.218544 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:44.218849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:44.221985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:44.240904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:44.243159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:44.260142 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4326/8629] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:49.539210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:49.606973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736725f-1dda-4b2d-b6d6-e058f777f49b service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:49.612439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:49.612887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:49.613194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:49.613472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] PATH_INFO: `/v3/users/721e354ea8204dd7a77a6d01e9ca520b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:49.614812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721e354ea8204dd7a77a6d01e9ca520b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:49.616846 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:49.667638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721e354ea8204dd7a77a6d01e9ca520b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:49.674878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721e354ea8204dd7a77a6d01e9ca520b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:49.687296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721e354ea8204dd7a77a6d01e9ca520b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:49.687945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721e354ea8204dd7a77a6d01e9ca520b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:49.688667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721e354ea8204dd7a77a6d01e9ca520b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:49.701481 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4304/8630] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:49 2022] DELETE /identity/v3/users/721e354ea8204dd7a77a6d01e9ca520b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:49.887230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:49.899315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f8b3-dfda-4afb-8f22-8218b47acc27 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:49.965235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:49.966113 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:49.966398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:49.966677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] PATH_INFO: `/v3/projects/0600178085744eb3925c615c9ee732c2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:49.967876 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0600178085744eb3925c615c9ee732c2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:49.969860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:50.017597 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0600178085744eb3925c615c9ee732c2', 'request_id': 'req-3e8189c8-11ec-451e-9195-6529325deda6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.026086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0600178085744eb3925c615c9ee732c2', 'request_id': 'req-3e8189c8-11ec-451e-9195-6529325deda6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.031706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0600178085744eb3925c615c9ee732c2', 'request_id': 'req-3e8189c8-11ec-451e-9195-6529325deda6'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.043148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] The token cache is being invalidate because project 0600178085744eb3925c615c9ee732c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:50.043438 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.044138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.045772 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4327/8631] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:49 2022] DELETE /identity/v3/projects/0600178085744eb3925c615c9ee732c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:50.050168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:50.051658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:50.065673 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729bb6c-39fb-45df-85ff-b3d86cae3dc5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:50.133735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:50.134658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.134942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.135222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] PATH_INFO: `/v3/users/6faab55d2bce417ba37a1144802c5259` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.136542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faab55d2bce417ba37a1144802c5259)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:50.138735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:50.167568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:50.200992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faab55d2bce417ba37a1144802c5259'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.210538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faab55d2bce417ba37a1144802c5259'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.227498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faab55d2bce417ba37a1144802c5259'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.228251 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faab55d2bce417ba37a1144802c5259'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.228897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-96b94603-863b-404c-bf6d-0d1115ad171b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faab55d2bce417ba37a1144802c5259'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.247619 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4305/8632] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:50 2022] DELETE /identity/v3/users/6faab55d2bce417ba37a1144802c5259 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:50.456054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:50.462388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:50.485422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8189c8-11ec-451e-9195-6529325deda6 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:50.506604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:50.559311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:50.560261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.560551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.560975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] PATH_INFO: `/v3/projects/2befb1af715e435ca598651c3e0f3960` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.562322 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2befb1af715e435ca598651c3e0f3960)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:50.564608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:50.636512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2befb1af715e435ca598651c3e0f3960', 'request_id': 'req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.645905 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2befb1af715e435ca598651c3e0f3960', 'request_id': 'req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.653736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2befb1af715e435ca598651c3e0f3960', 'request_id': 'req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.669120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] The token cache is being invalidate because project 2befb1af715e435ca598651c3e0f3960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:50.669443 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.670421 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-aeeb24f4-e33d-4abd-8ffe-2a5d166bc85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:50.672164 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4328/8633] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:50 2022] DELETE /identity/v3/projects/2befb1af715e435ca598651c3e0f3960 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:50.677912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.678469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.678569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.700777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:50.702011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:50.780477 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4306/8634] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:50.786955 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.787409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.787809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.812845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:50.814176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:50.827240 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4329/8635] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:50.832881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:50.845228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a524-78ac-4694-ae50-03aa6d6ef631 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:50.850048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:50.850716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.850994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.851268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.851996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:28:50.852302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:50.853983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:50.870698 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4307/8636] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:28:50.872207 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:50.882807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2bd7-70f5-4d55-b65b-ad08a84ed80a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:50.887638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:50.888386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:50.888886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:50.889259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:50.890173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:50.892076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:50.922767 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4330/8637] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:50 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:50.924193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:50.942566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32227b73-c31e-4573-b156-9a71af9f74fd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:51.001420 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:51.001998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.002277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.002591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.003266 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:51.006458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:51.029009 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4308/8638] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:50 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:51.033266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:51.043663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963a86e-8ea2-48d1-ae6c-9f68d4948b2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:51.048844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:51.049573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.049861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.050139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.050875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:51.052563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:51.063592 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4331/8639] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:51.067556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:51.078729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeefc-c264-4ff6-867d-f7d94c5bb9bf admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:51.086806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:51.087503 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.087815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.088118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.088871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:51.090516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b40ea-3b5c-43f4-8d8b-bca0c7a16f94 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:51.101806 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4309/8640] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:51.105978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:51.116505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350728-ca6c-4f3d-a84d-aee39aba2df4 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:51.121237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403019-c402-485f-8233-3b797649a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:51.122138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403019-c402-485f-8233-3b797649a016 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.122427 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403019-c402-485f-8233-3b797649a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.122733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403019-c402-485f-8233-3b797649a016 admin admin] PATH_INFO: `/v3/projects/47f83fd0806d415bbe911f1d51ad3c2c/users/d83e6898693c4e39a3959609c266f550/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.137833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403019-c402-485f-8233-3b797649a016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f83fd0806d415bbe911f1d51ad3c2c, user_id=d83e6898693c4e39a3959609c266f550, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:51.140562 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403019-c402-485f-8233-3b797649a016 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:51.156316 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4332/8641] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:51 2022] PUT /identity/v3/projects/47f83fd0806d415bbe911f1d51ad3c2c/users/d83e6898693c4e39a3959609c266f550/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:51.161567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.162058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.162511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.171086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:51.185522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:51.187588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:51.247340 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4310/8642] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:51.257365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403019-c402-485f-8233-3b797649a016 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:51.259165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-98403019-c402-485f-8233-3b797649a016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:51.313013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:51.323046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403019-c402-485f-8233-3b797649a016 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:51.326968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:51.327625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:51.327904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:51.328176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:51.337785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:51.339232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c47789-acf2-4aad-be6c-08293dff37b1 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:51.349129 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4333/8643] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:28:54.549210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:54.551751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:54.572464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6909a-6ea1-47e5-ad15-376a627e9884 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:54.594366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:54.595452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:54.595819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:54.596226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] PATH_INFO: `/v3/users/61f7e0c206e349a196bbd2c6562ee0e2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:54.600412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f7e0c206e349a196bbd2c6562ee0e2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:54.603063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:54.723233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f7e0c206e349a196bbd2c6562ee0e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:54.737680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f7e0c206e349a196bbd2c6562ee0e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:54.754759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f7e0c206e349a196bbd2c6562ee0e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:54.756035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f7e0c206e349a196bbd2c6562ee0e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:54.756892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f7e0c206e349a196bbd2c6562ee0e2'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:54.785086 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4311/8644] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:54 2022] DELETE /identity/v3/users/61f7e0c206e349a196bbd2c6562ee0e2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:54.789827 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:54.790328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:54.790426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:54.814259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:54.816609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:54.916302 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4334/8645] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:28:54.933478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:54.937068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:55.164283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f87443-87a2-489f-8b76-368a3a5dfb68 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:55.175902 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:55.176633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:55.176918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:55.177195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:55.205097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:55.206725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:55.218716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4312/8646] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:28:55.465713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:55.467376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:55.488273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547d92e-6fa7-4339-9adc-41856104ad28 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:55.500983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:55.509011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:55.509505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:55.509904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] PATH_INFO: `/v3/projects/1578a50f2f074a0f8027d8376717a39c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:55.511778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1578a50f2f074a0f8027d8376717a39c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:55.524250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:55.610490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1578a50f2f074a0f8027d8376717a39c', 'request_id': 'req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.626869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1578a50f2f074a0f8027d8376717a39c', 'request_id': 'req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.636756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1578a50f2f074a0f8027d8376717a39c', 'request_id': 'req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.655033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] The token cache is being invalidate because project 1578a50f2f074a0f8027d8376717a39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:55.655337 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.657527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.660364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4335/8647] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:55 2022] DELETE /identity/v3/projects/1578a50f2f074a0f8027d8376717a39c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:55.665158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:55.681910 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147917c1-56c4-4e69-8bbe-f4673c630fae service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:55.704090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:55.779530 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:55.780911 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:55.781356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:55.781783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] PATH_INFO: `/v3/users/78be1188a7e14055890e9aa815ba7d38` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:55.784083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78be1188a7e14055890e9aa815ba7d38)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:55.786959 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:55.896991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78be1188a7e14055890e9aa815ba7d38'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.908234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78be1188a7e14055890e9aa815ba7d38'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.940746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78be1188a7e14055890e9aa815ba7d38'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.941632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78be1188a7e14055890e9aa815ba7d38'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.943930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78be1188a7e14055890e9aa815ba7d38'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:55.961571 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4313/8648] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:55 2022] DELETE /identity/v3/users/78be1188a7e14055890e9aa815ba7d38 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:28:56.322935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:56.325019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:56.342734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f76922-d487-4fe0-b6f1-ca133fc5f1bd admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:56.439786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:56.442919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:56.445173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:56.445689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] PATH_INFO: `/v3/projects/a3f66b91d26244f49f1e0ce0b1440537` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:56.447878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f66b91d26244f49f1e0ce0b1440537)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:56.450969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:56.474304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:56.535707 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f66b91d26244f49f1e0ce0b1440537', 'request_id': 'req-138aad9d-19e6-480c-8cb4-812e019b1a20'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.546172 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f66b91d26244f49f1e0ce0b1440537', 'request_id': 'req-138aad9d-19e6-480c-8cb4-812e019b1a20'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.555071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f66b91d26244f49f1e0ce0b1440537', 'request_id': 'req-138aad9d-19e6-480c-8cb4-812e019b1a20'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.574431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] The token cache is being invalidate because project a3f66b91d26244f49f1e0ce0b1440537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:56.574985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.575500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-138aad9d-19e6-480c-8cb4-812e019b1a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.581615 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4336/8649] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:56 2022] DELETE /identity/v3/projects/a3f66b91d26244f49f1e0ce0b1440537 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:56.583526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:56.586145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:56.602937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893668b9-f5e7-4887-ab35-91d910263a71 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:56.686907 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:56.688510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:56.688800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:56.689081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] PATH_INFO: `/v3/users/d5c0b36bf20c48aeac639d108aa4360d` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:56.691095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c0b36bf20c48aeac639d108aa4360d)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:56.693789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:56.711829 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:56.712120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:56.712401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:56.752056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] MFA Rules not processed for user `d83e6898693c4e39a3959609c266f550`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:28:56.754307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:56.781596 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:56.789614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c0b36bf20c48aeac639d108aa4360d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.805740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c0b36bf20c48aeac639d108aa4360d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.824201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c0b36bf20c48aeac639d108aa4360d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.825771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c0b36bf20c48aeac639d108aa4360d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.826115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c0b36bf20c48aeac639d108aa4360d'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:56.849630 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4337/8651] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:28:56.852168 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4314/8651] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:28:56 2022] DELETE /identity/v3/users/d5c0b36bf20c48aeac639d108aa4360d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:56.854881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:56.856695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:56.873864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374506f4-6289-45e2-88a2-b1c42f73051f None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:56.959444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:56.959884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:56.960364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:56.960757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:56.961802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:56.964482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.008049 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4338/8652] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:28:56 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:57.011396 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.024628 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75634bd4-c0a3-4865-9ce8-6a63ddcedaba admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.072662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.074602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:57.108176 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:57.118353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.119181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.119644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.119971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.120873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.123260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.170973 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4315/8653] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:28:57 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:28:57.175035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.176733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241efe-43e3-4e04-89df-a7399841511f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.182295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.183893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.184180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.184585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] PATH_INFO: `/v3/projects/3aee9299a52643dc9b9a2a3776010e03` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.185825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aee9299a52643dc9b9a2a3776010e03)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.187990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.188259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05b6a-fd3c-4da2-b994-60cc99d324fa admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.194688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.195998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.196283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.196999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.198269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.200690 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.213029 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4316/8654] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:28:57.217998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.227647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325415-f0fb-4ad5-843f-90591023015b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.233465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.234457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.235031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.235312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] PATH_INFO: `/v3/projects/4daf493ba96a49949182d4d2b238c9ce/users/e06d6291057e4b0cab71fb71ae161dd3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.256503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aee9299a52643dc9b9a2a3776010e03', 'request_id': 'req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:57.258075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4daf493ba96a49949182d4d2b238c9ce, user_id=e06d6291057e4b0cab71fb71ae161dd3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.262697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.265867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aee9299a52643dc9b9a2a3776010e03', 'request_id': 'req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:57.276560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aee9299a52643dc9b9a2a3776010e03', 'request_id': 'req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:57.283925 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4317/8655] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:57 2022] PUT /identity/v3/projects/4daf493ba96a49949182d4d2b238c9ce/users/e06d6291057e4b0cab71fb71ae161dd3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:28:57.288029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.291058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] The token cache is being invalidate because project 3aee9299a52643dc9b9a2a3776010e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:28:57.291411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:57.292075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:28:57.293763 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4339/8656] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:28:57 2022] DELETE /identity/v3/projects/3aee9299a52643dc9b9a2a3776010e03 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:28:57.376810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d917-2ddd-4fa1-96d0-684171b56329 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.385412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.386935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.387961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.387961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.388601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.391228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975cfb-da5b-45f2-912c-7f0c443c42ef admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.408363 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4318/8657] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:28:57.409962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:28:57.415463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:28:57.501223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a4e4d-b5fd-4ad0-bfa0-2fd7c4624bb5 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:28:57.506211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:28:57.507199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:28:57.507487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:28:57.507767 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] PATH_INFO: `/v3/projects/4daf493ba96a49949182d4d2b238c9ce/users/e06d6291057e4b0cab71fb71ae161dd3/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:28:57.509940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4daf493ba96a49949182d4d2b238c9ce, user_id=e06d6291057e4b0cab71fb71ae161dd3, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:28:57.512737 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:28:57.525214 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4340/8658] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:28:57 2022] PUT /identity/v3/projects/4daf493ba96a49949182d4d2b238c9ce/users/e06d6291057e4b0cab71fb71ae161dd3/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:29:03.540290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10600ac6-df68-42aa-987c-0ebc563952e8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:03.540834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10600ac6-df68-42aa-987c-0ebc563952e8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:03.540993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10600ac6-df68-42aa-987c-0ebc563952e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:03.567157 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:03.577777 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-10600ac6-df68-42aa-987c-0ebc563952e8 None None] MFA Rules not processed for user `e06d6291057e4b0cab71fb71ae161dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:29:03.580301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-10600ac6-df68-42aa-987c-0ebc563952e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:03.671741 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4319/8659] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:29:03.688098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:03.693785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:03.769214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:03.834985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b15a01-eb8a-4609-add1-ed95c36dd6d3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:03.842807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231168ef-b956-4d23-b875-775052567320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:03.843654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231168ef-b956-4d23-b875-775052567320 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:03.844709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231168ef-b956-4d23-b875-775052567320 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:03.845143 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231168ef-b956-4d23-b875-775052567320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:03.847527 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-231168ef-b956-4d23-b875-775052567320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:03.947717 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231168ef-b956-4d23-b875-775052567320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:03.950409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231168ef-b956-4d23-b875-775052567320 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:03.966176 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4341/8660] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:29:05.134926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:05.135468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:05.135468 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:05.166108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] MFA Rules not processed for user `d83e6898693c4e39a3959609c266f550`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:29:05.167540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:05.180687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4320/8661] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:29:05.982553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231168ef-b956-4d23-b875-775052567320 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:05.984588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-231168ef-b956-4d23-b875-775052567320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:06.080042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231168ef-b956-4d23-b875-775052567320 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:06.085612 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:06.086355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:06.086845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:06.087205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:06.089149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:06.105006 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:06.106860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:06.120717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4342/8662] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:29:15.159610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=33 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:15.818970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:15.836380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ccfdb-70ea-461a-b8af-a2d95eb18855 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:15.842042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:15.842718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:15.843006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:15.843288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:15.845164 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:15.860928 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:15.863390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:15.880472 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4321/8663] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:29:16.113559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=69 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:16.487298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:16.488947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:16.557589 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ef33-aada-4ac3-9983-7a91741cd21f service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:16.563937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:16.564872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:16.565210 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:16.565538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] PATH_INFO: `/v3/users/f7ea2397650748afa9edf0864829c434` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:16.566913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ea2397650748afa9edf0864829c434)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:16.569303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:16.631756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ea2397650748afa9edf0864829c434'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:16.635167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ea2397650748afa9edf0864829c434'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:16.644014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ea2397650748afa9edf0864829c434'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:16.657940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ea2397650748afa9edf0864829c434'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:16.665278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ea2397650748afa9edf0864829c434'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:16.671354 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4343/8664] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:29:16 2022] DELETE /identity/v3/users/f7ea2397650748afa9edf0864829c434 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:29:16.898127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:16.909604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf8f5-7012-435a-a333-8a39225be022 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:16.982967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:16.983863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:16.984142 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:16.984450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] PATH_INFO: `/v3/projects/039691ff93174f54aaaa13770a444aa2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:16.985871 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] RBAC: Authorizing `identity:delete_project(project_id=039691ff93174f54aaaa13770a444aa2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:16.987853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:17.047113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039691ff93174f54aaaa13770a444aa2', 'request_id': 'req-823efc57-9f06-470b-a7c0-b3575963415f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.055835 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039691ff93174f54aaaa13770a444aa2', 'request_id': 'req-823efc57-9f06-470b-a7c0-b3575963415f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.061571 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039691ff93174f54aaaa13770a444aa2', 'request_id': 'req-823efc57-9f06-470b-a7c0-b3575963415f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.074373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] The token cache is being invalidate because project 039691ff93174f54aaaa13770a444aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:29:17.074691 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.075385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.077072 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4322/8665] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:29:16 2022] DELETE /identity/v3/projects/039691ff93174f54aaaa13770a444aa2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:29:17.081523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:17.083133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:17.098146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5921e-411f-4c78-b776-3521bab7b6e9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:17.157774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:17.158639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:17.158958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:17.159239 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] PATH_INFO: `/v3/users/0012741fcfdc484aab3d6f0bc2595f25` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:17.160482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0012741fcfdc484aab3d6f0bc2595f25)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:17.162573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:17.187225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:17.217749 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0012741fcfdc484aab3d6f0bc2595f25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.218423 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0012741fcfdc484aab3d6f0bc2595f25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.230841 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0012741fcfdc484aab3d6f0bc2595f25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.246561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0012741fcfdc484aab3d6f0bc2595f25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.254796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0012741fcfdc484aab3d6f0bc2595f25'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.262634 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4344/8666] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:29:17 2022] DELETE /identity/v3/users/0012741fcfdc484aab3d6f0bc2595f25 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:29:17.470887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:17.472633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:17.489587 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efc57-9f06-470b-a7c0-b3575963415f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:17.555028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:17.556131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:17.556472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:17.556880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] PATH_INFO: `/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:17.558878 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bf9f9abb9e4e128ea77d29ee63c66e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:17.561962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:17.587641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:17.616416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bf9f9abb9e4e128ea77d29ee63c66e', 'request_id': 'req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.626451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bf9f9abb9e4e128ea77d29ee63c66e', 'request_id': 'req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.632178 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bf9f9abb9e4e128ea77d29ee63c66e', 'request_id': 'req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.643520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] The token cache is being invalidate because project 32bf9f9abb9e4e128ea77d29ee63c66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:29:17.643848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.644550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:29:17.646154 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4323/8667] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:29:17 2022] DELETE /identity/v3/projects/32bf9f9abb9e4e128ea77d29ee63c66e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:29:18.586582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:18.588148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:18.652458 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e58b-866c-4d20-8a16-c2566bb93a77 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:18.703667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:18.704333 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:18.704654 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:18.704938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:18.706919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:18.774853 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:18.776308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808d66a-d3b5-4fff-bf6b-6e092d5b5525 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:18.786386 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4345/8668] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:29:20.417035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:20.418768 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:20.519200 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78edf-3b8b-40d5-a05e-962b40b7e5a0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:20.525936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:20.526698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:20.527050 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:20.527424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:20.529342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:20.544980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:20.546704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:20.561994 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4324/8669] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:29:28.782065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:30.556078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:56.177535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:56.178050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:56.178140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:56.198223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:29:56.199467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:56.257984 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4346/8670] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:29:57.567267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:29:57.568892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:57.643663 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7bd1-4ae0-4c48-8667-5ebd2fc78118 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:29:57.649303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:29:57.649958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:29:57.650241 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:29:57.650519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:29:57.652454 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:29:57.669062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:29:57.670668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:29:57.683148 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4325/8671] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:29:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:30:03.369926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:30:03.385753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645fe27-ea6e-4630-a928-a4320ac9cd7a None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:30:03.391757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:30:03.392405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:30:03.392713 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:30:03.392984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:30:03.395351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:30:03.410150 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:30:03.411839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:30:03.425066 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4347/8672] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:30:07.676748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=32 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:13.418334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=31 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:26.139821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:30:26.141445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:30:26.156686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095ac3a-28e2-4e5c-a776-ed6db6b4b106 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:30:26.161148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:30:26.161821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:30:26.162105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:30:26.162377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:30:26.164517 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:30:26.176133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:30:26.177642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a96b5-9d2b-45b9-a8f9-ee42b885b64f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:30:26.188545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4326/8673] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:30:36.183044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:44.916238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:31:44.917820 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:31:44.993389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a30f-e86e-4a33-b64a-bf8f069e085f service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:31:44.997706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:31:44.998376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:31:44.998660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:31:44.998934 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:31:45.001068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:31:45.013570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:31:45.015022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:31:45.024620 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4348/8674] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:31:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:31:47.737201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:31:47.737728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:31:47.737728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:31:47.766590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] MFA Rules not processed for user `8d162afa6d9b48ef9fac1bf23c0c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:31:47.767812 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:31:47.792133 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4327/8675] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:31:55.020370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=31 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:57.790233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=15 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:32:52.998565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:32:53.022919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754d5-db76-420a-a674-30ce8fd0a4e3 service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:32:53.027289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:32:53.027946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:32:53.028227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:32:53.028541 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:32:53.030655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:32:53.069964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:32:53.071581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:32:53.084105 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4349/8676] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:33:03.077222 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=20 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:08.115509 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:33:08.117181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:33:08.133391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92975fb7-f5f3-46c1-b697-ce74630cfa5c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:33:08.138002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:33:08.138660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:33:08.138949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:33:08.139218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:33:08.141373 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:33:08.154696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:33:08.156151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:33:08.167266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4328/8677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:33:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:33:18.161352 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:38.293810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:33:38.319817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c483a8-4762-46e9-97c0-f61c5124bba8 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:33:38.323796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:33:38.324603 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:33:38.324988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:33:38.325335 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:33:38.327187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:33:38.371184 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:33:38.372676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:33:38.386787 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4350/8678] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:33:39.584006 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:33:39.605261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac819551-1667-48d5-8be8-db5dd2c62ee3 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:33:39.609177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:33:39.609834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:33:39.610118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:33:39.610395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:33:39.612250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:33:39.629340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:33:39.630799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:33:39.644880 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4329/8679] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:33:48.379351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=21 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:49.637308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=10 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:20.819701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:20.831987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da406-6bed-47be-a3c2-96e9b9d80062 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:20.836028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:20.836721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:20.837008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:20.837289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:20.839285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:20.931593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:20.933092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:20.954469 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4351/8680] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:24.221658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:24.223293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:24.252950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73086e-7e7f-43bc-a7ce-83b33909592f service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:24.258769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:24.259482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:24.259896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:24.260189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:24.262265 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:24.280787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:24.282806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:24.305264 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4330/8681] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:27.239468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:27.241605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:27.257020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b21a9f-7b2e-4c0a-b9d6-56347133797a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:27.262040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:27.263088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:27.263375 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:27.263655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] PATH_INFO: `/v3/users/8d162afa6d9b48ef9fac1bf23c0c41e9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:27.270797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d162afa6d9b48ef9fac1bf23c0c41e9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:27.270797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:27.319245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d162afa6d9b48ef9fac1bf23c0c41e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.319911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d162afa6d9b48ef9fac1bf23c0c41e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.328490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d162afa6d9b48ef9fac1bf23c0c41e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.340740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d162afa6d9b48ef9fac1bf23c0c41e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.347524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d162afa6d9b48ef9fac1bf23c0c41e9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.353699 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4352/8682] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:34:27 2022] DELETE /identity/v3/users/8d162afa6d9b48ef9fac1bf23c0c41e9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:27.543566 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:27.555128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389884-f11b-4346-9f77-110aad97fa60 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:27.617091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:27.618014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:27.618320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:27.618629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] PATH_INFO: `/v3/projects/d1a396ec47a346dc97426df498e54ab2` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:27.619960 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a396ec47a346dc97426df498e54ab2)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:27.621945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:27.671872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a396ec47a346dc97426df498e54ab2', 'request_id': 'req-144718a5-1b47-484a-b382-6d1eb1a83ca6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.679451 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a396ec47a346dc97426df498e54ab2', 'request_id': 'req-144718a5-1b47-484a-b382-6d1eb1a83ca6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.685078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a396ec47a346dc97426df498e54ab2', 'request_id': 'req-144718a5-1b47-484a-b382-6d1eb1a83ca6'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.696519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] The token cache is being invalidate because project d1a396ec47a346dc97426df498e54ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:34:27.696807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.697496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.699108 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4331/8683] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:34:27 2022] DELETE /identity/v3/projects/d1a396ec47a346dc97426df498e54ab2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:27.703376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:27.705039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:27.719895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579b61-5359-4e06-bae4-cbe59dbe22f7 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:27.754621 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:27.780757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:27.781642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:27.781924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:27.782197 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] PATH_INFO: `/v3/users/5cdfe6293a8c48cf82e96279440d48c0` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:27.783436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdfe6293a8c48cf82e96279440d48c0)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:27.785398 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:27.840363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdfe6293a8c48cf82e96279440d48c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.841078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdfe6293a8c48cf82e96279440d48c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.849821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdfe6293a8c48cf82e96279440d48c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.861848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdfe6293a8c48cf82e96279440d48c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.868995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdfe6293a8c48cf82e96279440d48c0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:27.878313 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4353/8684] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:34:27 2022] DELETE /identity/v3/users/5cdfe6293a8c48cf82e96279440d48c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:28.058239 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:28.059704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:28.074496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144718a5-1b47-484a-b382-6d1eb1a83ca6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:28.135168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:28.136039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:28.136323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:28.136659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] PATH_INFO: `/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:28.137854 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfb5d7e0e9748f4b66bffb2e30f8f4c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:28.139824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:28.150322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:28.189259 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfb5d7e0e9748f4b66bffb2e30f8f4c', 'request_id': 'req-661686db-cf47-40e6-afaf-a914846f0951'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:28.197811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfb5d7e0e9748f4b66bffb2e30f8f4c', 'request_id': 'req-661686db-cf47-40e6-afaf-a914846f0951'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:28.203375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfb5d7e0e9748f4b66bffb2e30f8f4c', 'request_id': 'req-661686db-cf47-40e6-afaf-a914846f0951'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:28.215521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] The token cache is being invalidate because project 7bfb5d7e0e9748f4b66bffb2e30f8f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:34:28.215818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:28.216586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:28.218369 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4332/8685] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:34:28 2022] DELETE /identity/v3/projects/7bfb5d7e0e9748f4b66bffb2e30f8f4c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:30.826163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:30.829736 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:30.931823 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466481-46f2-4a61-81f9-72d003f5c159 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:30.977431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:31.001886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:31.002595 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:31.002881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:31.003158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:31.005188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:31.066175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:31.067772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:31.077147 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4354/8686] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:34:32.846971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:32.848695 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:32.876367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661686db-cf47-40e6-afaf-a914846f0951 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:32.883549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:32.884236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:32.884553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:32.884832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:32.886954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:32.905375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:32.907794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:32.925239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4333/8687] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:34.329691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:34.331634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:34.393253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd733221-241c-46a0-aed4-e9909276adb9 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:34.397949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:34.398579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:34.398879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:34.399178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:34.401032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:34.471809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:34.473292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:34.483604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4355/8688] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:34:40.973706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:40.975271 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:41.039727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:41.041253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:41.056962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac3661-c5a0-4ea8-bd33-a870038bf3b3 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:41.062684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:41.064688 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:41.065036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:41.065393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] PATH_INFO: `/v3/users/d83e6898693c4e39a3959609c266f550` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:41.066740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83e6898693c4e39a3959609c266f550)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:41.068831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:41.074575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679e52f-db7b-48a5-a64d-69e4123c54ad service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:41.079986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:41.080693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:41.080990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:41.081622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:41.083578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:41.099035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:41.100766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:41.101896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:41.115265 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4334/8689] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:41.121199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83e6898693c4e39a3959609c266f550'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.121988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83e6898693c4e39a3959609c266f550'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.132586 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83e6898693c4e39a3959609c266f550'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.145041 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83e6898693c4e39a3959609c266f550'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.152242 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83e6898693c4e39a3959609c266f550'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.158432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4356/8690] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:34:41 2022] DELETE /identity/v3/users/d83e6898693c4e39a3959609c266f550 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:41.343760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:41.356918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c47d5e-e355-4871-aeeb-703e9726eecf service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:41.420940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:41.421853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:41.422137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:41.422414 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] PATH_INFO: `/v3/projects/47f83fd0806d415bbe911f1d51ad3c2c` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:41.423637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f83fd0806d415bbe911f1d51ad3c2c)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:41.425646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:41.442870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:41.474277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f83fd0806d415bbe911f1d51ad3c2c', 'request_id': 'req-44a77bc8-5901-44cc-9d7a-516c679ce3e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.482469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f83fd0806d415bbe911f1d51ad3c2c', 'request_id': 'req-44a77bc8-5901-44cc-9d7a-516c679ce3e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.488666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f83fd0806d415bbe911f1d51ad3c2c', 'request_id': 'req-44a77bc8-5901-44cc-9d7a-516c679ce3e3'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.500058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] The token cache is being invalidate because project 47f83fd0806d415bbe911f1d51ad3c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:34:41.500356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.501149 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.502932 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4335/8691] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:34:41 2022] DELETE /identity/v3/projects/47f83fd0806d415bbe911f1d51ad3c2c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:41.507373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:41.509117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:41.523549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0632-c3c8-467b-8b32-c88c96bd1130 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:41.591610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:41.592450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:41.592752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:41.593032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] PATH_INFO: `/v3/users/e06d6291057e4b0cab71fb71ae161dd3` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:41.594342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06d6291057e4b0cab71fb71ae161dd3)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:41.596389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:41.645875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06d6291057e4b0cab71fb71ae161dd3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.645875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06d6291057e4b0cab71fb71ae161dd3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.652913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06d6291057e4b0cab71fb71ae161dd3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.665382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06d6291057e4b0cab71fb71ae161dd3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.672264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-2a3b2478-bc96-4a01-887c-8a95085d3912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06d6291057e4b0cab71fb71ae161dd3'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:41.678531 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4357/8692] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:34:41 2022] DELETE /identity/v3/users/e06d6291057e4b0cab71fb71ae161dd3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:41.858963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:41.860532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:41.876133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77bc8-5901-44cc-9d7a-516c679ce3e3 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:41.934705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:41.935580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:41.935863 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:41.936141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] PATH_INFO: `/v3/projects/4daf493ba96a49949182d4d2b238c9ce` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:41.937434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4daf493ba96a49949182d4d2b238c9ce)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:41.939355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:41.996882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4daf493ba96a49949182d4d2b238c9ce', 'request_id': 'req-12b83039-a6d8-4973-9034-e67992d920b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:42.007215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4daf493ba96a49949182d4d2b238c9ce', 'request_id': 'req-12b83039-a6d8-4973-9034-e67992d920b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:42.013992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4daf493ba96a49949182d4d2b238c9ce', 'request_id': 'req-12b83039-a6d8-4973-9034-e67992d920b8'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:42.027052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] The token cache is being invalidate because project 4daf493ba96a49949182d4d2b238c9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:34:42.027345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:42.028158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-12b83039-a6d8-4973-9034-e67992d920b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:34:42.029954 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4336/8693] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:34:41 2022] DELETE /identity/v3/projects/4daf493ba96a49949182d4d2b238c9ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:51.674799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:52.023644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:52.206177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.206473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.207216 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.268777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:34:52.269994 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:52.333517 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4358/8694] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:34:52.343062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.343360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.343640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.366631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:34:52.367866 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:52.377314 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4337/8695] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:34:52.382258 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.392869 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd241b-f6aa-47bc-8fcb-6b34dab33845 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.398594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.399268 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.399556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.399840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.400622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:34:52.400935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.402582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.415432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4359/8696] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:34:52.424706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.434887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c4369-9a6a-43eb-b0a5-f90924bd6426 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.441165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.441823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.442103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.442372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.443054 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.445009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.473326 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4338/8697] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:34:52.477792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.488277 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53efb-ba55-4b16-8f4c-f2a61368b89f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.546708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.547391 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.547682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.547961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.548701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.550675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.571916 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4360/8698] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:34:52.576211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.587340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf511-792d-4754-96a3-bc551cb35cc0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.592622 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.593289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.593570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.593841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.594569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.596172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.606864 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4339/8699] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:34:52.612896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.629665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a71a-5c1f-4b1a-8c4f-20e8af45f31c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.636830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.637498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.637780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.638053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.638784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.640392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c2a55-2d16-4188-86bd-cec01e896213 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.651193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4361/8700] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:34:52.655395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.666162 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470e99e-9d83-4c0c-abae-b8b9b657431a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.671462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.672349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.672680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.672957 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] PATH_INFO: `/v3/projects/5909b19117bd4a978ebda418febc91f8/users/81d3c5433f55474f90eab8bb607d48ae/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.687867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5909b19117bd4a978ebda418febc91f8, user_id=81d3c5433f55474f90eab8bb607d48ae, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.690583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.704920 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4340/8701] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:34:52 2022] PUT /identity/v3/projects/5909b19117bd4a978ebda418febc91f8/users/81d3c5433f55474f90eab8bb607d48ae/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:52.717257 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.717726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.717818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.745787 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] MFA Rules not processed for user `81d3c5433f55474f90eab8bb607d48ae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:34:52.747001 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:52.773529 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:52.816761 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4362/8702] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:34:52.821443 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.886931 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5a67-909e-40de-9278-b053d6b7328c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.892535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:52.893184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:52.893469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:52.893748 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:52.894456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:52.896374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:52.923996 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4341/8703] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:34:52.929879 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:52.941358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d3fc-4a14-4c30-89d7-ac8ea5e4e393 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:52.999885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.000611 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.000937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.001169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.001862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.003861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.026006 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4363/8704] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:34:52 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:34:53.030335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:53.041506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b7c4-34d7-4532-a26f-a26bd60187f0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:53.046278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.046955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.047240 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.047516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.048260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.049948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.060468 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4342/8705] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:34:53.064633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:53.074693 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7266d-5811-4fe1-b2b4-784e652bad09 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:53.079616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.080526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.080811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.081089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] PATH_INFO: `/v3/projects/a3bc66f185a74931bdf355a34805bc8f/users/66848b4c3e5440c8a2ef62627bdcee2c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.102152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bc66f185a74931bdf355a34805bc8f, user_id=66848b4c3e5440c8a2ef62627bdcee2c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.104959 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.122054 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4364/8706] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:34:53 2022] PUT /identity/v3/projects/a3bc66f185a74931bdf355a34805bc8f/users/66848b4c3e5440c8a2ef62627bdcee2c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:53.126275 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:53.137647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc256b-077c-4184-9f37-575d3ec15db6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:53.194915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.195786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.196039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.196317 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.197080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.198739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cea56-4379-4a40-ba0b-e3787ef3b2bc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.208945 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4343/8707] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:34:53.213418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:53.224759 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead590-e8bf-478a-b943-ed06abdaf33c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:53.230418 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.231311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.231697 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.231976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] PATH_INFO: `/v3/projects/a3bc66f185a74931bdf355a34805bc8f/users/66848b4c3e5440c8a2ef62627bdcee2c/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.234151 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bc66f185a74931bdf355a34805bc8f, user_id=66848b4c3e5440c8a2ef62627bdcee2c, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.236859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88575f5-4a65-4cb2-9534-cedbb68fbcdb admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.247971 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4365/8708] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:34:53 2022] PUT /identity/v3/projects/a3bc66f185a74931bdf355a34805bc8f/users/66848b4c3e5440c8a2ef62627bdcee2c/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:34:53.260841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.261161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.261538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.278626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:53.294943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] MFA Rules not processed for user `66848b4c3e5440c8a2ef62627bdcee2c`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:34:53.296165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:53.371183 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4344/8709] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:34:53.383973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.384250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.384565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.403115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] MFA Rules not processed for user `81d3c5433f55474f90eab8bb607d48ae`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:34:53.404259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:53.466867 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4366/8710] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:34:53.484841 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:53.486568 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:53.566555 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9e39-e2a9-4fde-92c4-18e64dc68e2f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:53.572537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:53.573198 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:53.573495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:53.573770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:53.582098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:53.583783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:53.592939 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4345/8711] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:54.995576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:54.997106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:55.024231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:55.078302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662c8dd-09cd-4450-a007-f3714afc4402 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:55.084310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:55.085007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:55.085295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:55.085578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:55.087515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:55.102329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:55.103937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:55.116959 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4367/8712] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:34:58.657073 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:34:58.658536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:58.691610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ecf1c-9c19-4dc6-89c0-5b18d9a3cb73 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:34:58.697896 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:34:58.698552 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:34:58.698860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:34:58.699132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:34:58.701197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:34:58.716017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:34:58.717647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:34:58.730327 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4346/8713] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:00.832203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:00.857452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97741-30bb-4911-a293-6707e2580ca1 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:00.863260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:00.863958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:00.864246 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:00.864567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:00.866588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:00.891408 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:00.894002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:00.914786 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4368/8714] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:06.370742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:06.372653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:06.395186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104bc3-3e8f-45b8-8851-336f82479594 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:06.403786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:06.404446 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:06.404801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:06.405191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:06.407069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:06.422819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:06.424466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03822bc8-40c7-4382-ab94-c4d4fb86b590 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:06.438769 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4347/8715] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:09.029605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:09.043381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29058d6-475a-43bf-81c2-66ff13c7513a service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:09.049373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:09.050118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.050397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.050663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.060744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:09.062355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:09.082828 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4369/8716] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:09.097675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.098139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.098250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.099645 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4348/8717] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:35:09.104182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] Authenticating service token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:35:09.118466 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:09.127108 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2660-b478-425c-88ff-7e4a7452a5f0 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:09.132972 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66848b4c3e5440c8a2ef62627bdcee2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3bc66f185a74931bdf355a34805bc8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:09.133903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.134341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.134815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] PATH_INFO: `/v3/projects/a3bc66f185a74931bdf355a34805bc8f` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.136190 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: Authorizing `identity:get_project(project_id=a3bc66f185a74931bdf355a34805bc8f)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:09.138219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f162-8ea9-443f-af55-72a349b87ed3 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:09.140940 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4370/8718] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:35:09 2022] GET /identity/v3/projects/a3bc66f185a74931bdf355a34805bc8f => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:35:09.315842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:09.317963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:09.363694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:09.382580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f7d9-7f49-44b9-931e-3e500a811ef0 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:09.386492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:09.387146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.387424 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.387733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.389792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:09.402597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:09.404089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:09.415081 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4349/8719] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:09.573483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.573777 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.574066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.575471 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4371/8720] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 25 21:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:35:09.580484 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] Authenticating service token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 25 21:35:09.597619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:09.607881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833dfa6-9689-4a1d-b0e9-8835c3d70926 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:09.612953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66848b4c3e5440c8a2ef62627bdcee2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3bc66f185a74931bdf355a34805bc8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:09.613880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.614115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.614398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] PATH_INFO: `/v3/projects/a3bc66f185a74931bdf355a34805bc8f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.615603 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: Authorizing `identity:get_project(project_id=a3bc66f185a74931bdf355a34805bc8f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:09.617464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:09.619184 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4350/8721] 10.222.0.39 () {58 vars in 1443 bytes} [Sat Jun 25 21:35:09 2022] GET /identity/v3/projects/a3bc66f185a74931bdf355a34805bc8f => generated 391 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:35:09.772976 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:09.776051 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:09.795862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd366-03e0-4035-b44c-dbee3e3ad582 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:09.799718 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:09.800367 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:09.800672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:09.800961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:09.802756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:09.815424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:09.816911 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:09.828069 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4372/8722] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:10.404112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:10.419665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f048-911c-42ee-a420-6779ac74d3a1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:10.426260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:10.426915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:10.427197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:10.427469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:10.429630 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:10.444671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:10.446279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69978f60-2dfa-4cf3-9f58-d2181cffa8c9 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:10.460146 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4351/8723] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:13.666895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:13.733694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0bce-a61c-41c6-b191-1b1cd0fca6f4 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:13.738899 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:13.739789 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:13.740095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:13.740349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] PATH_INFO: `/v3/users/81d3c5433f55474f90eab8bb607d48ae` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:13.741656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d3c5433f55474f90eab8bb607d48ae)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:13.743599 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:13.796837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d3c5433f55474f90eab8bb607d48ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:13.797510 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d3c5433f55474f90eab8bb607d48ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:13.805018 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d3c5433f55474f90eab8bb607d48ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:13.813456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:13.818699 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d3c5433f55474f90eab8bb607d48ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:13.826733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d3c5433f55474f90eab8bb607d48ae'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:13.833364 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4373/8724] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:35:13 2022] DELETE /identity/v3/users/81d3c5433f55474f90eab8bb607d48ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:35:13.837963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:13.838434 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:13.838562 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:13.858279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:13.859526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:13.932003 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4352/8725] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:35:13.942045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:13.943784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:14.007585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b4360-f65d-4299-8b25-2881e0f0cd62 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:14.012213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:14.012914 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:14.013199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:14.013473 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:14.023296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:14.024798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:14.034338 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4374/8726] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:14.215617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:14.217263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:14.230076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e864ad-0cc0-4ea8-b75b-13136f497636 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:14.235167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:14.236107 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:14.236486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:14.236773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] PATH_INFO: `/v3/projects/5909b19117bd4a978ebda418febc91f8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:14.237986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5909b19117bd4a978ebda418febc91f8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:14.239927 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:14.291845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5909b19117bd4a978ebda418febc91f8', 'request_id': 'req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.299572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5909b19117bd4a978ebda418febc91f8', 'request_id': 'req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.305213 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5909b19117bd4a978ebda418febc91f8', 'request_id': 'req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.317014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] The token cache is being invalidate because project 5909b19117bd4a978ebda418febc91f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:35:14.317309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.318034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.319707 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4353/8727] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:35:14 2022] DELETE /identity/v3/projects/5909b19117bd4a978ebda418febc91f8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:35:14.324015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:14.334404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cc97-0f08-4371-b178-4c33c84839b2 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:14.396866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:14.397764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:14.398054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:14.398330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] PATH_INFO: `/v3/users/66848b4c3e5440c8a2ef62627bdcee2c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:14.399550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66848b4c3e5440c8a2ef62627bdcee2c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:14.401554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:14.452022 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66848b4c3e5440c8a2ef62627bdcee2c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.452714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66848b4c3e5440c8a2ef62627bdcee2c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.461292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66848b4c3e5440c8a2ef62627bdcee2c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.473380 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66848b4c3e5440c8a2ef62627bdcee2c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.480136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6c912e97-e871-4095-ba29-9959622c80b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66848b4c3e5440c8a2ef62627bdcee2c'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.486686 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4375/8728] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:35:14 2022] DELETE /identity/v3/users/66848b4c3e5440c8a2ef62627bdcee2c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:35:14.775953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:14.777478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:14.792140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c03c-1a70-4ee8-81e0-646b2b1b38dd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:14.836441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:14.853238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:14.854145 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:14.854427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:14.854714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] PATH_INFO: `/v3/projects/a3bc66f185a74931bdf355a34805bc8f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:14.855913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3bc66f185a74931bdf355a34805bc8f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:14.858331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:14.908616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3bc66f185a74931bdf355a34805bc8f', 'request_id': 'req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.920380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3bc66f185a74931bdf355a34805bc8f', 'request_id': 'req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.926189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3bc66f185a74931bdf355a34805bc8f', 'request_id': 'req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.937815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] The token cache is being invalidate because project a3bc66f185a74931bdf355a34805bc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:35:14.938109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.938873 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-a04f4e8f-ca48-42b6-ad96-ea821c3b6a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:35:14.940648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4354/8729] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:35:14 2022] DELETE /identity/v3/projects/a3bc66f185a74931bdf355a34805bc8f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:35:14.946873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:14.947365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:14.947468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:14.955256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:14.968460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:14.969883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:15.041336 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4376/8730] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:35:15.049953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.050254 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.050550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.070511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:15.071740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:15.081142 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4355/8731] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:35:15.086344 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.099043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cf38-dbaa-483d-9203-82aadc967b08 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.105028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.105686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.105969 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.106238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.106958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:35:15.107291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.108943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.121538 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4377/8732] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:35:15.126115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.135868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dca0e-5802-4445-9db4-b507dfd0389d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.141675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.142331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.142619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.142889 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.143578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.145541 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.174901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4356/8733] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:35:15 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:35:15.179017 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.189349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2eb4c-7e99-4c4e-8c84-9ba93be99a21 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.251500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.252196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.252503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.252790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.253509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.255481 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.278381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4378/8734] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:35:15 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:35:15.283943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.295172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443a8d-40af-49eb-a2f2-9e19178e8ad6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.300394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.301095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.301524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.301805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.302535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.304345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.316471 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4357/8735] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:35:15.320712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.331724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61aa2-e33f-4565-a395-d584e65ac8fc admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.338503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.339180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.339464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.339740 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.340464 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.342206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016ae5b-ceaf-4a6e-8514-e8375b710752 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.352860 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4379/8736] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:35:15.357147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.368140 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea167edf-108c-4f15-a8a3-62b6a2ce8215 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.374303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.375189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.375475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.375749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] PATH_INFO: `/v3/projects/27deb4968d0749dfb6501f5cf2d3f403/users/6ded64c384e144c69c160f7f5568ac27/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.392610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27deb4968d0749dfb6501f5cf2d3f403, user_id=6ded64c384e144c69c160f7f5568ac27, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.395291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.410163 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4358/8737] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:35:15 2022] PUT /identity/v3/projects/27deb4968d0749dfb6501f5cf2d3f403/users/6ded64c384e144c69c160f7f5568ac27/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:35:15.416647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674957a-f002-49f2-86ef-efe713805fb1 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.416929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674957a-f002-49f2-86ef-efe713805fb1 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.417206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674957a-f002-49f2-86ef-efe713805fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.435431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-2674957a-f002-49f2-86ef-efe713805fb1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:15.436702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2674957a-f002-49f2-86ef-efe713805fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:15.513359 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4380/8738] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:35:15.523502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:15.525421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:15.587901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb13d-fc73-4ead-b1f4-c9e2fc1a7eb8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:15.592320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:15.593011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:15.593290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:15.593563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:15.603550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:15.605049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42fd9-1771-438c-a128-34bd892cfa6d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:15.616010 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4359/8739] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:19.435238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:19.436201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:19.436517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:19.461139 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:19.470517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] MFA Rules not processed for user `6ded64c384e144c69c160f7f5568ac27`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:19.471866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:19.552703 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4381/8740] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:35:19.564131 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:19.564725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:19.564725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:19.584007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] MFA Rules not processed for user `6ded64c384e144c69c160f7f5568ac27`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:19.585300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:19.592635 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4360/8741] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:35:19.606849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:19.608723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:19.687520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bbf5f-50f1-46e6-a2ff-6d49818397d5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:19.693078 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:19.693747 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:19.694029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:19.694305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:19.703821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:19.705806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13a7a-2cfb-462c-9d4b-dcf33c69182f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:19.719791 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4382/8742] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:29.578683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:29.714430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=61 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:30.414429 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:30.416090 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:30.432033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352685-8493-4cd6-a7f1-5f21dcd65e67 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:30.436745 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:30.437407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:30.437697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:30.438061 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:30.439868 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:30.452620 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:30.454197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54d643-e1d4-4555-ac69-aab128f6640a service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:30.465707 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4361/8743] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:35:30.556672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:30.556968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:30.557249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:30.558674 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4383/8744] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:35:30.563665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:30.564058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:30.564311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:30.602477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:35:30.603700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:30.666569 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4362/8745] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:35:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:35:30.688675 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:30.690608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:30.712169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d69b9-59c3-4e34-82dc-d6ef5a88f495 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:30.718926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:30.719640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:30.719882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:30.720142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:30.729523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:30.731149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:30.741140 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4384/8746] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:30.909967 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:35:30.924513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553e363-ebb5-423e-94c3-57b7480eb6ec None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:35:30.928930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:35:30.929567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:35:30.929864 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:35:30.930143 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:35:30.932108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:35:30.949222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:35:30.950678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:35:30.964744 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4363/8747] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:35:40.737212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:40.957170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=47 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:11.176967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:11.192957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e5a7-7d02-45d3-bcf6-60df702e6bb5 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:11.198075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:11.199058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.199345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.199628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] PATH_INFO: `/v3/users/6ded64c384e144c69c160f7f5568ac27` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.200954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ded64c384e144c69c160f7f5568ac27)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:11.203073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:11.275561 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ded64c384e144c69c160f7f5568ac27'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.276415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ded64c384e144c69c160f7f5568ac27'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.287267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ded64c384e144c69c160f7f5568ac27'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.304082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ded64c384e144c69c160f7f5568ac27'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.321062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-e5c1f955-4134-415a-a1f2-25a33ee2218e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ded64c384e144c69c160f7f5568ac27'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.329956 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4385/8748] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:36:11 2022] DELETE /identity/v3/users/6ded64c384e144c69c160f7f5568ac27 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:36:11.520376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:11.532280 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1aebe-be2b-42ea-9aa4-4334764e3c69 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:11.591079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:11.591884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.592168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.592453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] PATH_INFO: `/v3/projects/27deb4968d0749dfb6501f5cf2d3f403` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.593664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27deb4968d0749dfb6501f5cf2d3f403)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:11.595598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:11.643756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27deb4968d0749dfb6501f5cf2d3f403', 'request_id': 'req-4687a294-28f7-4b33-aed5-9493da0aeac9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.653379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27deb4968d0749dfb6501f5cf2d3f403', 'request_id': 'req-4687a294-28f7-4b33-aed5-9493da0aeac9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.659679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27deb4968d0749dfb6501f5cf2d3f403', 'request_id': 'req-4687a294-28f7-4b33-aed5-9493da0aeac9'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.672746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] The token cache is being invalidate because project 27deb4968d0749dfb6501f5cf2d3f403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:36:11.673256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.674125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-4687a294-28f7-4b33-aed5-9493da0aeac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:36:11.675749 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4364/8749] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:36:11 2022] DELETE /identity/v3/projects/27deb4968d0749dfb6501f5cf2d3f403 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:36:11.681186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.681530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.681882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.700231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:11.701480 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:11.767788 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4386/8750] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:11.776761 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.777085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.777366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.796349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:11.797625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:11.806578 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4365/8751] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:11.811199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:11.821892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0562-875c-4787-8518-e2b4083fa7b3 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:11.827270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:11.827939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.828224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.828492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.829226 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:36:11.829535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:11.831208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:11.843404 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4387/8752] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:36:11.847800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:11.858341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636635a7-9bea-4e1a-8487-8fad96a6394b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:11.867068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:11.867740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.868022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.868299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.869070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:11.871070 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:11.903090 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4366/8753] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:36:11 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:36:11.907554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:11.918265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3fb93-bacb-4fb5-8f60-6a425adbcc7c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:11.985109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:11.985783 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:11.986068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:11.986343 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] PATH_INFO: `/v3/users` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:11.987052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:11.989046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:11.995655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:12.011894 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4388/8754] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:36:11 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:36:12.016362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:12.027499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6ff-e52e-44c8-acef-517256a3ef73 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:12.033535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:12.034219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:12.034505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:12.034765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:12.035513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:12.037194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:12.048320 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4367/8755] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:36:12.052359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:12.063015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35866ff-518c-467a-b126-5ab61d8e7b74 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:12.067808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:12.068471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:12.068785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:12.069058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:12.069776 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:12.071381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58a3e6-3296-4747-9519-197d1c75308a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:12.082093 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4389/8756] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:36:12.086699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:12.098032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ac662-84ab-4e49-bcf3-ab1678dc7c2a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:12.102949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:12.103842 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:12.104124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:12.104395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] PATH_INFO: `/v3/projects/31f1f1e662e94d4899d83dcdc61cb9c8/users/581e969a68fc439f8021e3c106a1b58b/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:12.122645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f1f1e662e94d4899d83dcdc61cb9c8, user_id=581e969a68fc439f8021e3c106a1b58b, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:12.125383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:12.140206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4368/8757] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:36:12 2022] PUT /identity/v3/projects/31f1f1e662e94d4899d83dcdc61cb9c8/users/581e969a68fc439f8021e3c106a1b58b/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:36:12.145426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61745a-4ae2-497f-9019-b7052b2bd827 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:12.145810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61745a-4ae2-497f-9019-b7052b2bd827 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:12.146092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61745a-4ae2-497f-9019-b7052b2bd827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:12.164849 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-bc61745a-4ae2-497f-9019-b7052b2bd827 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:12.166120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bc61745a-4ae2-497f-9019-b7052b2bd827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:12.228265 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4390/8758] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:12.240709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:12.242556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:12.274448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:12.306293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528aea-332c-499f-b7de-cd8cd3ffc368 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:12.310453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:12.311111 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:12.311402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:12.311687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:12.321360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:12.322830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9c8cc-bf39-4a69-8b19-dfc19f551ccd service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:12.332846 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4369/8759] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:36:16.343554 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:16.344045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:16.344126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:16.372584 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] MFA Rules not processed for user `581e969a68fc439f8021e3c106a1b58b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:16.373881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:16.452213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4391/8760] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:16.467658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c0a1-f4e3-4ac5-a4f0-2bd40ac92b24 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:16.467658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c0a1-f4e3-4ac5-a4f0-2bd40ac92b24 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:16.467658 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c0a1-f4e3-4ac5-a4f0-2bd40ac92b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:16.485721 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c323c0a1-f4e3-4ac5-a4f0-2bd40ac92b24 None None] MFA Rules not processed for user `581e969a68fc439f8021e3c106a1b58b`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:16.486820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c323c0a1-f4e3-4ac5-a4f0-2bd40ac92b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:16.497489 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4370/8761] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:16.509570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:16.511120 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:16.594806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afef62-51e1-4437-b872-5806ce028d65 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:16.600451 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:16.601133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:16.601422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:16.601705 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:16.606924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:16.612348 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:16.614538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24530bc-eb01-4ab1-a3c7-b400ea4cd207 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:16.624678 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4392/8762] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:36:26.479985 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=17 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:26.621730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:27.717148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:27.717683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:27.717683 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:27.719081 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4371/8763] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:36:27.724729 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f1f5-6d9b-4783-bdd6-278f09779bdd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:27.725186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f1f5-6d9b-4783-bdd6-278f09779bdd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:27.725306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f1f5-6d9b-4783-bdd6-278f09779bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:27.756486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9542f1f5-6d9b-4783-bdd6-278f09779bdd None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:36:27.757687 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9542f1f5-6d9b-4783-bdd6-278f09779bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:27.826553 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4393/8764] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:36:27.847588 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:36:27.849497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:36:27.869865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d01a1a-fcf8-4195-b28f-5a17eeeeadce None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:36:27.875393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:36:27.876066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:36:27.876330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:36:27.876652 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:36:27.885585 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:36:27.887193 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86995c-5492-40cc-bb02-6173227220c1 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:36:27.897563 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4372/8765] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:36:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:36:37.817395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=33 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:37.893173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:10.479254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd687-e8ef-41e8-a4c2-8d9373113f38 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:37:10.479832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd687-e8ef-41e8-a4c2-8d9373113f38 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:37:10.479832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd687-e8ef-41e8-a4c2-8d9373113f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:37:10.497889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-601dd687-e8ef-41e8-a4c2-8d9373113f38 None None] MFA Rules not processed for user `581e969a68fc439f8021e3c106a1b58b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:37:10.499114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-601dd687-e8ef-41e8-a4c2-8d9373113f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:37:10.507515 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4394/8766] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:37:20.492373 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:22.277725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:37:22.278278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:37:22.278278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:37:22.279823 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4373/8767] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:37:22.285032 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:37:22.285503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:37:22.285788 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:37:22.305542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:37:22.306790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:37:22.317076 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4395/8768] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:37:22.337994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:37:22.339752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:37:22.360189 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f663-be7a-4121-8057-aaf3ea935197 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:37:22.365423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:37:22.366063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:37:22.366383 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:37:22.366635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:37:22.375482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:37:22.377122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:37:22.387187 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4374/8769] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:37:32.300186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:32.382998 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:53.766594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:37:53.768137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:37:53.784029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c114329-23ff-4a03-bf47-412f75412edd None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:37:53.788548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:37:53.789323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:37:53.789634 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:37:53.789964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:37:53.792024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:37:53.805635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:37:53.807306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:37:53.819081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4396/8770] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:38:02.843649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:02.855104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28638e-b93a-434c-a2cd-964b41e4547c service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:02.860489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:02.861395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:02.861674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:02.861949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] PATH_INFO: `/v3/users/581e969a68fc439f8021e3c106a1b58b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:02.863310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581e969a68fc439f8021e3c106a1b58b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:02.865307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:02.918348 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581e969a68fc439f8021e3c106a1b58b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:02.926561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581e969a68fc439f8021e3c106a1b58b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:02.938339 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581e969a68fc439f8021e3c106a1b58b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:02.938963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581e969a68fc439f8021e3c106a1b58b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:02.939582 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2c4cf139-50d3-42e1-94c6-39289cb46c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581e969a68fc439f8021e3c106a1b58b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:02.951585 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4375/8771] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:38:02 2022] DELETE /identity/v3/users/581e969a68fc439f8021e3c106a1b58b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:38:03.141492 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.155515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41310-fcdd-4ff0-b4df-33a7f1afbb8b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.223928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.224843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.225123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.225399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] PATH_INFO: `/v3/projects/31f1f1e662e94d4899d83dcdc61cb9c8` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.226610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f1f1e662e94d4899d83dcdc61cb9c8)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.228551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.276470 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f1f1e662e94d4899d83dcdc61cb9c8', 'request_id': 'req-d1a7eea9-41af-4255-9590-b4da11a30e7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:03.285173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f1f1e662e94d4899d83dcdc61cb9c8', 'request_id': 'req-d1a7eea9-41af-4255-9590-b4da11a30e7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:03.291132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f1f1e662e94d4899d83dcdc61cb9c8', 'request_id': 'req-d1a7eea9-41af-4255-9590-b4da11a30e7a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:03.303296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] The token cache is being invalidate because project 31f1f1e662e94d4899d83dcdc61cb9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:38:03.303588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:03.304243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-d1a7eea9-41af-4255-9590-b4da11a30e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:38:03.305915 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4397/8772] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:38:03 2022] DELETE /identity/v3/projects/31f1f1e662e94d4899d83dcdc61cb9c8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:38:03.311049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.311347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.311626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.331150 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:03.332386 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:03.394421 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4376/8773] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:03.403138 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.403431 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.403728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.423056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:03.424290 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:03.432484 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4398/8774] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:03.436903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.446726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306fed-2d7b-45b8-8b18-4552aef5d12b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.451823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.452576 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.452856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.453132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.453859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:38:03.454172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.455795 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.468079 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4377/8775] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:38:03.472667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.483133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9e37-1c88-46f7-9f42-83c88d801bef None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.489620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.490319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.490607 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.490882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.491579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.493549 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.535015 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4399/8776] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:38:03 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:38:03.540042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.560021 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec48505-d791-4bfb-bc2c-4c95cb7fee4f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.620716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.621435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.621709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.621991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.622680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.624736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.631413 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:03.647382 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4378/8777] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:38:03 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:38:03.651668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.662690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f99-68c1-4ddf-b1c1-a5821a2fd7f0 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.668401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.669106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.669388 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.669683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.670415 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.672052 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.682644 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4400/8778] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:38:03.686938 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.698231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b81517-6f4a-4c75-abe0-a70dcdad536a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.707642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.709444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.709737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.710018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.711342 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.713650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485eb7d-4d8a-4166-9908-1104646f9e38 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.730128 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4379/8779] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:38:03.737276 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.750567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee81e8-0903-4558-b743-a29aea41b09c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.755819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.756758 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.757039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.757317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] PATH_INFO: `/v3/projects/252cb11a6c804df8840720793581d971/users/39b0356717474e7fabff20aa3fa9e309/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.773179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252cb11a6c804df8840720793581d971, user_id=39b0356717474e7fabff20aa3fa9e309, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.775854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:03.790799 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4401/8780] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:38:03 2022] PUT /identity/v3/projects/252cb11a6c804df8840720793581d971/users/39b0356717474e7fabff20aa3fa9e309/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:38:03.796078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b2a3-27ad-40cf-ae2a-eb74ff4e38e2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.796377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b2a3-27ad-40cf-ae2a-eb74ff4e38e2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.796708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b2a3-27ad-40cf-ae2a-eb74ff4e38e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.815293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1465b2a3-27ad-40cf-ae2a-eb74ff4e38e2 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:03.816494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1465b2a3-27ad-40cf-ae2a-eb74ff4e38e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:03.884755 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4380/8781] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:03.894900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:03.896946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:03.905551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:03.966272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39972ee-4f9e-4546-a8b1-e537da2bf818 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:03.971872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:03.972974 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:03.973323 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:03.973733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:03.988399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:03.989919 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:04.000176 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4402/8782] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:38:08.078401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24018df-794c-432d-94c4-ead335be837e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:08.078954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24018df-794c-432d-94c4-ead335be837e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:08.079049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24018df-794c-432d-94c4-ead335be837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:08.109845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-a24018df-794c-432d-94c4-ead335be837e None None] MFA Rules not processed for user `39b0356717474e7fabff20aa3fa9e309`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:08.111511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a24018df-794c-432d-94c4-ead335be837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:08.185495 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4381/8783] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:08.200491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:08.201941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:08.282291 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062be75-4bc4-49a4-b440-9dd310f29a8e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:08.288371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:08.289068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:08.289358 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:08.289651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:08.298560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:08.300187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:08.310607 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4403/8784] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:38:09.592963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:09.593520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:09.593520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:09.612852 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] MFA Rules not processed for user `39b0356717474e7fabff20aa3fa9e309`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:09.614079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:09.621099 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4382/8785] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:18.305725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=58 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:19.606268 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.171815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:52.173517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:52.189928 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a21f4-f4f3-4f23-9dc7-1c9045afc15b service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:52.193768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:52.194536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:52.194815 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:52.195114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:52.197292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:52.214721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:52.216249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836d4a4-ad98-4b25-9c60-a68a5e8f01da service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:52.231100 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4404/8786] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:38:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:38:52.412222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:52.431128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f6cdc-7fbb-4817-8c0f-4d724187a259 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:52.436351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:52.437032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:52.437310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:52.437583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:52.439508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:52.456002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:52.457472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd111d7d-fef3-4326-a7dc-8171256898ed service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:52.471498 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4383/8787] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:38:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:38:53.152203 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:53.152689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:53.153030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] PATH_INFO: `/` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:53.154847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4405/8788] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:38:53.160069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:53.160362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:53.160696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:53.190384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:38:53.191639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:53.262137 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4384/8789] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:38:53.287404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:38:53.289165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:38:53.308800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a57e0c-f6ad-48ae-89c1-041f39224096 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:38:53.313993 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:38:53.314633 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:38:53.314913 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:38:53.315174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:38:53.323723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:38:53.325370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249aef-3df1-4584-9856-65ad0cfa7fa4 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:38:53.335017 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4406/8790] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:39:03.248874 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=35 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:03.331101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:06.788304 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:39:06.801133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b973e-354e-45a3-8aa1-0e2b922d1f05 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:39:06.805686 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:39:06.806384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:39:06.806669 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:39:06.807068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:39:06.809272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:39:06.825117 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:39:06.827043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ebe1b-bea4-4c34-9e27-d2e087e869a5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:39:06.838690 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4385/8791] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:39:16.831926 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:18.150475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5745c-f41a-40e4-b2e2-1afe0cb9e041 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:39:18.150989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5745c-f41a-40e4-b2e2-1afe0cb9e041 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:39:18.151091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5745c-f41a-40e4-b2e2-1afe0cb9e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:39:18.169596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3df5745c-f41a-40e4-b2e2-1afe0cb9e041 None None] MFA Rules not processed for user `39b0356717474e7fabff20aa3fa9e309`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:39:18.170816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3df5745c-f41a-40e4-b2e2-1afe0cb9e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:39:18.179001 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4407/8792] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:39:28.164166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:12.189461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.190081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.190081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.191408 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4386/8793] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:40:12.196695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.197200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.197303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.218235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:40:12.219456 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:12.229494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4408/8794] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:40:12.249818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:12.251704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:12.271699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f9c6b-3ab6-4071-a608-a41f0aefdba7 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:12.276905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:12.277534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.277817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.278095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.286717 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:12.288338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e70e4-36da-41e4-830f-d0dd6f5ed5b9 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:12.298193 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4387/8795] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:12.382702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:12.396532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf8393-9c08-497d-a1ff-eab3385e33de None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:12.402668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:12.403326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.403673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.403952 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.405942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:12.421098 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:12.422730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:12.436235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4409/8796] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:12.524355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.524676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.524962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.544561 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:40:12.545883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:12.555945 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4388/8797] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:40:12.567508 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:12.580963 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fe9c8-1ff7-46a4-b4ad-223205313e77 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:12.586267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158368e9-afab-442e-846d-ba5703af013d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:12.586942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158368e9-afab-442e-846d-ba5703af013d service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.587596 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158368e9-afab-442e-846d-ba5703af013d service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.587868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158368e9-afab-442e-846d-ba5703af013d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.597192 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158368e9-afab-442e-846d-ba5703af013d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:12.598796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158368e9-afab-442e-846d-ba5703af013d service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:12.609089 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4410/8798] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:12.963537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:12.978300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c4f-01d0-4cc1-93c1-18d42237641a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:12.984376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:12.985069 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:12.985355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:12.985639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:12.987590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:13.003390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:13.005052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:13.018236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4389/8799] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:16.492672 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158368e9-afab-442e-846d-ba5703af013d service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:16.508223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158368e9-afab-442e-846d-ba5703af013d service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:16.514225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:16.514875 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:16.515165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:16.515444 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:16.517289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:16.532555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:16.534166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395dc1e-7462-4ab6-b152-16dc0f03e659 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:16.549438 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4411/8800] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:23.011151 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=15 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:23.345710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:23.347511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:23.369136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1fea-b6ed-461c-9b60-1982df74ad31 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:23.375687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:23.377502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:23.377502 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:23.377737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:23.379990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:23.397367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:23.399138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d8b23-5f44-4ce6-825c-3d694ecdd920 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:23.413987 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4390/8801] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:26.541808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=21 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:28.426382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:28.426982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:28.426982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:28.446074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] MFA Rules not processed for user `39b0356717474e7fabff20aa3fa9e309`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:40:28.447467 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:28.455641 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4412/8802] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:40:28.774493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b107e-eb6b-4388-ad48-51488da015d8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:28.775270 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b107e-eb6b-4388-ad48-51488da015d8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:28.775408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b107e-eb6b-4388-ad48-51488da015d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:28.821742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-980b107e-eb6b-4388-ad48-51488da015d8 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:40:28.822997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-980b107e-eb6b-4388-ad48-51488da015d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:28.831158 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4391/8803] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 25 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:40:28.837723 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:28.848132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e64bd-71c5-4bec-bf00-10e5dc8460a5 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:28.852229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:28.852908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:28.853199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:28.853472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:28.855461 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:28.868263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:28.869730 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:28.883738 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4413/8804] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:29.214471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33cbd-9b85-4c79-8b66-e04e37b5bbee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:29.214764 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33cbd-9b85-4c79-8b66-e04e37b5bbee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:29.215042 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a33cbd-9b85-4c79-8b66-e04e37b5bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:29.234504 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f3a33cbd-9b85-4c79-8b66-e04e37b5bbee None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:40:29.237958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f3a33cbd-9b85-4c79-8b66-e04e37b5bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:40:29.249853 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4392/8805] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:40:29.261956 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:40:29.277555 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f205b9-271c-468e-9777-46e12451c4ea service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:40:29.287055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:40:29.287055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:40:29.287055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:40:29.287055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:40:29.293932 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:40:29.295857 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:40:29.305717 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4414/8806] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:40:39.228712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=18 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:39.302068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=15 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:53.230807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c4d-5db4-4a6b-8b92-c5df70db7228 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.231417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c4d-5db4-4a6b-8b92-c5df70db7228 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.231417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c4d-5db4-4a6b-8b92-c5df70db7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.261951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ab3f4c4d-5db4-4a6b-8b92-c5df70db7228 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:41:53.263187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ab3f4c4d-5db4-4a6b-8b92-c5df70db7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:41:53.270969 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4393/8807] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 25 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:41:53.282523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:41:53.292178 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640221aa-fa4a-4d6a-b68b-1f1b8f0d4d73 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:41:53.295893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:41:53.296573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.296862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.297130 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.298973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:41:53.311916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:41:53.313328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7860a8-d924-4f6e-a9c9-05760f4545c0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:41:53.324270 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4415/8808] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:41:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:41:53.422435 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87a4-543e-4fa3-8a55-1373c2025fec None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.422722 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87a4-543e-4fa3-8a55-1373c2025fec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.423004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87a4-543e-4fa3-8a55-1373c2025fec None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.424537 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4394/8809] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:41:53.429424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.429742 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.430015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.448894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:41:53.450087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:41:53.473633 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4416/8810] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:41:53.494387 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc87a4-543e-4fa3-8a55-1373c2025fec None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:41:53.511234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc87a4-543e-4fa3-8a55-1373c2025fec None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:41:53.517660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:41:53.518313 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.518606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.518880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.528036 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:41:53.529706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5c422-9aa9-4b06-b571-5001f4bd47ed service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:41:53.539657 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4395/8811] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:41:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:41:53.707260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:41:53.718043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84db2-942d-468b-88f3-0e1fa9781599 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:41:53.722861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:41:53.723519 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:41:53.723808 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:41:53.724088 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:41:53.726158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:41:53.743378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:41:53.744880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:41:53.758907 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4417/8812] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:41:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:42:03.535799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=13 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:03.751670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=21 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:24.173790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:42:24.174312 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:42:24.174417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:42:24.192183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] MFA Rules not processed for user `39b0356717474e7fabff20aa3fa9e309`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:42:24.193445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:42:24.200732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4396/8813] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:42:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:42:24.507632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:42:24.516517 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fce0-1229-4e0a-bf05-bfab0b84b451 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:42:24.521064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:42:24.521731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:42:24.522045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:42:24.522316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:42:24.524270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:42:24.537284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:42:24.538724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:42:24.549212 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4418/8814] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:42:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:42:28.533565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:42:28.551516 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8d3ff-9701-49de-8245-8159b437109f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:42:28.558649 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:42:28.559086 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:42:28.560077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:42:28.560406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:42:28.562731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:42:28.580255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:42:28.581942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfc39-f639-4c55-b35c-c9238fafbaef service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:42:28.599967 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4397/8815] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:42:28.779620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:42:28.795859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcb6b-917c-4e03-b82b-a42fe204df51 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:42:28.801332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:42:28.801983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:42:28.802269 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:42:28.802567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:42:28.804691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:42:28.823895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:42:28.825590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:42:28.842543 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4419/8816] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:42:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:42:38.590462 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=9 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:38.832624 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:50.991364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:50.992179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:50.992384 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:51.043277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] MFA Rules not processed for user `083565d7e7e3423486d9bfd51efaf318`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:43:51.044560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:43:51.126574 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4398/8817] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 25 21:43:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:43:51.133247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:43:51.154573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d777e4-1ed2-4826-b26e-fa5eb8cd08c5 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:43:51.159015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:43:51.159673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:51.159962 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:51.160244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:51.169106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:43:51.170563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:43:51.179795 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4420/8818] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:43:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:43:52.591212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:43:52.620993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de8bf-68ff-4188-8b48-486bfe01d3f4 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:43:52.625651 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:43:52.626299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:52.626590 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:52.626870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:52.656441 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:43:52.657933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc7cd-0d0c-47dd-9a5e-22d47f41b1e4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:43:52.672074 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4399/8819] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:43:52.864680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:43:52.867014 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:43:52.887602 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88392b8-7659-405c-b95d-8f3900b1235e service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:43:52.891894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:43:52.892592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:52.892882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:52.893160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:52.906979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:43:52.908441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eede3-28f1-4db8-bb65-1e4292ae8e22 service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:43:52.922405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4421/8820] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:43:56.718994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cac1e-dc84-48be-97c7-436819f5c95e None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:56.719607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cac1e-dc84-48be-97c7-436819f5c95e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:56.719607 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cac1e-dc84-48be-97c7-436819f5c95e None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:56.721236 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4400/8821] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:43:56.726660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:56.727134 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:56.727256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:56.746751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:43:56.747985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:43:56.757870 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4422/8822] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:43:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:43:56.778134 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cac1e-dc84-48be-97c7-436819f5c95e None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:43:56.794862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cac1e-dc84-48be-97c7-436819f5c95e None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:43:56.799935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:43:56.800623 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:43:56.800909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:43:56.801187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:43:56.811361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:43:56.813984 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:43:56.826432 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4401/8823] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:43:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:06.741619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=20 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:06.820699 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=69 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:15.117650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:15.128055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf109f1-c248-4e76-a765-f807f0bed764 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:15.136273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:15.137361 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:15.137769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:15.138243 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:15.152774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:15.154658 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:15.169114 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4423/8824] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:44:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:25.161462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:38.226532 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:38.236693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cb424-9e2a-46df-9737-5fd94dc6f61a service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:38.240685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:38.241360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:38.241642 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:38.241939 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:38.253016 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:38.254470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:38.283944 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4402/8825] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:41.176570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.208311 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968e45-450a-47c8-a528-16762f90b10e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.213874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:41.214546 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.214831 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.215110 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.216929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:41.231989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:41.234055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:41.247121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.255746 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4424/8826] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:44:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:41.258732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf64da-89d7-4162-83e6-7e17563b782d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.265824 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:41.268122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.268402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.268714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] PATH_INFO: `/v3/users/39b0356717474e7fabff20aa3fa9e309` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.270094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b0356717474e7fabff20aa3fa9e309)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:41.272172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:41.321685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b0356717474e7fabff20aa3fa9e309'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.329789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b0356717474e7fabff20aa3fa9e309'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.342538 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b0356717474e7fabff20aa3fa9e309'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.343222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b0356717474e7fabff20aa3fa9e309'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.343876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-497bb9ad-ec46-4ee3-9660-2ea2adb91127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b0356717474e7fabff20aa3fa9e309'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.356891 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4403/8827] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:44:41 2022] DELETE /identity/v3/users/39b0356717474e7fabff20aa3fa9e309 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:44:41.535503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.546865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c019-e983-4514-9027-802e58b52eee service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.611627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:41.612679 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.612968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.613250 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] PATH_INFO: `/v3/projects/252cb11a6c804df8840720793581d971` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.614450 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=252cb11a6c804df8840720793581d971)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:41.617515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:41.668743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252cb11a6c804df8840720793581d971', 'request_id': 'req-7f850eec-22f3-4e03-b832-10d9ab3828ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.676708 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252cb11a6c804df8840720793581d971', 'request_id': 'req-7f850eec-22f3-4e03-b832-10d9ab3828ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.682981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252cb11a6c804df8840720793581d971', 'request_id': 'req-7f850eec-22f3-4e03-b832-10d9ab3828ee'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.707840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] The token cache is being invalidate because project 252cb11a6c804df8840720793581d971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:44:41.708067 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.708860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-7f850eec-22f3-4e03-b832-10d9ab3828ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:44:41.710464 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4425/8828] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:44:41 2022] DELETE /identity/v3/projects/252cb11a6c804df8840720793581d971 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:44:41.716108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.716399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.716712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.734993 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:41.736205 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:41.798239 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4404/8829] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:44:41.807140 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087a19-5331-4214-a489-9778c717b954 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.807435 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087a19-5331-4214-a489-9778c717b954 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.807715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087a19-5331-4214-a489-9778c717b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.828436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d0087a19-5331-4214-a489-9778c717b954 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:41.829670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0087a19-5331-4214-a489-9778c717b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:41.837823 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4426/8830] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:44:41.842735 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.852586 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198769-0ad1-4048-97b2-bbc38d7c812b None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.858378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:41.859060 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.859345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.859621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.860356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:44:41.860719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:41.862381 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:41.874888 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4405/8831] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:44:41.879364 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0087a19-5331-4214-a489-9778c717b954 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.888999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0087a19-5331-4214-a489-9778c717b954 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.894102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:41.894761 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:41.895048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:41.895329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:41.896021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:41.898080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:41.926507 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4427/8832] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:44:41 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:44:41.932834 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:41.943844 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba7e1c-99f3-42ee-a948-b357bac474f6 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:41.975355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:42.007195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:42.007880 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.008168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.008496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.009208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:42.011165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:42.033321 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4406/8833] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:44:41 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:44:42.037826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:42.048728 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6760-d550-4899-a9e8-7269b73d8a56 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:42.053579 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:42.054241 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.054523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.054796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.055539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:42.057205 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:42.067115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4428/8834] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:44:42.071127 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:42.081615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148909-b35c-4105-ab30-43be638ac13b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:42.086553 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:42.087257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.087536 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.087843 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.088958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:42.090579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2c493-2c0f-45a2-8ab4-6a2225eb7750 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:42.101234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4407/8835] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:44:42.105434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:42.116091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714404-94ad-4963-b889-a0e49ea19e83 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:42.121613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:42.122504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.122781 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.123062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] PATH_INFO: `/v3/projects/49b14b2b91e84382b20f46a788ecba70/users/e368fa23f5ab4e6887af9a885e560164/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.140136 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b14b2b91e84382b20f46a788ecba70, user_id=e368fa23f5ab4e6887af9a885e560164, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:42.143663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:42.146156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:42.162012 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4429/8836] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:44:42 2022] PUT /identity/v3/projects/49b14b2b91e84382b20f46a788ecba70/users/e368fa23f5ab4e6887af9a885e560164/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:44:42.167226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a830-93ca-4b34-bc24-655cd541d490 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.167521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a830-93ca-4b34-bc24-655cd541d490 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.167829 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358a830-93ca-4b34-bc24-655cd541d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.186531 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3358a830-93ca-4b34-bc24-655cd541d490 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:42.187749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3358a830-93ca-4b34-bc24-655cd541d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:42.248769 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4408/8837] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:44:42.259796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:42.261686 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:42.333198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b5da-0cb9-4b2d-a138-97dce730ece8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:42.337653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:42.338302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:42.338936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:42.339212 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:42.348968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:42.350600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0051-4ea6-479b-8d46-4737b9d14ed7 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:42.361814 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4430/8838] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:46.348893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:46.349423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:46.349523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:46.380349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] MFA Rules not processed for user `e368fa23f5ab4e6887af9a885e560164`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:46.380349 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:46.449955 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4409/8839] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:44:46.461629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854fe5-7c1c-4caa-8ea7-ae917d65e2f9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:46.462200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854fe5-7c1c-4caa-8ea7-ae917d65e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:46.462200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854fe5-7c1c-4caa-8ea7-ae917d65e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:46.481826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-01854fe5-7c1c-4caa-8ea7-ae917d65e2f9 None None] MFA Rules not processed for user `e368fa23f5ab4e6887af9a885e560164`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:46.483093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-01854fe5-7c1c-4caa-8ea7-ae917d65e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:46.496597 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4431/8840] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:44:46.503787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:44:46.505605 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:46.570631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:46.654710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40efa71-bb00-418d-86c4-9904d4a65eba None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:44:46.660980 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:44:46.661783 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:46.662072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:46.662355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:46.671109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:44:46.672796 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:44:46.682843 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4410/8841] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:44:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:44:56.475552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:INSERT=1,keystone:SELECT=36 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:56.678188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=25 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:59.209884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:44:59.210433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:44:59.210530 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:44:59.231573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] MFA Rules not processed for user `e368fa23f5ab4e6887af9a885e560164`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:44:59.232822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:44:59.240978 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4432/8842] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:09.226003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:16.254893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:16.256650 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:16.344056 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2aa3-6dee-4001-881d-5b6de84b8600 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:16.349794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:16.350444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:16.350730 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:16.351002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:16.352919 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:16.367169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:16.368918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:16.381511 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4411/8843] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:17.572483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:17.593662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aba0e-829d-428a-8e46-bf7d2112181d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:17.601810 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:17.602726 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:17.603056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:17.603414 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:17.606359 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:17.624416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:17.626155 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:17.641714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4433/8844] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:45:17.717380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:17.718909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:17.735076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bea868-1bdb-41bf-bfb4-b1fc72293078 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:17.740153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:17.740839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:17.741125 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:17.741428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:17.743214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:17.757508 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:17.759186 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:17.771756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4412/8845] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:22.261900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:22.277195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cd79f-41ed-48fa-983e-7bafa070047c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:22.284033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:22.284844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.285240 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.285626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.287572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:22.305538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:22.307175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:22.329249 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4434/8846] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:22.346534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:22.358641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5191e-cc58-4eb6-bf27-49b4245bf29b service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:22.363803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:22.364770 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.365055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.365335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] PATH_INFO: `/v3/users/e368fa23f5ab4e6887af9a885e560164` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.366540 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e368fa23f5ab4e6887af9a885e560164)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:22.368814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:22.418617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e368fa23f5ab4e6887af9a885e560164'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.429329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e368fa23f5ab4e6887af9a885e560164'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.443231 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e368fa23f5ab4e6887af9a885e560164'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.444118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e368fa23f5ab4e6887af9a885e560164'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.444743 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-43eec438-ab4f-4658-8c9a-34a43553be11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e368fa23f5ab4e6887af9a885e560164'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.460989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4413/8847] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:45:22 2022] DELETE /identity/v3/users/e368fa23f5ab4e6887af9a885e560164 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:22.643043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:22.655396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569d475-1755-4ed2-bfdb-de7d56d50a8b service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:22.714133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:22.715020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.715307 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.715571 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] PATH_INFO: `/v3/projects/49b14b2b91e84382b20f46a788ecba70` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.716821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b14b2b91e84382b20f46a788ecba70)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:22.718738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:22.766204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b14b2b91e84382b20f46a788ecba70', 'request_id': 'req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.773870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b14b2b91e84382b20f46a788ecba70', 'request_id': 'req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.779727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b14b2b91e84382b20f46a788ecba70', 'request_id': 'req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.791217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] The token cache is being invalidate because project 49b14b2b91e84382b20f46a788ecba70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:45:22.791512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.792253 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94a9a23d-1ca2-4c71-a0d5-9c43bd0ea3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:22.793950 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4435/8848] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:45:22 2022] DELETE /identity/v3/projects/49b14b2b91e84382b20f46a788ecba70 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:22.799395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.799693 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.799978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.857095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:22.860136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:22.861467 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:22.923724 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4414/8849] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:22.932300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.932620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.932901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.952757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:22.953979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:22.963064 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4436/8850] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:22.967716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:22.978093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f9f4-442c-4d40-b871-e1b8c441ac19 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:22.983408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:22.984113 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:22.984390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:22.984729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:22.985456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:45:22.985762 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:22.987390 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:22.999149 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4415/8851] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:45:23.003538 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.013238 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c961f-3f01-4f57-a29e-c3e1430c291d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.018122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.018769 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.019054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.019326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.020042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.021985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.049048 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4437/8852] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:45:23 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:23.053314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.064394 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb1299-2d8a-48dd-9c26-ddba28995a7c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.123782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.124380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.125128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.125398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.126096 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.128027 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.147679 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4416/8853] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:45:23 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:23.151936 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.162878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcb51c-b648-49e6-9b71-65a0974718ab admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.168727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.169399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.169682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.169986 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.170681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.172295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.189936 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4438/8854] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:23.191146 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.201667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9dc7-807f-42ba-a5cd-236db83f0c81 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.206641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.207303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.207581 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.207883 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.208637 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.210260 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd15e32-88be-46ec-b525-f601ad1bd0b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.220687 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4417/8855] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 21:45:23.224835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.235496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eec11-2df6-43c1-9e0d-557764644151 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.240682 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.241580 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.241894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.242177 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] PATH_INFO: `/v3/projects/eb08edc4eb2d419580894532e9ce68d2/users/eb61c65f91c847ef8cec416ea2e6df56/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.257378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb08edc4eb2d419580894532e9ce68d2, user_id=eb61c65f91c847ef8cec416ea2e6df56, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.260086 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.270573 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:23.276026 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4439/8856] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:45:23 2022] PUT /identity/v3/projects/eb08edc4eb2d419580894532e9ce68d2/users/eb61c65f91c847ef8cec416ea2e6df56/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:23.339729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.340017 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.340283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.372272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] MFA Rules not processed for user `eb61c65f91c847ef8cec416ea2e6df56`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:23.373513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:23.440322 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4418/8857] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:23.451263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:23.453193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:23.514351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c91da-75b0-40a9-826a-fe11a555d4d8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:23.519092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:23.519754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:23.520037 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:23.520310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:23.529644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:23.531092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7eec-0500-48db-8b95-2d6e9e3d451e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:23.540257 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4440/8858] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:33.437604 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:33.536044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=26 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:33.956401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.031278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a674be-6465-4eb5-a656-998d5ac2bca5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.036081 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.037018 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.037272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.037554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] PATH_INFO: `/v3/users/eb61c65f91c847ef8cec416ea2e6df56` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.038861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb61c65f91c847ef8cec416ea2e6df56)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.040892 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.099297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb61c65f91c847ef8cec416ea2e6df56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.114128 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb61c65f91c847ef8cec416ea2e6df56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.128486 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb61c65f91c847ef8cec416ea2e6df56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.129195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb61c65f91c847ef8cec416ea2e6df56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.129997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb61c65f91c847ef8cec416ea2e6df56'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.144256 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4419/8859] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:45:33 2022] DELETE /identity/v3/users/eb61c65f91c847ef8cec416ea2e6df56 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:34.149076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.149369 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.149650 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.167354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:34.168610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:34.235429 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4441/8860] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:45:34.247826 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.249374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:34.312996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769f32-4901-4e39-ace4-f9fc84491617 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.317356 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.318055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.318336 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.318613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.329724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.331194 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fa5f1-3ec9-45e0-84b7-ac481179d90d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.341933 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4420/8861] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:45:34.534799 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.536293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:34.548598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ad01-a906-4946-bf89-ebd74bd590b0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.553817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.555121 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.555469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.555752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] PATH_INFO: `/v3/projects/eb08edc4eb2d419580894532e9ce68d2` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.557055 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb08edc4eb2d419580894532e9ce68d2)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.560830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.623263 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb08edc4eb2d419580894532e9ce68d2', 'request_id': 'req-8f7f11e4-bdda-4606-895f-e46a24cf69f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.630837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb08edc4eb2d419580894532e9ce68d2', 'request_id': 'req-8f7f11e4-bdda-4606-895f-e46a24cf69f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.637073 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb08edc4eb2d419580894532e9ce68d2', 'request_id': 'req-8f7f11e4-bdda-4606-895f-e46a24cf69f0'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.649019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] The token cache is being invalidate because project eb08edc4eb2d419580894532e9ce68d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:45:34.649267 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.649978 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-8f7f11e4-bdda-4606-895f-e46a24cf69f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:34.651853 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4442/8862] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:45:34 2022] DELETE /identity/v3/projects/eb08edc4eb2d419580894532e9ce68d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:45:34.657144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.657589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.657692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.677392 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:34.678624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:34.697158 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:34.742869 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4421/8863] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:34.752664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.752967 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.753390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.781165 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:34.782314 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:34.792043 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4443/8864] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:34.796781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.808833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635974b-0ca8-4524-9dd9-4b8a489a0a94 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.814786 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.815496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.815757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.816065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.816836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:45:34.817144 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.818775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.832212 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4422/8865] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:45:34.840077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.850278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe056a05-3ffb-4663-be64-f06a9cb7fcd9 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.858528 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.859720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.859720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.859720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.860462 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.862401 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.896729 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4444/8866] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:45:34 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:34.901456 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:34.912092 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb72749-34c4-4019-9d7e-7fdac83f65fe admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:34.973029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:34.973712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:34.974000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:34.974277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:34.974974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:34.976964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:34.999386 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4423/8867] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:45:34 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:35.003979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:35.014987 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e221-27a2-46e3-9e6c-65d97b3f549b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:35.020045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:35.020745 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:35.021030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:35.021306 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:35.022042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:35.023676 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:35.035884 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4445/8868] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:35.040007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:35.051135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4f59-2919-4690-9dc2-47afc24b82fc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:35.056602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:35.057273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:35.057558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:35.057955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:35.058682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:35.060300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b6272-bae2-453e-9b12-6d885bcc5210 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:35.070486 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4424/8869] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:35.075507 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:35.088219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750c6b8-ffa8-4816-bee5-ad0a295e9fa2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:35.094214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:35.095111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:35.095393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:35.095666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] PATH_INFO: `/v3/projects/b9cc260ed94e448a921e4caa2cbc569b/users/963ef02834b64d939e1b8516805a0089/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:35.112127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cc260ed94e448a921e4caa2cbc569b, user_id=963ef02834b64d939e1b8516805a0089, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:35.114894 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:35.131263 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4446/8870] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:45:35 2022] PUT /identity/v3/projects/b9cc260ed94e448a921e4caa2cbc569b/users/963ef02834b64d939e1b8516805a0089/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:35.142400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:35.142694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:35.143003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:35.170098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] MFA Rules not processed for user `963ef02834b64d939e1b8516805a0089`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:35.171341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:35.246756 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4425/8871] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:35.257476 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:35.259982 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:35.282570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:35.323054 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96699e7-be96-4b47-9d48-7853c031e373 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:35.327520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:35.328181 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:35.328489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:35.328771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:35.337500 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:35.339278 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af355-d353-4198-b271-77ca8d6e7eb6 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:35.348159 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4447/8872] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:39.775258 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:39.795512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:39.844551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eafc3e-ebaf-4c65-a874-0dad3f922b70 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:39.850059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:39.850949 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:39.851229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:39.851499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] PATH_INFO: `/v3/users/963ef02834b64d939e1b8516805a0089` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:39.852893 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963ef02834b64d939e1b8516805a0089)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:39.854830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:39.902956 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963ef02834b64d939e1b8516805a0089'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:39.911602 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963ef02834b64d939e1b8516805a0089'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:39.923589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963ef02834b64d939e1b8516805a0089'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:39.924237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963ef02834b64d939e1b8516805a0089'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:39.924857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963ef02834b64d939e1b8516805a0089'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:39.937437 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4426/8873] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:45:39 2022] DELETE /identity/v3/users/963ef02834b64d939e1b8516805a0089 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:39.942166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:39.942652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:39.942854 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:39.961411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:39.962626 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.029626 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4448/8874] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:40.041168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.042709 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.103405 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3826da-b084-4a06-bbc0-d6e443284636 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.107489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.108138 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.108437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.108732 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.118293 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.119755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceddca-0b67-4717-bc19-aeb5a5c9825e service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.129623 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4427/8875] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:45:40.307674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.309133 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.322229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1428a-3bf3-4bb7-8e47-6c1b7f9ac272 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.327254 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.328193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.328509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.328768 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] PATH_INFO: `/v3/projects/b9cc260ed94e448a921e4caa2cbc569b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.330046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cc260ed94e448a921e4caa2cbc569b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.332005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.381757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cc260ed94e448a921e4caa2cbc569b', 'request_id': 'req-77248031-aac9-4cef-a011-9e8f8d101c10'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:40.389644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cc260ed94e448a921e4caa2cbc569b', 'request_id': 'req-77248031-aac9-4cef-a011-9e8f8d101c10'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:40.395234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cc260ed94e448a921e4caa2cbc569b', 'request_id': 'req-77248031-aac9-4cef-a011-9e8f8d101c10'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:40.407660 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] The token cache is being invalidate because project b9cc260ed94e448a921e4caa2cbc569b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:45:40.407954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:40.408655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-77248031-aac9-4cef-a011-9e8f8d101c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:45:40.410232 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4449/8876] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:45:40 2022] DELETE /identity/v3/projects/b9cc260ed94e448a921e4caa2cbc569b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:40.416292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.416646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.416924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.435093 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:40.436307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.476367 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:40.503697 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4428/8877] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:45:40.513701 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.513996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.514285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.533389 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:40.534643 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.543405 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4450/8878] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:40.547724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.557861 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11acc17-ff33-420c-9134-7d4ef05fffe5 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.563377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.563954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.564243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.564559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.565327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:45:40.565633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.567282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.587999 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4429/8879] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 21:45:40.589545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.599493 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d1053-19c3-4161-9c9c-248af067c3d6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.606105 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.606773 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.607058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.607334 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.608064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.610000 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.637817 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4451/8880] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:45:40 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:45:40.642108 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.652946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc228-a60d-4df7-916b-91186670bd41 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.711391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.712052 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.712330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.712636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.713327 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.715624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.737288 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4430/8881] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:45:40 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:40.741731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.753053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74b4e-8d9c-4719-a308-14ce23b3e06c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.757851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.758587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.758871 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.759148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.759874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.761495 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.771943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4452/8882] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:40.776808 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.787546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a8d2-da09-4825-a5b6-5f00bc88d685 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.793211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.793955 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.794242 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.794523 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.795264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.796983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ce76-8eaa-43cd-b2d6-fa3ad26a1e27 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.813488 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4431/8883] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:40.817305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.829840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50230-d694-4e24-8fe5-0165dd69ccd9 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:40.836331 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:40.837409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.837692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.837968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] PATH_INFO: `/v3/projects/f1aca77315704d338f4f0f881e741a12/users/53b9cc03262c41d682254f9cf61f34a0/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.840862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:40.858144 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1aca77315704d338f4f0f881e741a12, user_id=53b9cc03262c41d682254f9cf61f34a0, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:40.860884 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:40.875745 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4453/8884] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:45:40 2022] PUT /identity/v3/projects/f1aca77315704d338f4f0f881e741a12/users/53b9cc03262c41d682254f9cf61f34a0/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:40.881215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13a0c-ec09-4edd-9063-ac8ba1f30223 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:40.881528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13a0c-ec09-4edd-9063-ac8ba1f30223 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:40.881809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13a0c-ec09-4edd-9063-ac8ba1f30223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:40.900671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-5aa13a0c-ec09-4edd-9063-ac8ba1f30223 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:40.901839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-5aa13a0c-ec09-4edd-9063-ac8ba1f30223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:40.965617 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4432/8885] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:40.976638 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:40.978399 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:41.042169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199a458-bc21-45a5-880d-950b69d4e79f admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:41.048310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:41.049412 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:41.049800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:41.050157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:41.063460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:41.064958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:41.076074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4454/8886] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:45.279564 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.280064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.280347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.316905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] MFA Rules not processed for user `53b9cc03262c41d682254f9cf61f34a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:45.318139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:45.353858 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:45.390206 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4433/8887] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:45.395002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.407295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177311-4f79-4e5e-989e-300709b53b97 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.416053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.416796 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.417081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.417363 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.418080 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.420039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.453135 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4455/8888] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 21:45:45.454921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.467461 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8246c5-f19d-4eb3-9891-e1fc052e1105 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.525505 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.526197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.526522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.526774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.527466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.529470 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.555384 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4434/8889] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:45:45 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:45:45.556628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.568153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5165d-dd65-4c47-939a-e3573447b41e admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.573075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.573792 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.574124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.574436 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.575166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.576942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.589007 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4456/8890] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:45.593437 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.607595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d82f1-6bda-4431-bf8e-de18dfd037b0 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.618208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.621083 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.621365 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.621641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] PATH_INFO: `/v3/projects/b217cd2ddf7c4255ac0e6984adc19262/users/97ab575f415b416494dd44d4b2f9b38b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.640354 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217cd2ddf7c4255ac0e6984adc19262, user_id=97ab575f415b416494dd44d4b2f9b38b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.643289 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.665767 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4435/8891] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:45:45 2022] PUT /identity/v3/projects/b217cd2ddf7c4255ac0e6984adc19262/users/97ab575f415b416494dd44d4b2f9b38b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:45.669901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.683248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68fa8-a93a-4d8d-8287-200089ce29f3 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.752598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.753301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.753656 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.753851 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.754655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.756315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766d6c2-6dd2-4486-8de4-6feaed11287e admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.770505 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4457/8892] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:45:45.771877 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:45.782887 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfcec-237a-4a25-8866-14363d426f63 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:45.788358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:45.789675 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:45.790136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:45.790556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] PATH_INFO: `/v3/projects/b217cd2ddf7c4255ac0e6984adc19262/users/97ab575f415b416494dd44d4b2f9b38b/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:45.792626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217cd2ddf7c4255ac0e6984adc19262, user_id=97ab575f415b416494dd44d4b2f9b38b, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:45.795282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca8ed4-d5a9-49d8-974f-ab398053376a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:45.810525 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4436/8893] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:45:45 2022] PUT /identity/v3/projects/b217cd2ddf7c4255ac0e6984adc19262/users/97ab575f415b416494dd44d4b2f9b38b/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:45:50.451839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:50.452293 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:50.452395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:50.486039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] MFA Rules not processed for user `97ab575f415b416494dd44d4b2f9b38b`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:50.487524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:50.534221 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:50.568504 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4458/8894] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:45:50.597595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b71d8-2704-4b1d-b6bc-74d4a038e902 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:50.597983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b71d8-2704-4b1d-b6bc-74d4a038e902 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:50.598167 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b71d8-2704-4b1d-b6bc-74d4a038e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:50.652278 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-b29b71d8-2704-4b1d-b6bc-74d4a038e902 None None] MFA Rules not processed for user `8cddedee376f4cf4a01caffdea20716d`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:50.653528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b29b71d8-2704-4b1d-b6bc-74d4a038e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:50.719842 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4437/8895] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Jun 25 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:50.726220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:50.736861 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ddc88-7aad-46cc-b50f-30708f727f72 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:50.740609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:50.741292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:50.741574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:50.741859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:50.802220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:50.803714 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d53a4-9290-47cc-9e81-e5102a8b06c1 service glance] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:50.813462 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4459/8896] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:45:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:45:50.937323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:50.937766 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:50.938175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:50.944755 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:50.998064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:50.999274 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:51.068855 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4438/8897] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:51.130793 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12df91-8926-40ae-b37d-7a8caec32640 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:51.131191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12df91-8926-40ae-b37d-7a8caec32640 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:51.131506 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12df91-8926-40ae-b37d-7a8caec32640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:51.201694 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4e12df91-8926-40ae-b37d-7a8caec32640 None None] MFA Rules not processed for user `c226aaf467e44e59b368c6b5c9db1cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:45:51.203576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4e12df91-8926-40ae-b37d-7a8caec32640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:45:51.289481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4460/8898] 10.222.0.39 () {58 vars in 1039 bytes} [Sat Jun 25 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:45:51.296667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:45:51.312524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f123-377b-4b54-8e8f-110139885d19 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:45:51.318970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:45:51.319616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:45:51.319906 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:45:51.320177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:45:51.329168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:45:51.330785 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:45:51.339700 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4439/8899] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:46:00.076158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0a12-b55d-41cb-9c81-726d5ebd3dda None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:00.076762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0a12-b55d-41cb-9c81-726d5ebd3dda None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:00.076762 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0a12-b55d-41cb-9c81-726d5ebd3dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:00.104102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-351c0a12-b55d-41cb-9c81-726d5ebd3dda None None] MFA Rules not processed for user `53b9cc03262c41d682254f9cf61f34a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:46:00.105379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-351c0a12-b55d-41cb-9c81-726d5ebd3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:00.113776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4461/8900] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:46:00.712368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:46:00.714332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:00.791015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b9a1a-f92b-4045-9ad9-f85e4dfc6b4d service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:46:00.796453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:46:00.797115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:00.797402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:00.797680 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:00.799557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:00.811575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:46:00.813246 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:46:00.823597 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4440/8901] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:46:02.003196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:02.003706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:02.003706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:02.024074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:46:02.025315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:02.033498 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4462/8902] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:46:02.047862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:46:02.059415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5744-8fa4-477f-8ef1-0b424606fc97 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:46:02.065243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:46:02.065930 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:02.066214 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:02.066489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:02.076781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:46:02.078417 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:46:02.087213 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4441/8903] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:46:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:46:12.018635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:12.083714 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=82 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:21.109756 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:46:21.111327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:21.189639 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46699038-84bf-4cc1-aab2-84915c505d35 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:46:21.195646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:46:21.196308 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:21.196625 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:21.196908 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:21.198752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:21.213896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:46:21.215498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74bb6-7c1a-4ec2-b742-d5f8a486d6e6 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:46:21.228554 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4463/8904] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:46:30.444728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:46:30.446316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:46:30.507535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9de6d-c3c9-4341-94e5-7f4e38e87588 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:46:30.511537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:46:30.512179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:46:30.512452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:46:30.512771 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:46:30.522363 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:46:30.523750 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa73e0b-3b01-43bb-8b9a-7f709435f5a8 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:46:30.533629 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4442/8905] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:46:31.221605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=34 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:40.529490 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=26 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:19.261031 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:19.261709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:19.261709 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:19.311332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:48:19.312601 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:48:19.322967 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4464/8906] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Jun 25 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:48:19.340177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd44a3-fb73-4d75-aa77-7298f7115d56 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:19.340700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd44a3-fb73-4d75-aa77-7298f7115d56 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:19.340803 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd44a3-fb73-4d75-aa77-7298f7115d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:19.360165 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-97bd44a3-fb73-4d75-aa77-7298f7115d56 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:48:19.361397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-97bd44a3-fb73-4d75-aa77-7298f7115d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:48:19.372157 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4443/8907] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 25 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:48:19.378384 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:48:19.390833 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee3e0-59d1-4ec5-b9eb-5a276bfea660 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:48:19.398724 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:48:19.399396 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:19.399653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:19.399922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:19.409400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:48:19.411011 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127c4b-831f-43d0-84f4-67dabb14b8e5 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:48:19.421284 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4465/8908] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:48:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:48:23.329828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:23.330449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:23.330449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:23.350619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:48:23.351822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:48:23.362054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4444/8909] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Jun 25 21:48:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:48:23.375565 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:23.376046 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:23.376146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:23.395780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:48:23.397036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:48:23.407388 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4466/8910] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 25 21:48:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:48:23.413425 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:48:23.424406 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cb635-edce-43be-a727-f642dbc56e64 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:48:23.431037 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:48:23.431729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:48:23.432063 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:48:23.432366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:48:23.441170 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:48:23.442800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:48:23.453354 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4445/8911] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:48:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:48:33.390996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=22 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:33.448976 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:23.106819 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:49:23.116874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bae3b1-bc70-424f-9877-3306f81cba5e None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:49:23.121417 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:49:23.122066 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:49:23.122351 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:49:23.122619 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:49:23.124732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:49:23.138874 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:49:23.140310 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:49:23.154908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4467/8912] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:49:27.875100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:49:27.885007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773eb2-1b95-4166-8169-bf2261c86408 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:49:27.888821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:49:27.889633 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:49:27.889918 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:49:27.890197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:49:27.892209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:49:27.909789 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:49:27.911279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8dcd-3c14-47ac-b772-1b1ca2a6d6b7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:49:27.926140 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4446/8913] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:49:29.245315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:49:29.254342 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53707-fd62-4c28-97f8-a6a0ca234488 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:49:29.258898 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:49:29.259553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:49:29.259838 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:49:29.260112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:49:29.262237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:49:29.279591 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:49:29.281070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:49:29.294748 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4468/8914] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:49:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:49:37.918068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:39.287347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:23.092545 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e62c8-acd7-432a-a427-372686f9a7e8 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:50:23.093216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e62c8-acd7-432a-a427-372686f9a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:50:23.093216 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e62c8-acd7-432a-a427-372686f9a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:50:23.114176 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f28e62c8-acd7-432a-a427-372686f9a7e8 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:50:23.115397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f28e62c8-acd7-432a-a427-372686f9a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:50:23.124033 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4447/8915] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Jun 25 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:50:23.136294 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:50:23.145760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95d58-ccb2-4821-a035-35fac377f811 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:50:23.150439 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:50:23.151095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:50:23.151379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:50:23.151645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:50:23.159385 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:50:23.160877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:50:23.169908 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4469/8916] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:50:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:50:33.108543 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=3 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:33.166112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:05.798546 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ca-2ede-4a56-acba-a341134693b9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:05.799247 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ca-2ede-4a56-acba-a341134693b9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:05.799428 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ca-2ede-4a56-acba-a341134693b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:05.842330 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-56a598ca-2ede-4a56-acba-a341134693b9 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:05.844180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-56a598ca-2ede-4a56-acba-a341134693b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:05.854983 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4448/8917] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:05.861738 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:05.876406 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b13d-db78-46a7-95c2-4e862909c6b2 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:05.883916 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:05.884739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:05.885021 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:05.885296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:05.893715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:05.895300 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:05.904705 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4470/8918] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:05.950839 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bce39-0888-4134-908f-020a272b11ec None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:05.951136 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bce39-0888-4134-908f-020a272b11ec None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:05.951421 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bce39-0888-4134-908f-020a272b11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:05.971133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-337bce39-0888-4134-908f-020a272b11ec None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:05.972357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-337bce39-0888-4134-908f-020a272b11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:05.984570 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4449/8919] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:05.999114 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:06.011843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43741-c129-4034-ae57-c9e1ea1f42db service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:06.016523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:06.017163 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:06.017448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:06.017721 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:06.031345 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:06.032845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78242d0-49be-4c0f-972d-062b0725dde4 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:06.044679 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4471/8920] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:06.510296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:06.510598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:06.510856 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:06.535482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:06.536769 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:06.550178 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4450/8921] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:06.570489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ddfd5-6e85-468f-80fd-dbd209196192 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:06.570791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ddfd5-6e85-468f-80fd-dbd209196192 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:06.571071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ddfd5-6e85-468f-80fd-dbd209196192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:06.598622 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e57ddfd5-6e85-468f-80fd-dbd209196192 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:06.599940 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e57ddfd5-6e85-468f-80fd-dbd209196192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:06.616534 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4472/8922] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 25 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:06.623572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:06.640737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f488c-b8bd-4459-85bb-053596b19a1c None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:06.653597 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:06.654068 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:06.654362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:06.654646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:06.670397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:06.672023 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc24d0-3feb-4859-8079-156d542267e9 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:06.687993 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4451/8923] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:10.691070 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:10.691620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:10.691620 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:10.713004 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:10.714236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:10.725275 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4473/8924] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:10.740719 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e9dd-674a-46ae-b97c-dbe6a8e27e8b None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:10.741238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e9dd-674a-46ae-b97c-dbe6a8e27e8b None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:10.741412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e9dd-674a-46ae-b97c-dbe6a8e27e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:10.759876 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-2579e9dd-674a-46ae-b97c-dbe6a8e27e8b None None] MFA Rules not processed for user `083565d7e7e3423486d9bfd51efaf318`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:10.761109 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2579e9dd-674a-46ae-b97c-dbe6a8e27e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:10.819054 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4452/8925] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 25 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:10.825525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:10.839016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae4d9c-19c2-489f-8cc2-e7c79ca74a22 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:10.843636 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '083565d7e7e3423486d9bfd51efaf318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:10.844288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:10.844600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:10.844885 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:10.855900 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:10.857302 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:10.869213 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4474/8926] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:15.810062 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdee3-c236-493a-973f-87dc46494c7f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:15.810498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdee3-c236-493a-973f-87dc46494c7f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:15.810629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebdee3-c236-493a-973f-87dc46494c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:15.829657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-1aebdee3-c236-493a-973f-87dc46494c7f None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:15.830884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1aebdee3-c236-493a-973f-87dc46494c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:15.839656 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4453/8927] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:51:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:15.881141 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:15.893191 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d657-3d01-4bba-8624-278f6b1c64ad service cinder] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:15.899933 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:15.900630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:15.900961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:15.901341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:15.910296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:15.911937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:15.920802 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4475/8928] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:51:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:51:16.436935 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf1c-7ad7-4589-8d55-5bc7f404da90 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:16.437287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf1c-7ad7-4589-8d55-5bc7f404da90 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:16.437703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf1c-7ad7-4589-8d55-5bc7f404da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:16.459298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d12cdf1c-7ad7-4589-8d55-5bc7f404da90 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:16.460575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d12cdf1c-7ad7-4589-8d55-5bc7f404da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:16.469829 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4454/8929] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:51:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:16.484297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:16.495332 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be78fb-27f7-432b-a60e-1512729903cb service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:16.502029 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0972557-a559-426a-8665-3293b707a11b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:16.502860 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972557-a559-426a-8665-3293b707a11b service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:16.503166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972557-a559-426a-8665-3293b707a11b service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:16.503472 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0972557-a559-426a-8665-3293b707a11b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:16.513350 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0972557-a559-426a-8665-3293b707a11b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:16.514948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0972557-a559-426a-8665-3293b707a11b service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:16.523245 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4476/8930] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:51:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:51:24.749656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:24.750208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:24.750208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:24.768263 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] MFA Rules not processed for user `53b9cc03262c41d682254f9cf61f34a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:24.769499 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:24.777561 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4455/8931] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:51:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:25.047087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:25.047692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:25.047692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:25.087168 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:25.088690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:25.095537 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4477/8932] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:51:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:25.107455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:25.118226 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493824-4838-4ed8-8313-2b51f1c1419a None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:25.122492 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:25.123229 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:25.123374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:25.123679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:25.131286 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:25.132772 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06283281-c098-43c4-b905-1253aa08e12c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:25.141046 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4456/8933] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:25.486468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:25.499220 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3974b0a-c3fb-40ef-8836-a25f8ba31ade None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:25.505199 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:25.505846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:25.506131 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:25.506407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:25.508282 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:25.521485 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:25.523161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:25.536598 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4478/8934] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:26.696273 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b8a0-3e99-470f-91df-09221fe8a18e None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:26.696809 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b8a0-3e99-470f-91df-09221fe8a18e None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:26.696923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b8a0-3e99-470f-91df-09221fe8a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:26.715559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d8b4b8a0-3e99-470f-91df-09221fe8a18e None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:26.716806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d8b4b8a0-3e99-470f-91df-09221fe8a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:26.725340 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4457/8935] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:51:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:26.738590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:26.750266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682346f-49d7-422f-a18f-8b0d8c5f2a88 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:26.755173 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:26.755825 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:26.756111 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:26.756390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:26.765101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:26.766695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:26.775142 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4479/8936] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 25 21:51:36.709660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=62 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:36.772209 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=57 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:44.548379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:44.548936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:44.548936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:44.569518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:44.570804 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:44.581306 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4458/8937] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:51:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:44.598722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:44.611901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaecc9-2291-430c-bfc8-afa526de3983 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:44.617881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:44.618572 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:44.619217 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:44.619542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:44.634187 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:44.635809 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e8010-6be7-4547-9e27-d512f8203467 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:44.649941 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4480/8938] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:52.587798 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:52.597817 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e816bd-86ee-44ed-a702-7e56c9ef0038 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:52.602232 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:52.602882 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:52.603135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:52.603438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:52.613718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:52.615179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:52.625113 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4459/8939] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:51:54.282273 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:54.282771 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:54.282870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:54.314674 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:51:54.316315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:51:54.347037 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4481/8940] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:51:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:51:54.360466 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:51:54.390328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad2ce-9e8b-4be7-944b-2df67d7170ba service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:51:54.396355 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:51:54.397376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:51:54.397672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:51:54.397937 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:51:54.408043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:51:54.409977 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:51:54.421201 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4460/8941] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:51:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:52:04.338552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=19 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:04.417410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=21 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:21.221395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:53:21.233837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8bb72-62ab-440b-b9bf-4850753e0d57 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:53:21.240227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:53:21.240915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:53:21.241201 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:53:21.241471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:53:21.250818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:53:21.252410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8230-59b3-4a37-8371-10502fb0c4e7 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:53:21.262963 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4482/8942] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:53:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:53:30.357340 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:53:30.373132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aba01-1535-4a3e-8480-f07baaf6b5a4 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:53:30.379667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:53:30.380358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:53:30.380679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:53:30.380973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:53:30.390311 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:53:30.391992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:53:30.402219 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4461/8943] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:53:31.258484 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:40.398014 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:12.520979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:12.521498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:12.521604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:12.540264 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:12.541501 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:12.582065 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4483/8944] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 21:54:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:12.624284 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:12.654898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574981-3d02-482b-a1c1-eeeaf0fac632 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:12.660689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:12.661341 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:12.661625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:12.661898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:12.671015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:12.672656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd0e0d-1ae0-486e-9dc1-148b1961f496 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:12.681056 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4462/8945] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 21:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 21:54:13.076459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:13.097123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb5dd-deb3-4e8b-b626-2bd9ee6f1d57 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:13.101166 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:13.101816 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:13.102095 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:13.102371 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:13.163844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:13.165413 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:13.175751 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4484/8946] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:16.036219 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7eb0-d7a4-4f5c-98f9-62b396c261de None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:16.037309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7eb0-d7a4-4f5c-98f9-62b396c261de None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:16.037869 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7eb0-d7a4-4f5c-98f9-62b396c261de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:16.072756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9bbf7eb0-d7a4-4f5c-98f9-62b396c261de None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:16.073994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9bbf7eb0-d7a4-4f5c-98f9-62b396c261de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:16.083196 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4463/8947] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:54:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:16.106570 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:16.121483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e17481-8825-46a2-a7d5-3bc6b14e224e service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:16.126655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:16.127394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:16.127681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:16.127958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:16.140328 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:16.141944 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:16.153771 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4485/8948] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:19.366563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:19.367677 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:19.367934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:19.388729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:19.390245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:19.400262 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4464/8949] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:54:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:19.425985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:19.437990 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4473b-d51d-4c50-915a-4601de8928ca service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:19.445120 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:19.446395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:19.447175 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:19.447557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:19.447925 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:19.458095 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45bcc-a34e-4f8a-95e9-225d6d2cc5a3 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:19.460135 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:19.463948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:19.464409 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:19.464974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:19.465427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:19.465702 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] PATH_INFO: `/v3/users/53b9cc03262c41d682254f9cf61f34a0` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:19.466963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b9cc03262c41d682254f9cf61f34a0)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:19.469066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:19.475914 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4486/8950] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:19.528458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b9cc03262c41d682254f9cf61f34a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.541851 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b9cc03262c41d682254f9cf61f34a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.555156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b9cc03262c41d682254f9cf61f34a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.556000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b9cc03262c41d682254f9cf61f34a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.556729 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b9cc03262c41d682254f9cf61f34a0'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.570241 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4465/8951] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:54:19 2022] DELETE /identity/v3/users/53b9cc03262c41d682254f9cf61f34a0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:54:19.747802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:19.761922 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b509-af7f-4ea1-938e-6b3bb97e204f service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:19.830075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:19.831003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:19.831284 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:19.831578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] PATH_INFO: `/v3/projects/f1aca77315704d338f4f0f881e741a12` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:19.832938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1aca77315704d338f4f0f881e741a12)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:19.834862 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:19.868782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:19.884237 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1aca77315704d338f4f0f881e741a12', 'request_id': 'req-a9bb259f-774e-421d-af74-c116c3bb94b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.892428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1aca77315704d338f4f0f881e741a12', 'request_id': 'req-a9bb259f-774e-421d-af74-c116c3bb94b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.898896 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1aca77315704d338f4f0f881e741a12', 'request_id': 'req-a9bb259f-774e-421d-af74-c116c3bb94b2'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.910715 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] The token cache is being invalidate because project f1aca77315704d338f4f0f881e741a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:54:19.911007 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.911720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:19.913492 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4487/8952] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:54:19 2022] DELETE /identity/v3/projects/f1aca77315704d338f4f0f881e741a12 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:54:19.917697 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:19.919281 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:19.933368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabad454-33a0-43a9-85fa-72a66f2e331a admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:19.995589 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:19.996544 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:19.996850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:19.997139 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] PATH_INFO: `/v3/users/97ab575f415b416494dd44d4b2f9b38b` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:19.998361 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ab575f415b416494dd44d4b2f9b38b)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.000337 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.039520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:20.058619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ab575f415b416494dd44d4b2f9b38b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.067235 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ab575f415b416494dd44d4b2f9b38b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.079579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ab575f415b416494dd44d4b2f9b38b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.080276 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ab575f415b416494dd44d4b2f9b38b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.080932 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-281af025-73ed-4af1-9528-6c033b22cd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ab575f415b416494dd44d4b2f9b38b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.093804 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4466/8953] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 21:54:19 2022] DELETE /identity/v3/users/97ab575f415b416494dd44d4b2f9b38b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:54:20.276943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.278478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:20.293259 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb259f-774e-421d-af74-c116c3bb94b2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.351755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.352665 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.352968 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.353227 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] PATH_INFO: `/v3/projects/b217cd2ddf7c4255ac0e6984adc19262` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.354416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217cd2ddf7c4255ac0e6984adc19262)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.356329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.404760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217cd2ddf7c4255ac0e6984adc19262', 'request_id': 'req-de546207-8ede-470d-a192-cfa48885131a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.414312 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217cd2ddf7c4255ac0e6984adc19262', 'request_id': 'req-de546207-8ede-470d-a192-cfa48885131a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.419918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217cd2ddf7c4255ac0e6984adc19262', 'request_id': 'req-de546207-8ede-470d-a192-cfa48885131a'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.431576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] The token cache is being invalidate because project b217cd2ddf7c4255ac0e6984adc19262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 21:54:20.432153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.432657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-de546207-8ede-470d-a192-cfa48885131a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 21:54:20.434318 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4488/8954] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:54:20 2022] DELETE /identity/v3/projects/b217cd2ddf7c4255ac0e6984adc19262 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 21:54:20.439705 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.440195 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.440299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.459338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:20.460704 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:20.522548 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4467/8955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:20.530731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.531024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.531330 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.551106 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:20.552309 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:20.561773 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4489/8956] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:20.566161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.576346 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87816701-ca1a-43ea-b8c3-76ee5f6314ee None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.582506 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.583177 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.583491 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.583915 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.584723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 21:54:20.584994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.587034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.599052 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4468/8957] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 21:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 21:54:20.603559 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.613518 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87944b-f624-4ba0-bac2-5e2ad204e539 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.619552 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.620213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.620534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.620807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.621491 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.623377 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.664663 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4490/8958] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:54:20 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:54:20.668923 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.679917 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49414b2-8edd-414a-b5c5-6f74660e338c admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.738034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.738779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.739064 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.739338 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.740015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.741974 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.770699 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4469/8959] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:54:20 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:54:20.772087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.783416 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0722d-4268-43e0-8012-5bac745d4fb1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.789002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.789677 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.789961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.790235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.790958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.792642 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.794801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:20.807934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4491/8960] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:54:20.809019 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.819610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62fe10-2225-4d9f-940a-3e2533d419fd admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.824815 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.825493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.825775 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.826055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.826790 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.828412 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325bf6-1d4b-43e0-aa1b-627c156dd02a admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.839420 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4470/8961] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:54:20.843731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:20.854999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e468-e82b-410b-9b66-39c1596ee939 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:20.861752 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:20.862645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.862935 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.863271 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] PATH_INFO: `/v3/projects/d8abcaad562b4e00a9bae557c0f21e6e/users/3f346fe40c774c4cb8f0f93413823b1f/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.879991 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8abcaad562b4e00a9bae557c0f21e6e, user_id=3f346fe40c774c4cb8f0f93413823b1f, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:20.882704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:20.898279 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4492/8962] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:54:20 2022] PUT /identity/v3/projects/d8abcaad562b4e00a9bae557c0f21e6e/users/3f346fe40c774c4cb8f0f93413823b1f/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:54:20.909334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:20.909626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:20.909905 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:20.934983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:20.938248 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:20.939865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:21.013277 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4471/8963] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:21.018109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.085727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f015285-c207-4ef1-a568-803136e26d8c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.091983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.092744 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.093036 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.093313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.094009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.095949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.124915 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4493/8964] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 21:54:21 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:54:21.129238 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.140580 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7009b-89bd-46dc-b58b-f3b92eef8629 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.201085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.201774 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.202059 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.202335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.203031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.205053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.228101 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4472/8965] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 21:54:21 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 21:54:21.232225 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.243509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f52ad9-d1b7-4fe0-b901-d030ce8c51b1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.249651 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.250325 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.250604 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.250877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.251630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.253286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.264456 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4494/8966] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:54:21.268751 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.279379 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b711-9a4f-4742-8d5d-67adcf2c211f admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.284477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.285376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.285657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.285934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] PATH_INFO: `/v3/projects/90f904e8acaa409d9da290dad07f2f7b/users/40911c1b9dde4813aa30dd9f42442ea7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.301679 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f904e8acaa409d9da290dad07f2f7b, user_id=40911c1b9dde4813aa30dd9f42442ea7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.304345 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.318956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4473/8967] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:54:21 2022] PUT /identity/v3/projects/90f904e8acaa409d9da290dad07f2f7b/users/40911c1b9dde4813aa30dd9f42442ea7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:54:21.323124 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.333568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762d31-3309-4707-8ac1-fe549b536ff2 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.397303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.397983 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.398272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.398556 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.399288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.400948 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ca3d3-4bb6-4cd8-bf43-ee29675be054 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.411004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4495/8968] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 21:54:21.415452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.426296 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd650f-a5bc-42a3-9b73-7a83c5ebe135 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.431118 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.432009 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.432291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.432595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] PATH_INFO: `/v3/projects/90f904e8acaa409d9da290dad07f2f7b/users/40911c1b9dde4813aa30dd9f42442ea7/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.434621 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f904e8acaa409d9da290dad07f2f7b, user_id=40911c1b9dde4813aa30dd9f42442ea7, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.437331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.448027 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4474/8969] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 21:54:21 2022] PUT /identity/v3/projects/90f904e8acaa409d9da290dad07f2f7b/users/40911c1b9dde4813aa30dd9f42442ea7/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 21:54:21.458315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.458765 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.458863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.488802 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] MFA Rules not processed for user `40911c1b9dde4813aa30dd9f42442ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:21.490803 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:21.529818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:21.567390 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4496/8970] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:21.582627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:21.585641 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:21.647990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:21.669464 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39f887-89bd-4ec1-b43a-3d31a9040da5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:21.675402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:21.676123 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:21.676408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:21.676713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:21.733445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:21.735089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895ca3d-0495-4c15-8266-a8e121efe017 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:21.744293 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4475/8971] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:24.876644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:24.878146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:24.936255 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a286d7-89f6-4bbb-bc7b-37cbab5a1a51 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:24.940019 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:24.940716 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:24.941003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:24.941441 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:24.951107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:24.952613 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1fc5d-1084-4d99-8e5f-fcd2c4bfac56 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:24.962900 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4497/8972] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:27.532038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:27.532624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:27.532624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:27.554031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:27.555256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:27.562882 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4476/8973] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:54:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:27.923434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:27.924457 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:27.925047 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:27.952122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:54:27.953946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:27.969183 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4498/8974] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 21:54:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:54:27.985765 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:27.987411 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:28.012837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747b290-08eb-46ca-a517-d741a0d36687 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:28.016526 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:28.017208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:28.017483 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:28.017759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:28.031784 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:28.033300 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:28.046520 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4477/8975] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:28.418326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:54:28.423289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:28.514567 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c46e0f-3f12-4b64-8b2c-d9ab1cb4fc87 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:54:28.519865 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:54:28.520577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:54:28.520866 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:54:28.521148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:54:28.522942 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:54:28.535234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:54:28.536882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b6fa6-6743-46d6-b366-481e20ea90e2 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:54:28.547244 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4499/8976] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:54:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:54:38.047104 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=40 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:38.543386 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=75 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:29.100415 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:55:29.110573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb6fd-9d40-4fd8-945a-b7850a954708 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:55:29.115781 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:55:29.116452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:55:29.116756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:55:29.117141 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:55:29.119324 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:55:29.142962 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:55:29.144444 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:55:29.152778 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4478/8977] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:55:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:55:39.149471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=11 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:03.920286 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:56:03.920872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:56:03.920872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:56:03.939892 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:56:03.941170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:56:03.948540 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4500/8978] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:56:05.923030 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:56:05.935132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45495e-6c96-47d9-b4f7-f4dfa78ca1d7 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:56:05.942075 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:56:05.945936 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:56:05.946234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:56:05.946524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:56:05.949039 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:56:06.003320 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:56:06.005250 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:56:06.038613 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4479/8979] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:56:07.442839 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:56:07.446162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:56:07.473154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75b978-3813-458a-adf2-cba3d376ca53 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:56:07.479198 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:56:07.479930 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:56:07.480152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:56:07.480534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:56:07.482645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:56:07.501042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:56:07.503280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:56:07.519610 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4501/8980] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:56:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:56:10.780475 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:56:10.790097 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe4ca-7d8e-4965-8417-4fd00e1c98f8 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:56:10.794257 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:56:10.794908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:56:10.795204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:56:10.795478 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:56:10.797457 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:56:10.811903 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:56:10.813403 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:56:10.825651 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4480/8981] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:56:17.513664 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=9 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:20.820822 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=21 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:22.912049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:58:22.926848 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a2de-33ae-492e-8fe5-f5115fb5fe19 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:58:22.932901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:58:22.934028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:58:22.934028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:58:22.934234 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:58:22.936119 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:22.949632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:58:22.951428 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:58:22.963521 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4502/8982] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:58:26.243933 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:58:26.245676 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:26.287173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2208e-e3a5-499f-acd1-cf1a531ab2f6 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:58:26.294133 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:58:26.294792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:58:26.295079 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:58:26.295360 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:58:26.297416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:26.309733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:58:26.311335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb8553-9cee-4ed3-8b0d-9fb6c7de87ea service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:58:26.321545 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4481/8983] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:58:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:58:32.958248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:34.346123 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:58:34.358961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5905f-19b0-4ad8-b8b3-723754678b8f service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:58:34.366460 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:58:34.367283 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:58:34.367764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:58:34.368042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:58:34.370058 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:34.383015 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:58:34.384671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:58:34.395369 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4503/8984] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:58:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:58:35.996696 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc096-704b-40fe-9909-39f521cfefce None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:58:35.997137 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc096-704b-40fe-9909-39f521cfefce None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:58:35.997314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc096-704b-40fe-9909-39f521cfefce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:58:36.022471 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-127bc096-704b-40fe-9909-39f521cfefce None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:58:36.023712 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-127bc096-704b-40fe-9909-39f521cfefce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:36.031391 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4482/8985] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 21:58:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:58:44.390931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:44.719996 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:58:44.735743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a5039-c48d-4c9c-9b6f-cb7e5d3957b8 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:58:44.742169 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:58:44.742832 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:58:44.743116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:58:44.743390 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:58:44.745425 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:58:44.759189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:58:44.760886 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:58:44.772395 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4504/8986] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:58:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:58:46.016512 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=18 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:54.768157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:51.236161 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bc096-704b-40fe-9909-39f521cfefce None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:51.249999 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bc096-704b-40fe-9909-39f521cfefce None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:51.256204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:51.257012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.257292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.257567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.266175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:51.267800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a677-1d91-4aac-9a37-1a1d801e4504 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:51.277396 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4483/8987] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:59:51.329927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:51.340551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9f68d-d27b-4bb0-8c56-5de5ffb0f618 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:51.345127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:51.345778 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.346064 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.346339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.355605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:51.357097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:51.365567 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4505/8988] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:59:51.517583 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f96129-79f4-456f-9670-e29d3ca336f2 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.517870 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f96129-79f4-456f-9670-e29d3ca336f2 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.518172 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f96129-79f4-456f-9670-e29d3ca336f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.556946 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-d2f96129-79f4-456f-9670-e29d3ca336f2 None None] MFA Rules not processed for user `f07213aded8c456785f17c358a348083`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:59:51.558135 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-d2f96129-79f4-456f-9670-e29d3ca336f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:59:51.565298 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4484/8989] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:59:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 21:59:51.578320 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:51.587872 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41630-0b75-4cc5-8797-3f8955696fe0 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:51.592020 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:51.592780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.593231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.593702 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.601445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:51.603081 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fd6db-f892-40ab-9aff-40a8abb7e407 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:51.612671 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4506/8990] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 21:59:51.707316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e845de-8694-4833-ba34-5ab7c35b3d98 None None] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.707660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e845de-8694-4833-ba34-5ab7c35b3d98 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.707945 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e845de-8694-4833-ba34-5ab7c35b3d98 None None] PATH_INFO: `/` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.710032 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4485/8991] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 25 21:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 21:59:51.715609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97256cc-d95c-4bde-9f5b-32fbc4ac142d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.715958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97256cc-d95c-4bde-9f5b-32fbc4ac142d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.716228 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97256cc-d95c-4bde-9f5b-32fbc4ac142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.752840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d97256cc-d95c-4bde-9f5b-32fbc4ac142d None None] MFA Rules not processed for user `237820e4132b4e65898c330ae2240d20`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:59:51.753988 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d97256cc-d95c-4bde-9f5b-32fbc4ac142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:59:51.763481 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4507/8992] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:59:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:59:51.785672 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e845de-8694-4833-ba34-5ab7c35b3d98 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:51.800099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e845de-8694-4833-ba34-5ab7c35b3d98 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:51.805666 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:51.806319 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:51.806606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:51.806886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:51.815853 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:51.817522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:51.827743 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4486/8993] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:59:52.007941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:52.008142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:52.008471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:52.028805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 21:59:52.030040 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:59:52.040500 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4508/8994] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 21:59:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 21:59:52.052116 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:52.062173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b0ead-0d67-44af-b6e0-7dff90ea3c7e service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:52.066591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:52.067234 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:52.067520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:52.067787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:52.078884 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:52.080391 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:52.091663 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4487/8995] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 21:59:52.157101 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:59:52.169433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9420e-3dac-4bfd-8509-7a7bc39de0d6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:59:52.175378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:59:52.176061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:59:52.176453 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:59:52.176751 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:59:52.178710 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:59:52.190949 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:59:52.192574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:59:52.202934 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4509/8996] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 21:59:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:00:02.087287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=29 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:02.198346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=30 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:35.238756 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:00:35.248710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91872f-b296-4f99-8f19-dbfc989c335b service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:00:35.253362 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:00:35.254012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:00:35.254290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:00:35.254565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:00:35.262489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:00:35.263948 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:00:35.272187 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4488/8997] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:00:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:00:45.268848 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:06.480748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:06.492224 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a520c0-c172-4c46-a3e9-8367228a1da0 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:06.498142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:06.498822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:06.499104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:06.499381 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:06.501315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:01:06.514244 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:06.515979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61157771-4c0b-4011-a5fa-c1356648a6c8 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:06.526847 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4510/8998] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:09.728554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:09.737314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38cb07-a4e7-4b38-ad5e-65ec03383d2c service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:09.741287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:09.742048 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:09.742331 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:09.742610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:09.752047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:09.753569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:09.763556 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4489/8999] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:12.600539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:12.600954 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:12.601102 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:12.626760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:01:12.628075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:01:12.640812 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4511/9000] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:01:12.675920 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:12.677570 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:01:12.762358 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801060b-76ac-47d2-a504-f2b2ac9e3388 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:12.766678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:12.767427 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:12.767820 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:12.768996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:12.780746 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:12.782297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:12.794538 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4490/9001] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:13.127957 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:13.138089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5ea8-d47c-485e-bd43-245308642b37 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:13.141999 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:13.142800 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:13.143056 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:13.143339 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:13.145200 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:01:13.161076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:13.162581 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:13.175885 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4512/9002] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:13.581465 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:13.593255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03584c-a003-43fa-86c9-4f172955bd61 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:13.597101 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:13.597832 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:13.598180 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:13.598554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:13.613033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:13.614518 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:13.626625 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4491/9003] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:14.588490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:14.603667 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a10a-bbe2-41f8-a5ea-3180a09cc593 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:14.611340 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:14.612091 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:14.614392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:14.614712 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:14.645524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:14.647410 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:14.660173 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4513/9004] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:20.070460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:01:20.090535 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d810d-ea18-4fc5-b8d6-360c7a67c1a4 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:01:20.103272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:01:20.103991 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:01:20.104245 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:01:20.104558 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:01:20.115121 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:01:20.116788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:01:20.128716 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4492/9005] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:01:24.655608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=21 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:30.123655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=53 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:35.235791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:03:35.260840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975de36-cd56-4183-a235-7712fb299365 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:03:35.266490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:03:35.267158 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:03:35.267442 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:03:35.267725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:03:35.276690 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:03:35.278295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60878839-f244-47d4-a23a-2d2af955700e service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:03:35.288335 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4514/9006] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:03:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:03:38.378315 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:03:38.405332 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1101ee-04e0-4c6c-8a5c-567dde98ab07 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:03:38.411579 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:03:38.412626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:03:38.412914 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:03:38.413191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:03:38.422318 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:03:38.423943 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:03:38.435455 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4493/9007] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:03:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:03:45.284148 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:48.430409 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:55.566296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:03:55.566826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:03:55.566927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:03:55.598837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] MFA Rules not processed for user `3f346fe40c774c4cb8f0f93413823b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:03:55.600100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:03:55.608624 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4515/9008] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:04:04.577022 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:04:04.599110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159cb6c-4d65-4743-8ad2-2880a20d4a8e service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:04:04.605922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:04:04.606210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:04:04.606513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:04:04.606794 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:04:04.617983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:04:04.619860 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:04:04.636251 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4494/9009] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:04:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:04:05.593327 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=7 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:14.628779 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:13.155077 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:13.271646 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fe4b7-e5c4-4324-b9d2-54939353c5ba None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:13.277247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:13.277904 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:13.278193 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:13.278499 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:13.280526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:13.365550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:13.367171 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:13.386962 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4516/9010] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:21.453510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:21.455713 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:21.568497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb014b73-6411-4481-9858-c02bf13361ad service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:21.576787 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:21.577788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:21.578325 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:21.578810 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:21.591472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:21.593640 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:21.606156 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4495/9011] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:23.383975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=84 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:28.234426 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:28.236780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:28.310082 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ab5b1-8b9e-4cdb-97ae-b216343e6c60 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:28.315846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:28.316553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:28.316840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:28.317117 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:28.318961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:28.330864 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:28.332498 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70fd0-14d8-4c20-ba31-09b32d268064 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:28.343209 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4517/9012] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:28.526912 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:28.529210 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:28.631792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68f6de-3bc2-42b4-bb33-6c5c187ba7bc service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:28.637624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:28.638527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:28.638814 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:28.639124 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] PATH_INFO: `/v3/users/3f346fe40c774c4cb8f0f93413823b1f` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:28.640449 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f346fe40c774c4cb8f0f93413823b1f)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:28.642667 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:28.685940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:28.697801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f346fe40c774c4cb8f0f93413823b1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:28.706423 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f346fe40c774c4cb8f0f93413823b1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:28.718898 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f346fe40c774c4cb8f0f93413823b1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:28.719549 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f346fe40c774c4cb8f0f93413823b1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:28.720183 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f346fe40c774c4cb8f0f93413823b1f'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:28.733441 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4496/9013] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:05:28 2022] DELETE /identity/v3/users/3f346fe40c774c4cb8f0f93413823b1f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:28.738261 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:28.738553 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:28.738835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:28.766009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:28.767542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:28.827081 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4518/9014] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:28.837872 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:28.839376 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:28.910674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be91e-6571-49a2-8bda-6ca37ba0a435 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:28.914723 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:28.915377 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:28.915682 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:28.915951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:28.925736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:28.927192 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:28.937113 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4497/9015] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:29.118488 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:29.120208 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:29.135812 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8c80f-a853-4456-8cd9-40347df29d0d None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:29.141867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:29.142873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:29.143230 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:29.143575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] PATH_INFO: `/v3/projects/d8abcaad562b4e00a9bae557c0f21e6e` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:29.144923 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8abcaad562b4e00a9bae557c0f21e6e)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:29.146973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:29.197156 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8abcaad562b4e00a9bae557c0f21e6e', 'request_id': 'req-94023a6b-f28d-4028-bb5a-6e001ea4a852'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.206083 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8abcaad562b4e00a9bae557c0f21e6e', 'request_id': 'req-94023a6b-f28d-4028-bb5a-6e001ea4a852'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.212387 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8abcaad562b4e00a9bae557c0f21e6e', 'request_id': 'req-94023a6b-f28d-4028-bb5a-6e001ea4a852'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.227463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] The token cache is being invalidate because project d8abcaad562b4e00a9bae557c0f21e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:05:29.227755 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.228504 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.230167 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4519/9016] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:05:29 2022] DELETE /identity/v3/projects/d8abcaad562b4e00a9bae557c0f21e6e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:29.234510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:29.244924 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aab016-69a8-4815-96a2-023c2c3e3887 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:29.303749 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:29.304731 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:29.305015 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:29.305292 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] PATH_INFO: `/v3/users/40911c1b9dde4813aa30dd9f42442ea7` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:29.319203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40911c1b9dde4813aa30dd9f42442ea7)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:29.321277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:29.361522 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:29.378279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40911c1b9dde4813aa30dd9f42442ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.385888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40911c1b9dde4813aa30dd9f42442ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.399297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40911c1b9dde4813aa30dd9f42442ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.399964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40911c1b9dde4813aa30dd9f42442ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.400626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-05e8e5b3-273d-4778-9488-ff9f1f897274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40911c1b9dde4813aa30dd9f42442ea7'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.413856 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4498/9017] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:05:29 2022] DELETE /identity/v3/users/40911c1b9dde4813aa30dd9f42442ea7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:29.687540 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:29.689132 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:29.704673 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023a6b-f28d-4028-bb5a-6e001ea4a852 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:29.708452 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:29.764147 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:29.765016 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:29.765301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:29.765577 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] PATH_INFO: `/v3/projects/90f904e8acaa409d9da290dad07f2f7b` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:29.776753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f904e8acaa409d9da290dad07f2f7b)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:29.778766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:29.826691 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f904e8acaa409d9da290dad07f2f7b', 'request_id': 'req-c899e514-dd46-4288-adbd-cd1cb2d7a470'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.835247 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f904e8acaa409d9da290dad07f2f7b', 'request_id': 'req-c899e514-dd46-4288-adbd-cd1cb2d7a470'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.840870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f904e8acaa409d9da290dad07f2f7b', 'request_id': 'req-c899e514-dd46-4288-adbd-cd1cb2d7a470'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.852635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] The token cache is being invalidate because project 90f904e8acaa409d9da290dad07f2f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:05:29.852924 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.853557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-c899e514-dd46-4288-adbd-cd1cb2d7a470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:05:29.855131 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4520/9018] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:05:29 2022] DELETE /identity/v3/projects/90f904e8acaa409d9da290dad07f2f7b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:29.860806 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:29.861290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:29.861476 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:29.906557 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:29.907792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:29.975121 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4499/9019] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:29.983575 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:29.983868 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:29.984149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.006684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:30.007893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:30.017457 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4521/9020] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:30.021493 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.032155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fe8af-6120-4187-89af-8a1b6218dc1d None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.037416 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.038087 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.038372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.038646 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.039372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 22:05:30.039692 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.042351 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.056044 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4500/9021] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 22:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 22:05:30.060632 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.070422 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2aaea-15fc-44ab-9b1b-a20a27c72722 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.076137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.076846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.077126 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.077397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.078089 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.080042 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.119776 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4522/9022] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 22:05:30 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 22:05:30.124225 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.135049 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce650e-80dd-4819-b503-0c41744fc547 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.191792 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.192513 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.192805 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.193085 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.193778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.195734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.217127 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4501/9023] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 22:05:30 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 22:05:30.221368 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.231951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24189125-f2e9-4def-a490-0764d34b7330 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.238770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.239446 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.239748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.240009 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.240780 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.242392 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.253235 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4523/9024] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:05:30.257303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.267615 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743aacd-c8c2-44c1-ac73-4542e2754121 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.272372 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.273065 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.273375 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.273656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.274371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.275987 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca63cd-4cf8-4014-bd01-c8609e59a153 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.285930 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4502/9025] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:05:30.290137 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.300985 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8872c-f2bd-41b3-ae8d-266eb9aa6998 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.306062 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.306931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.307232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.307509 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] PATH_INFO: `/v3/projects/7659c265b2b14bdb9ac0b22dfbb8d2ed/users/bd5bd999a2b74f6b820b67f376486e7e/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.322813 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7659c265b2b14bdb9ac0b22dfbb8d2ed, user_id=bd5bd999a2b74f6b820b67f376486e7e, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.325520 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.340943 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4524/9026] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:05:30 2022] PUT /identity/v3/projects/7659c265b2b14bdb9ac0b22dfbb8d2ed/users/bd5bd999a2b74f6b820b67f376486e7e/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:30.348644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288286ae-0e2c-415d-ae6e-1fe4fdffabce None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.349038 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288286ae-0e2c-415d-ae6e-1fe4fdffabce None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.349407 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288286ae-0e2c-415d-ae6e-1fe4fdffabce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.357110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:30.369430 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-288286ae-0e2c-415d-ae6e-1fe4fdffabce None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:30.371291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-288286ae-0e2c-415d-ae6e-1fe4fdffabce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:30.435383 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4503/9027] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:30.446821 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:30.449578 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:30.481296 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:30.533523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de542-e715-4729-82a1-1e5e038ad05b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:30.537909 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:30.538564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:30.538846 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:30.539118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:30.554103 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:30.556757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:30.571863 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4525/9028] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:34.211498 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.211964 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.212211 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.239718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] MFA Rules not processed for user `bd5bd999a2b74f6b820b67f376486e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:34.240913 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:34.305591 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4504/9029] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:34.310235 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.320152 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d46f84-ad55-4522-9799-db368a43c862 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.325188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.325856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.326206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.326532 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.327157 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.329784 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.369494 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4526/9030] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 22:05:34 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 22:05:34.373778 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.387299 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40189-4e3d-4b4a-95e9-17fd0d9d5814 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.448495 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.449197 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.449485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.449782 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.450521 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.452698 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.481310 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4505/9031] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 22:05:34 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 22:05:34.486445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.499196 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c186a9-517a-419d-8a47-41cc0fb51055 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.505252 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.506085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.506295 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.506576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.507316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.509229 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.523203 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4527/9032] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:05:34.528399 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.553329 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73e3b-9dff-40e9-b463-ce431c8cde76 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.563591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.564574 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.564867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.565147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] PATH_INFO: `/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c/users/a667fae6b1254815b047680e061da7d4/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.581264 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7edd6c069e04df3b6dafa6c6c89078c, user_id=a667fae6b1254815b047680e061da7d4, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.583951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.597616 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:34.602732 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4506/9033] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:05:34 2022] PUT /identity/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c/users/a667fae6b1254815b047680e061da7d4/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:34.606920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.617545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ebbe-795e-4e31-a4e6-a5cdc6c94b42 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.675719 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.676411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.676727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.677008 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.678592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.681920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42669-d174-4ba2-9c7e-0976ae5bb7fc admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.694049 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4528/9034] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:05:34.698252 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:34.710031 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e7f9-1560-492a-99d2-6c6bfbb99650 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:34.714909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:34.715811 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:34.716091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:34.716364 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] PATH_INFO: `/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c/users/a667fae6b1254815b047680e061da7d4/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:34.718828 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7edd6c069e04df3b6dafa6c6c89078c, user_id=a667fae6b1254815b047680e061da7d4, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:34.721591 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:34.733901 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4507/9035] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:05:34 2022] PUT /identity/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c/users/a667fae6b1254815b047680e061da7d4/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:05:39.368289 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1879-4473-4150-bcf7-5b742edeb932 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:39.368734 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1879-4473-4150-bcf7-5b742edeb932 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:39.368867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1879-4473-4150-bcf7-5b742edeb932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:39.397837 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-940a1879-4473-4150-bcf7-5b742edeb932 None None] MFA Rules not processed for user `a667fae6b1254815b047680e061da7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:39.399039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-940a1879-4473-4150-bcf7-5b742edeb932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:39.470479 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:39.482408 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4529/9036] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:39.499290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:39.501733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:39.580410 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b9b5c-de4b-46bd-b297-ed6a00d1b2c8 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:39.586799 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:39.587469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:39.587757 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:39.588041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:39.650072 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:39.651759 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:39.661956 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4508/9037] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:40.787550 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:40.788087 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:40.788204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:40.807483 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] MFA Rules not processed for user `bd5bd999a2b74f6b820b67f376486e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:05:40.808754 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:40.816475 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4530/9038] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:05:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:05:43.260291 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:43.347395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c2cf-d38d-495a-8e93-93d3b6f54470 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:43.351230 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:43.351965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:43.352310 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:43.352688 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:43.354631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:43.365636 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:43.367455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:43.379782 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4509/9039] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:50.802013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=5 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:51.250548 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:05:51.252285 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:05:51.265605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9505-a5bb-4211-8978-d406e464b158 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:05:51.269731 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:05:51.270378 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:05:51.270655 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:05:51.270931 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:05:51.281692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:05:51.283122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:05:51.292813 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4531/9040] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:05:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:05:53.375047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:06:01.288523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:19.589979 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:19.591442 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:19.647632 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d536-0095-4d72-8b72-87ddd9ef7a82 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:19.651801 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:19.652455 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:19.652899 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:19.653184 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:19.655122 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:19.682970 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:19.684458 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada6a0d-02be-42e9-9fb5-bcd62419af17 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:19.706171 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4510/9041] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:20.999074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:21.008195 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757ef2-c5b5-4505-9078-28a195316a2a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:21.012305 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:21.013045 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:21.013303 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:21.013653 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:21.015588 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:21.029315 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:21.031397 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:21.043004 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4532/9042] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:29.703155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=35 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:31.038100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:36.938610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:36.939179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:36.939179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:36.989626 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:08:36.991000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:37.061468 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4511/9043] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:08:37.113873 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:37.115447 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:37.210068 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf601f-28b5-4654-bf47-864830dc7d73 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:37.216223 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:37.216927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:37.217215 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:37.217486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:37.226048 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:37.227644 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:37.235804 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4533/9044] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:08:41.235965 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:41.237618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:41.391450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8b15-eae9-4d83-ad29-cf48af1789c9 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:41.391450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aad2-6526-4073-b945-4b216297448f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:41.391450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aad2-6526-4073-b945-4b216297448f service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:41.391740 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aad2-6526-4073-b945-4b216297448f service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:41.391909 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aad2-6526-4073-b945-4b216297448f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:41.393725 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-df64aad2-6526-4073-b945-4b216297448f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:41.406963 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64aad2-6526-4073-b945-4b216297448f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:41.408934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64aad2-6526-4073-b945-4b216297448f service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:41.420204 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4512/9045] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:42.360681 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:42.362317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:42.379975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a4cd-7809-4694-8bab-ae56d7761404 service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:42.385960 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:42.386641 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:42.386927 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:42.387202 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:42.389164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:42.402610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:42.404929 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169e218-dc4c-4722-a1c6-a44cb4a2bf52 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:42.424381 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4534/9046] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:50.219220 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aad2-6526-4073-b945-4b216297448f service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:50.229554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aad2-6526-4073-b945-4b216297448f service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:50.234400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:50.235044 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.235323 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.235598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.238094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:50.248608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:50.250055 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:50.259805 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4513/9047] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:50.364979 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.365585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.365585 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.403774 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] MFA Rules not processed for user `bce2e604e9444a99b194c1a5a9f96683`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:08:50.405142 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:50.414714 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4535/9048] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 25 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:08:50.426303 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:50.436243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9ba1-e610-4232-a480-ee63c7757e21 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:50.440282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:50.441187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.441473 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.441752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.452996 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:50.454520 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:50.466358 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4514/9049] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:50.534206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:50.543995 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27ddb4-d714-49fc-aaba-e014037efffe None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:50.547834 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:50.548512 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.548798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.549071 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.550973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:50.560835 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:50.562270 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:50.570115 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4536/9050] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:50.644132 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:50.654497 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968271b4-c1bb-43bf-aee0-c3a8fcdf4abf service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:50.658922 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:50.659565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.659849 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.660126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.662168 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:50.676103 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:50.677598 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4064d-8ba1-40d5-872c-631cb61030d5 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:50.688405 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4515/9051] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:50.751459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:50.767883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e410a-9b0a-4af1-9c2b-36961da751fb service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:50.777795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:50.778743 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:50.779044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:50.779319 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:50.782683 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:50.798362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:50.799984 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:50.810808 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4537/9052] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:08:52.363114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:52.363572 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:52.363685 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:52.370728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:52.386269 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:08:52.387460 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:08:52.396812 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4516/9053] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:08:52.412951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:08:52.425028 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc47f5-d2b5-416d-a46d-81ae72fc8bd3 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:08:52.430695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:08:52.431394 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:08:52.431671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:08:52.431961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:08:52.440830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:08:52.442459 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004b04-64f0-4a12-9227-c26cee67ebb9 service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:08:52.450948 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4538/9054] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:08:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:09:02.379953 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=2 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:02.447801 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=74 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:10.169850 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:09:10.184700 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15e5dd-d6eb-4b95-8177-8f987ea99232 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:09:10.190653 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:09:10.191400 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:09:10.191716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:09:10.192000 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:09:10.193908 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:09:10.207382 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:09:10.209401 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:09:10.222335 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4517/9055] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:09:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:09:11.681662 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:09:11.682186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:09:11.682186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:09:11.701668 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:09:11.702880 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:09:11.711297 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4539/9056] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 22:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:09:11.725179 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:09:11.737328 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0615-9dc4-4cb6-93fd-010bece0a9a8 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:09:11.743316 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:09:11.743954 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:09:11.744236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:09:11.744533 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:09:11.753114 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:09:11.754634 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:09:11.762800 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4518/9057] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:09:21.696795 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:21.759694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:47.085610 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:10:47.096814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186051c-c74e-406b-920e-31f5d59badd0 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:10:47.101420 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:10:47.102074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:10:47.102365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:10:47.102645 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:10:47.110411 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:10:47.111897 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:10:47.120241 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4540/9058] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:10:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:10:57.116958 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:57.701389 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:10:57.712100 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b4a44-52df-4681-8615-c68f59de839d service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:10:57.716388 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:10:57.717076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:10:57.717314 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:10:57.717612 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:10:57.727971 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:10:57.729452 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6e99a-6a99-4a5a-b020-6d00d0d3f896 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:10:57.738989 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4519/9059] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:10:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:10:58.602870 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:10:58.604336 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:10:58.630061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa883-b33d-4c40-a725-dcf2ec68331d service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:10:58.636478 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:10:58.637159 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:10:58.637448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:10:58.637725 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:10:58.639689 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:10:58.654882 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:10:58.656524 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:10:58.668725 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4541/9060] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:11:02.441724 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:11:02.442309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:11:02.442309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:11:02.460950 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] MFA Rules not processed for user `bd5bd999a2b74f6b820b67f376486e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:11:02.462481 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:11:02.470928 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4520/9061] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:11:05.343186 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:11:05.353318 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e058-acfb-420e-aec9-de18179b316c service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:11:05.357739 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:11:05.358382 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:11:05.358666 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:11:05.358938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:11:05.360950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:11:05.371039 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:11:05.372568 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:11:05.380406 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4542/9062] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:11:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:11:06.171569 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:11:06.184272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f58d-9716-47dd-b65f-cdc852750865 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:11:06.190020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:11:06.190718 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:11:06.191002 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:11:06.191309 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:11:06.193287 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:11:06.205624 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:11:06.207272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:11:06.220232 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4521/9063] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:11:15.377034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:16.215357 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=15 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:17.034219 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:11:17.043564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9ba8-1a42-4c25-b29e-4fa77c53a7ea service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:11:17.047826 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:11:17.048515 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:11:17.048814 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:11:17.049075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:11:17.059522 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:11:17.061061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:11:17.070901 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4543/9064] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:11:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:11:19.064836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:11:19.077395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773959-d73d-4c17-9d28-f2c3a756e719 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:11:19.085668 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:11:19.086496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:11:19.086837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:11:19.087173 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:11:19.089547 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:11:19.105951 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:11:19.108307 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:11:19.120162 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4522/9065] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:11:27.066706 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:29.115288 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:24.399918 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:13:24.409085 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3579b-e808-4b52-9ce1-f18e2327684b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:13:24.413822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:13:24.414490 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:13:24.414790 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:13:24.415076 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:13:24.426912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:13:24.428374 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:13:24.439821 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4544/9066] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:13:25.638290 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:13:25.648215 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da999-150f-40aa-9f26-9a1fe6aa682b service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:13:25.652741 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:13:25.653398 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:13:25.653716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:13:25.653992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:13:25.665645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:13:25.667106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:13:25.678648 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4523/9067] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:13:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:13:34.434961 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:35.673519 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=6 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:45.182680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:13:45.210003 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d5cd-2664-422a-84d5-2be607289867 service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:13:45.215937 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:13:45.216970 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:13:45.217256 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:13:45.217534 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:13:45.226445 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:13:45.228060 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:13:45.238143 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4545/9068] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:13:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:13:49.322559 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:13:49.350708 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915523b-6d85-40d5-8e7c-f3d36f44c082 service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:13:49.356867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:13:49.357613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:13:49.357925 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:13:49.358204 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:13:49.366997 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:13:49.368635 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:13:49.378582 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4524/9069] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:13:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:13:55.234179 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:59.374577 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:18.465437 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:18.475733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fa94f-a5cc-4174-b32d-84f749ea46de service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:18.479975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:18.480657 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:18.480945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:18.481440 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:18.543127 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:18.544692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:18.555317 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4546/9070] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:21.422422 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:21.435277 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736cd29-9db2-4d4e-81d2-2c8eefc9e700 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:21.442453 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:21.443445 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:21.443727 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:21.444007 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:21.446224 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:21.484554 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:21.490243 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:21.501426 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4525/9071] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:24.820249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:24.863153 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a687c6e-377a-47c4-a9b1-6c44cc60b2ed service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:24.869640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:24.871236 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:24.871711 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:24.872395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:24.875670 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:24.895433 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:24.900362 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:24.901279 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:24.911952 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4547/9072] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:24.929474 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc255d1-1bcb-451e-a6f5-744f9430ee6a service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:24.935208 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:24.936147 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:24.936469 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:24.936752 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] PATH_INFO: `/v3/users/bd5bd999a2b74f6b820b67f376486e7e` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:24.937986 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5bd999a2b74f6b820b67f376486e7e)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:24.939942 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:24.996847 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5bd999a2b74f6b820b67f376486e7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.005110 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5bd999a2b74f6b820b67f376486e7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.017115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5bd999a2b74f6b820b67f376486e7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.017753 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5bd999a2b74f6b820b67f376486e7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.018347 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5bd999a2b74f6b820b67f376486e7e'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.030697 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4526/9073] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:15:24 2022] DELETE /identity/v3/users/bd5bd999a2b74f6b820b67f376486e7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 22:15:25.222149 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:25.234468 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e782fd-0507-41ee-8e42-05061c09e044 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:25.305301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:25.306370 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:25.306750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:25.307033 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] PATH_INFO: `/v3/projects/7659c265b2b14bdb9ac0b22dfbb8d2ed` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:25.309146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7659c265b2b14bdb9ac0b22dfbb8d2ed)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:25.311162 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:25.366167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'request_id': 'req-9a207cbd-0745-4f75-9c66-06165a0498f8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.374782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'request_id': 'req-9a207cbd-0745-4f75-9c66-06165a0498f8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.381917 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'request_id': 'req-9a207cbd-0745-4f75-9c66-06165a0498f8'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.383160 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:25.399542 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] The token cache is being invalidate because project 7659c265b2b14bdb9ac0b22dfbb8d2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:15:25.400109 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.400902 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.402621 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4548/9074] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:15:25 2022] DELETE /identity/v3/projects/7659c265b2b14bdb9ac0b22dfbb8d2ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 22:15:25.407028 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:25.408706 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:25.423076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757713-7784-4ce1-a3b5-0b9c22f0d3d5 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:25.482818 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:25.483711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:25.484001 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:25.484283 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] PATH_INFO: `/v3/users/a667fae6b1254815b047680e061da7d4` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:25.485573 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a667fae6b1254815b047680e061da7d4)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:25.487550 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:25.528595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:25.543129 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a667fae6b1254815b047680e061da7d4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.551687 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a667fae6b1254815b047680e061da7d4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.564859 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a667fae6b1254815b047680e061da7d4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.565477 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a667fae6b1254815b047680e061da7d4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.566089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8d87c20d-b1cf-4554-b148-1f64124f0da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a667fae6b1254815b047680e061da7d4'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.578503 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4527/9075] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:15:25 2022] DELETE /identity/v3/users/a667fae6b1254815b047680e061da7d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:15:25.763469 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:25.764946 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:25.782881 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a207cbd-0745-4f75-9c66-06165a0498f8 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:25.846393 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:25.847316 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:25.847600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:25.847877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] PATH_INFO: `/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:25.849115 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7edd6c069e04df3b6dafa6c6c89078c)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:25.851075 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:25.899950 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7edd6c069e04df3b6dafa6c6c89078c', 'request_id': 'req-a52ab13a-210d-4c7b-84ca-24e8f1599f06'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.910424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7edd6c069e04df3b6dafa6c6c89078c', 'request_id': 'req-a52ab13a-210d-4c7b-84ca-24e8f1599f06'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.916245 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7edd6c069e04df3b6dafa6c6c89078c', 'request_id': 'req-a52ab13a-210d-4c7b-84ca-24e8f1599f06'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.927798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] The token cache is being invalidate because project d7edd6c069e04df3b6dafa6c6c89078c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:15:25.928092 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.928817 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-a52ab13a-210d-4c7b-84ca-24e8f1599f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:15:25.930585 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4549/9076] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:15:25 2022] DELETE /identity/v3/projects/d7edd6c069e04df3b6dafa6c6c89078c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:15:25.936057 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:25.936565 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:25.936660 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:25.965218 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:25.966436 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:26.027266 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4528/9077] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:15:26.035951 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.036249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.036563 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.055448 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:26.056786 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:26.065074 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4550/9078] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:15:26.069551 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.079916 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dcc7-a3a0-4d68-a560-b077ced4fbe1 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.084788 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.085448 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.085734 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.086011 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] PATH_INFO: `/v3/domains` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.086737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 22:15:26.087043 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.088703 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.100783 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4529/9079] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 25 22:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 22:15:26.105297 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.114977 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce142bd-04d9-4d6e-b165-84d256c7fceb None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.120684 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.121347 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.121628 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.121901 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.122608 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.124598 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.152497 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4551/9080] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 22:15:26 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 22:15:26.156648 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.166941 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9e45-ca97-426f-93e7-19e005c1e281 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.233004 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.233694 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.233978 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.234253 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.234952 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.236961 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.259917 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4530/9081] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 22:15:26 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 22:15:26.264112 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.274764 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7165-0549-4555-8d22-b6224089acb1 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.279859 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.280557 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.280844 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.281122 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.281850 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.283471 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.294470 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4552/9082] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:15:26.298656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.309982 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bf03-f535-45e0-9d3a-b6c9076fb86d admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.315575 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.316237 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.316560 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.316837 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] PATH_INFO: `/v3/roles` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.317578 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.319209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf918235-5865-4650-956c-e66dd833a20d admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.329622 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4531/9083] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:15:26.334038 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.345050 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a661-aad9-4809-828d-289076a3f479 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.350640 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.351535 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] REQUEST_METHOD: `PUT` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.351818 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.352097 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] PATH_INFO: `/v3/projects/2f2229a0064b42d88f84448115ff450a/users/6d3934c5660947f28734aefe3cb1c9b9/roles/7faa3dc09867417b8ea82703161cde19` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.368167 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2229a0064b42d88f84448115ff450a, user_id=6d3934c5660947f28734aefe3cb1c9b9, role_id=7faa3dc09867417b8ea82703161cde19)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.370912 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.386198 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4553/9084] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:15:26 2022] PUT /identity/v3/projects/2f2229a0064b42d88f84448115ff450a/users/6d3934c5660947f28734aefe3cb1c9b9/roles/7faa3dc09867417b8ea82703161cde19 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:15:26.391527 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b64e-3dd1-4ff1-8b74-d4ea66fb81c3 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.391825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b64e-3dd1-4ff1-8b74-d4ea66fb81c3 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.392156 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b64e-3dd1-4ff1-8b74-d4ea66fb81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.406160 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:26.412369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-3cc6b64e-3dd1-4ff1-8b74-d4ea66fb81c3 None None] MFA Rules not processed for user `152e93db3c4b47f4a0815a7df2a050f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:26.414267 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-3cc6b64e-3dd1-4ff1-8b74-d4ea66fb81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:26.476542 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4532/9085] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 22:15:26.491617 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:26.494545 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:26.518288 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:26.558251 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26f95f-82f9-4199-80a7-fc9ea52a008b admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:26.562424 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:26.563074 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:26.563365 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:26.563652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:26.573355 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:26.574797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:26.584855 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4554/9086] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:30.617098 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:30.617608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:30.617742 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:30.644671 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] MFA Rules not processed for user `6d3934c5660947f28734aefe3cb1c9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:30.645886 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:30.718751 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4533/9087] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:15:30.719560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:30.772107 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774038-47ca-41cf-8b9b-4d82944f121a service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:30.787523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:30.787523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:30.787523 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:30.787920 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] PATH_INFO: `/v3/projects` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:30.788748 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:30.790785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:30.859432 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4555/9088] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 25 22:15:30 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 22:15:30.863282 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:30.876297 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba1e7a-bcba-4d05-ac81-149bdf23135f None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:30.951606 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:30.952450 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:30.952807 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:30.953159 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] PATH_INFO: `/v3/users` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:30.953988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:30.956099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:30.984277 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4534/9089] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 25 22:15:30 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 22:15:30.985627 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:30.996941 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3ee4-1136-47e0-9fd5-0ed3c10fec27 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:31.002024 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:31.002830 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:31.003180 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:31.003486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:31.004214 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:31.005943 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:31.018861 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4556/9090] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:15:31.023221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:31.034261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234561a-fe79-44ab-8593-39b7472c4d80 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:31.038988 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:31.039901 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:31.040187 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:31.040496 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] PATH_INFO: `/v3/projects/101c1d25cf044292b919c657ee93ded8/users/ca99abbed8b741809f49b173b37f3278/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:31.057047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101c1d25cf044292b919c657ee93ded8, user_id=ca99abbed8b741809f49b173b37f3278, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:31.059897 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:31.075745 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4535/9091] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:15:31 2022] PUT /identity/v3/projects/101c1d25cf044292b919c657ee93ded8/users/ca99abbed8b741809f49b173b37f3278/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:15:31.079845 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:31.090663 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccb462-9fcd-478c-a1c5-a8b60f768d2c admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:31.151856 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:31.152732 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:31.153118 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:31.153487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:31.154301 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:31.156005 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f3d5-3c67-4120-a9ae-1bce342a8a23 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:31.167420 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4557/9092] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 22:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 22:15:31.171819 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:31.177716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:31.183647 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fd16a-aa03-400e-8d75-d3ed9913fd00 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:31.190594 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:31.191542 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:31.191823 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:31.192099 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] PATH_INFO: `/v3/projects/101c1d25cf044292b919c657ee93ded8/users/ca99abbed8b741809f49b173b37f3278/roles/54803232909643ca80ca0cfb291c7f49` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:31.194203 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=101c1d25cf044292b919c657ee93ded8, user_id=ca99abbed8b741809f49b173b37f3278, role_id=54803232909643ca80ca0cfb291c7f49)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:31.197058 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:31.208861 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4536/9093] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 25 22:15:31 2022] PUT /identity/v3/projects/101c1d25cf044292b919c657ee93ded8/users/ca99abbed8b741809f49b173b37f3278/roles/54803232909643ca80ca0cfb291c7f49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:15:35.835188 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83293d4-dc72-45f3-8d04-10d917ff9df8 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:35.835692 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83293d4-dc72-45f3-8d04-10d917ff9df8 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:35.835791 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83293d4-dc72-45f3-8d04-10d917ff9df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:35.863746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-c83293d4-dc72-45f3-8d04-10d917ff9df8 None None] MFA Rules not processed for user `ca99abbed8b741809f49b173b37f3278`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:35.864947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-c83293d4-dc72-45f3-8d04-10d917ff9df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:35.909010 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:35.939953 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4558/9094] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 22:15:35.956034 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:35.957992 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:36.045374 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ed663-81b0-4221-ac04-167edfd0a8cc admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:36.051335 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:36.051994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:36.052249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:36.052563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:36.114301 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:36.115983 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:36.125665 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4537/9095] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:37.241772 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:37.242313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:37.242313 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:37.264804 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] MFA Rules not processed for user `6d3934c5660947f28734aefe3cb1c9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:15:37.265753 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:37.276049 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4559/9096] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:15:46.121830 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:46.237020 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:46.239524 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:46.256921 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc57fd-6c79-46a0-bf2c-9a9eaa1522f3 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:46.263408 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:46.264222 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:46.265181 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:46.265494 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:46.267402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:46.282744 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:46.284595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:46.300650 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4538/9097] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:47.256346 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=14 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:48.881116 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:48.882807 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:48.978403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e08c4-86c7-4532-a503-780ff97e3aa6 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:48.982560 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:48.983280 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:48.983574 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:48.983824 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:48.993722 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:48.995182 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442178b-1777-4106-a53e-2482aa9ef199 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:49.006193 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4560/9098] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:15:50.680371 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:15:50.690610 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29b7c4-2e30-4566-a10c-738ab2a9ea09 service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:15:50.694773 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:15:50.695459 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:15:50.695800 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:15:50.696047 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:15:50.698026 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:15:50.708155 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:15:50.709716 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:15:50.719005 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4539/9099] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:15:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 22:15:59.001272 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=35 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:16:00.714674 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:25.531170 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468e5-5b8e-42fa-80a9-6b2cf14e6369 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:25.531727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468e5-5b8e-42fa-80a9-6b2cf14e6369 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:25.531727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468e5-5b8e-42fa-80a9-6b2cf14e6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:25.561349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-79f468e5-5b8e-42fa-80a9-6b2cf14e6369 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:18:25.562558 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-79f468e5-5b8e-42fa-80a9-6b2cf14e6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:25.620830 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4561/9100] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 22:18:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:18:25.677397 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:25.679041 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:25.757657 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45049f-e46b-4101-a2e1-4284cfb7acbc service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:25.766130 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:25.767169 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:25.767625 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:25.768078 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:25.777402 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:25.779032 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:25.787114 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4540/9101] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:18:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:18:34.593630 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:34.594161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:34.594161 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:34.612379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] MFA Rules not processed for user `6d3934c5660947f28734aefe3cb1c9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:18:34.613609 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:34.621260 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4562/9102] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 25 22:18:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:18:34.663595 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:34.665175 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:34.744857 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c30b67-6cec-4692-85bf-2afcb9231d06 service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:34.750366 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cddedee376f4cf4a01caffdea20716d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:34.751353 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:34.751737 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:34.752112 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:34.755249 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:34.783029 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:34.784534 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:34.806289 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4541/9103] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:35.099292 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:35.111647 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50331275-e3f7-42c1-bfc2-37ab78201540 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:35.117025 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:35.118233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:35.118525 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:35.118805 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:35.120806 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:35.131503 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:35.132973 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:35.141014 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4563/9104] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:35.479510 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:35.481077 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:35.497964 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:35.507760 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddd209-aeba-44f2-bfa5-10b7c153108f service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:35.512938 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:35.513720 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:35.514104 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:35.514403 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:35.516757 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:35.530405 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:35.531843 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7c4b-d624-4247-99fd-2dd8d4e78f57 service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:35.536888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=100 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:35.543006 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4564/9105] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:35.553639 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956195a9-42ce-4b56-a4a2-3d681a3ec186 service glance] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:35.561867 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:35.562537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:35.562821 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:35.563209 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:35.565088 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:35.577154 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:35.578760 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:35.591214 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4542/9106] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:36.809533 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] REQUEST_METHOD: `POST` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:36.810044 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:36.810174 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:36.829100 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.auth.core [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:18:36.830564 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:36.838204 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4565/9107] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 22:18:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:18:36.851089 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:36.863489 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e3358-bde9-4a04-a2cb-9c5e64235586 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:36.868689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:36.869350 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:36.869678 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:36.869958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:36.879025 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:36.880776 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:36.889422 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4543/9108] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:18:46.823629 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=47 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:46.886066 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=14 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:47.165576 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:47.185093 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bf68-7dca-41b8-a7d2-e765e6de6164 None None] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:47.190863 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:47.191547 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:47.191883 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:47.192164 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:47.201349 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:47.216266 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:47.218766 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:47.231996 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4566/9109] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:52.219739 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:52.243378 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e21e1f-5f49-4b03-bc10-281418a535fc service swift] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:52.249369 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:52.250053 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:52.250334 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:52.250618 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:52.252556 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:52.281188 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:52.283825 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:52.296234 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4544/9110] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:54.877049 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:54.879298 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:54.894065 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8ade4-8cde-4a63-971c-b22b946a4683 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:54.900631 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:54.901304 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:54.901592 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:54.901878 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:54.903746 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:54.915981 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:54.917605 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:54.927929 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4567/9111] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:18:58.194012 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:18:58.206728 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a2a4-8db1-4dda-85a3-3fb14fe0d8d1 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:18:58.213201 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:18:58.213865 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:18:58.214153 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:18:58.214433 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:18:58.216614 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:18:58.230003 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:18:58.231644 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:18:58.242890 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4545/9112] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:19:04.923895 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=12 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:08.238537 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=21 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:20:58.754329 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:20:58.764526 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f0aed-9b40-4018-aa56-9d6027cd29e9 service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:20:58.769079 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:20:58.769704 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:20:58.769989 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:20:58.770265 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:20:58.777939 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:20:58.779395 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:20:58.787511 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4568/9113] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:20:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:21:08.784206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=6 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:11.706726 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:11.721934 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763f8d-e0d2-4ab2-93bc-49e8c0cc5f9c service nova] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:11.728631 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:11.729601 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:11.729990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:11.730385 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:11.742684 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:11.744302 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4d91-39c4-4773-863c-8fcb8002f634 service nova] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:11.753727 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4546/9114] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:21:19.957069 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:19.973357 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e60f85-2850-4a94-814a-cffc20f3750b service neutron] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:19.979671 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bce2e604e9444a99b194c1a5a9f96683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:19.980404 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:19.980785 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:19.981128 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:19.990551 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:19.992232 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:20.003125 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4569/9115] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:21:20.567119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb610d7-4702-43ae-9cbd-dc37bad155e0 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:20.567629 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb610d7-4702-43ae-9cbd-dc37bad155e0 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:20.567736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb610d7-4702-43ae-9cbd-dc37bad155e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:20.617845 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-9bb610d7-4702-43ae-9cbd-dc37bad155e0 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:21:20.619045 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-9bb610d7-4702-43ae-9cbd-dc37bad155e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:20.637224 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4547/9116] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 25 22:21:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:21:20.680030 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:20.702211 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d1c83-bfce-4694-9097-418645e0af58 service nova] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:20.707811 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:20.708635 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:20.708975 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:20.709379 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:20.718727 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:20.720326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:20.728730 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4570/9117] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:21:29.644393 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2412-2cf9-4691-8dbb-cf30540dfbaf None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:29.644973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2412-2cf9-4691-8dbb-cf30540dfbaf None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:29.644973 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2412-2cf9-4691-8dbb-cf30540dfbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:29.664256 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-36ec2412-2cf9-4691-8dbb-cf30540dfbaf None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:21:29.665501 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-36ec2412-2cf9-4691-8dbb-cf30540dfbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:29.673740 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4548/9118] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:21:29.687505 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:29.698400 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328dc54-df16-4dff-a1dd-91ad937ac4ef service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:29.704341 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:29.704915 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:29.705189 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:29.705463 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:29.714043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:29.715616 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:29.724191 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4571/9119] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:21:34.615627 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] REQUEST_METHOD: `POST` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:34.616126 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:34.616233 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:34.634528 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.auth.core [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] MFA Rules not processed for user `8942fa716189487aa6c949730a9de90f`. Rule list: `[]` (Enabled: `True`). {{(pid=97719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 22:21:34.635733 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:34.643533 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4549/9120] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 25 22:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 22:21:34.656326 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:34.667002 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794994e8-cd33-4fb8-ac20-63d3c799b08d service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:34.672590 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c226aaf467e44e59b368c6b5c9db1cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:34.673231 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:34.673516 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:34.673797 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:34.684013 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:34.686582 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:34.699227 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4572/9121] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 25 22:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 22:21:38.715881 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:38.720958 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=31 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:38.727613 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd89655-3c88-4374-9e5d-b140b70b8c46 None None] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:38.731511 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07213aded8c456785f17c358a348083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:38.732228 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:38.732563 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:38.732891 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:38.804106 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:38.805659 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:38.815788 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4550/9122] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:21:41.692213 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:41.708206 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90ba3-609e-44fe-a722-275fd20933ea service swift] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:41.714822 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:41.715489 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:41.715770 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:41.716043 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:41.718496 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:41.733486 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:41.735376 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:41.747374 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4573/9123] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:21:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 22:21:45.000333 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:45.014485 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e16d4-decd-4f4d-af5c-14c37d39e56d service neutron] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:45.020272 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:45.021298 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:45.021888 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:45.022322 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:45.024990 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:45.039664 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:45.041439 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:45.054691 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4551/9124] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:21:45.065248 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:45.078053 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8de38-3c86-4265-b2bf-4bd2225eef3b service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:45.084482 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:45.085733 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:45.086146 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:45.086487 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] PATH_INFO: `/v3/users/6d3934c5660947f28734aefe3cb1c9b9` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:45.087889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3934c5660947f28734aefe3cb1c9b9)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:45.090903 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:45.143926 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3934c5660947f28734aefe3cb1c9b9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.144661 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3934c5660947f28734aefe3cb1c9b9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.154594 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3934c5660947f28734aefe3cb1c9b9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.166798 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3934c5660947f28734aefe3cb1c9b9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.173750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3934c5660947f28734aefe3cb1c9b9'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.179721 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4574/9125] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:21:45 2022] DELETE /identity/v3/users/6d3934c5660947f28734aefe3cb1c9b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:21:45.364472 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:45.375689 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77679f-e63f-4280-8f0f-658bfbba8308 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:45.440105 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:45.441035 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:45.441326 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:45.441608 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] PATH_INFO: `/v3/projects/2f2229a0064b42d88f84448115ff450a` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:45.442833 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2229a0064b42d88f84448115ff450a)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:45.444836 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:45.495076 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2229a0064b42d88f84448115ff450a', 'request_id': 'req-8ee22226-a633-4861-92c9-ea2922fac82b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.503368 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2229a0064b42d88f84448115ff450a', 'request_id': 'req-8ee22226-a633-4861-92c9-ea2922fac82b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.508994 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2229a0064b42d88f84448115ff450a', 'request_id': 'req-8ee22226-a633-4861-92c9-ea2922fac82b'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.520665 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] The token cache is being invalidate because project 2f2229a0064b42d88f84448115ff450a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:21:45.520940 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.521619 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.523223 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4552/9126] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:21:45 2022] DELETE /identity/v3/projects/2f2229a0064b42d88f84448115ff450a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:21:45.527407 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:45.528947 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:45.542600 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ab7-d9e9-4c92-8afc-6deaf15bb93d admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:45.595475 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:45.603354 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:45.604260 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:45.604593 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:45.605233 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] PATH_INFO: `/v3/users/ca99abbed8b741809f49b173b37f3278` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:45.606700 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca99abbed8b741809f49b173b37f3278)` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:45.609204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:45.657084 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca99abbed8b741809f49b173b37f3278'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.657735 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca99abbed8b741809f49b173b37f3278'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.665680 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca99abbed8b741809f49b173b37f3278'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.678782 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca99abbed8b741809f49b173b37f3278'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.688649 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.notifications [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca99abbed8b741809f49b173b37f3278'} {{(pid=97720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:45.696011 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4575/9127] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 22:21:45 2022] DELETE /identity/v3/users/ca99abbed8b741809f49b173b37f3278 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:21:45.884638 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:21:45.886091 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:21:45.903115 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee22226-a633-4861-92c9-ea2922fac82b admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:21:45.912736 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:45.962989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e93db3c4b47f4a0815a7df2a050f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d98522b7634403f83ff66fd72edfd9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:21:45.963862 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:21:45.964148 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:21:45.964431 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] PATH_INFO: `/v3/projects/101c1d25cf044292b919c657ee93ded8` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:21:45.965711 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=101c1d25cf044292b919c657ee93ded8)` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:21:45.967656 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:21:46.016308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101c1d25cf044292b919c657ee93ded8', 'request_id': 'req-830b232e-a3fa-405f-9cf5-224f7d91d315'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:46.025255 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101c1d25cf044292b919c657ee93ded8', 'request_id': 'req-830b232e-a3fa-405f-9cf5-224f7d91d315'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:46.031308 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101c1d25cf044292b919c657ee93ded8', 'request_id': 'req-830b232e-a3fa-405f-9cf5-224f7d91d315'} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:46.043221 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] The token cache is being invalidate because project 101c1d25cf044292b919c657ee93ded8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 22:21:46.043514 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:46.044236 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.notifications [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 22:21:46.045933 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4553/9128] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 22:21:45 2022] DELETE /identity/v3/projects/101c1d25cf044292b919c657ee93ded8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 22:21:55.691840 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:56.040119 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:23:57.237154 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:23:57.238867 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:23:57.328249 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03c456-bdb1-47d2-ad62-762b336bfe43 admin admin] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:23:57.396652 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:23:57.397321 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:23:57.397587 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:23:57.397889 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:23:57.399877 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:23:57.411539 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:23:57.413183 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:23:57.423283 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4576/9129] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:23:58.320080 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:23:58.321645 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:23:58.352191 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b232e-a3fa-405f-9cf5-224f7d91d315 admin admin] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:23:58.358438 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:23:58.359094 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:23:58.359380 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:23:58.359655 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:23:58.361701 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.fernet_utils [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:23:58.373617 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:23:58.375212 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:23:58.385299 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4554/9130] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:23:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:24:07.419434 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=64 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:24:08.381227 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=12 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:03.215204 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] Authenticating user token {{(pid=97720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:29:03.216893 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.fernet_utils [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 22:29:03.290430 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762413c2-9b94-4518-b2de-cb734bc55b4f service placement] Validating token access rules against request {{(pid=97720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:29:03.296061 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:29:03.296750 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] REQUEST_METHOD: `GET` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:29:03.297034 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] SCRIPT_NAME: `/identity` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:29:03.297317 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:29:03.305945 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:29:03.307536 ncdv-master-1 devstack@keystone.service[97720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f1a2-0d42-4b42-8025-cd20838ef0ad service placement] RBAC: Authorization granted {{(pid=97720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:29:03.317604 ncdv-master-1 devstack@keystone.service[97720]: [pid: 97720|app: 0|req: 4577/9131] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:29:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:29:06.333482 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] Authenticating user token {{(pid=97719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 22:29:06.381567 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265899dc-8233-4239-bd95-24aaff7bb021 service placement] Validating token access rules against request {{(pid=97719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 22:29:06.387033 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237820e4132b4e65898c330ae2240d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 22:29:06.387710 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] REQUEST_METHOD: `GET` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 22:29:06.387989 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] SCRIPT_NAME: `/identity` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 22:29:06.388261 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 22:29:06.396780 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 22:29:06.398395 ncdv-master-1 devstack@keystone.service[97719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab4759-9546-43d2-a4c6-64281e089d49 service placement] RBAC: Authorization granted {{(pid=97719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 22:29:06.408008 ncdv-master-1 devstack@keystone.service[97719]: [pid: 97719|app: 0|req: 4555/9132] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 25 22:29:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 22:29:13.313695 ncdv-master-1 devstack@keystone.service[97720]: DEBUG dbcounter [-] [97720] Writing DB stats keystone:SELECT=31 {{(pid=97720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:16.404305 ncdv-master-1 devstack@keystone.service[97719]: DEBUG dbcounter [-] [97719] Writing DB stats keystone:SELECT=21 {{(pid=97719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}